This book constitutes the refereed post-proceedings of the First International Conference and Second International Conference on Deep Learning Theory and Applications, DeLTA 2020 and DeLTA 2021, was held virtually due to the COVID-19 crisis on July 8-10, 2020 and July 7-9, 2021. The 7 full papers included in this book were carefully reviewed and selected from 58 submissions. They present recent research on machine learning and artificial intelligence in real-world applications such as computer vision, information retrieval and summarization from structuredand unstructured multimodal data sources, natural language understanding andtranslation, and many other application domains.