Data Parallelism VS Model Parallelism: Link Federated Learning Swarm Learning for decentralized and confidential clinical machine learning – Link AI with swarm intelligence to analyse medical data – Link
Category: Deep Learning
Multimodal Deep Learning
MIT 6.S191 Lecture 5 Multimodal Deep Learning – Link What nobody tells you about MULTIMODAL Machine Learning! 🙊 THE definition. – Link Deep Audio-Visual Speech Recognition by Triantafyllos Afouras et. al. – Link
Deep Reinforcement Learning
Deep Reinforcement Learning for Autonomous Driving by Sen Wang et. al. – Link Neural Architecture Search with Reinforcement Learning by Barret Zoph et. al. – Link Deep Reinforcement Learning that Matters by Peter Henderson et. al. – Link https://gym.openai.com/ Reinforcement Learning (DQN) Tutorial – Link A friendly introduction to deep reinforcement learning, Q-networks and policy…
Contrastive Learning
Contrastive Representation Learning by Lilian Weng – Link Understanding Contrastive Learning (Learn how to learn without labels using self-supervised learning) – Link Supervised Contrastive Learning by Prannay Khosla et. al @NeurIPS 2020 – Link Extending Contrastive Learning to the Supervised Setting by AJ Maschinot et. al. – Link
Deep Learning on the Edge
How do we Optimize Deep Learning models for edge devices? Training a single AI model can emit as much carbon as five cars in their lifetimes Parameter Removal: Identify the trainable layers in the model and reduce the number of parameters! Weight Pruning: Specific connections between neurons are removed. In practice this removal means replacing…
Domain Randomization
Domain Randomization: future of robust modeling by Urwa Muaz Invariance, Causality, and Robust Deep Learning – Why do Neural networks fail to generalize to new environments, and how can this be fixed? by by Urwa Muaz
Important Concepts in Deep Learning
Chromosome Segmentation in Pytorch using U-Net Architecture
Details about the usecase can be studied from the references given below in the references section. Following is the source code. The code was run on Google Colab. Imports & Utilities Importing the Libraries Following is the code to set device based on the type of machine (CPU or GPU). Following is the code for…
Must Read Papers
Neural Architecture Search Neural Architecture Search: A Survey – Thomas Elsken Literature on Neural Architecture Search Transfer Learning & Domain Adaptation Model Compression – Cristian Bucila˘ et. al. – KDD 2006 A Survey on Transfer Learning – Sinno Jialin Pan, et. al. – 2010 Unbiased look at dataset bias – Antonio Torralba et. al. –…