Historically neuroscience has inspired many deep learning techniques. Now the two fields are converging. Neuroscience continues to inspire more powerful deep learning models and deep learning models are used to understand the working mechanism of the brain. Interaction between the two fields will benefit both of them.