Description
In this talk, we will discuss the implementation of selective attention in deep networks. We will also talk about the pros and cons of different attention methods and provide insights and best practices. Practical implementations examples for both image processing and NLP will be presented. Finally, novel ideas for further research in the subject will be suggested.