Neural Network Insights

Neural Network Insights

#nlp-transformers

Articles tagged with #nlp-transformers

Visualize Attention Mechanism in Sequence to Sequence Models
Attention mechanism is really fascinating. It tries to mimic human way of perceiving the world. In this post, I will provide visualizations on how attention mechanisms work on different simple problems. I will demonstrate them by reversing, right shi...
Jul 22, 20243 min read12
Visualization of Self-Attention Network for Sentiment Analysis
I use Self-Attention network for Sentiment Analysis. This model is equivalent to 1 head of Multi head Transformer Encoder. I use the IMDB dataset which contains 50K movie reviews which are marked positive or negative in sentiment. Architecture The i...
Jul 21, 20244 min read5