https://tuhinsharma.netlify.app/tags/transformer/TransformerHugo Blox Builder (https://hugoblox.com)en-usWed, 06 Nov 2024 14:15:00 +0000https://tuhinsharma.netlify.app/media/icon_hu55b84836e614877e119cbfa37f6d5a66_1386708_512x512_fill_lanczos_center_3.pnghttps://tuhinsharma.netlify.app/tags/transformer/https://tuhinsharma.netlify.app/blogs/multihead-attention/Wed, 06 Nov 2024 14:15:00 +0000https://tuhinsharma.netlify.app/blogs/multihead-attention/<h2>Description</h2> <p>In our pursuit of creating a fun dialogue completer using transformers, we chose to build a system that could complete famous quotes — like those from Cersei Lannister when she played the game of thrones. To achieve this, we first passed our input text through an embedding layer, adding position information to each word embedding to create position-aware embeddings. These were then sent forward to the next layer. In this segment, we dive deeper into the transformative heart of transformer models: the multi-head attention mechanism, which, I must warn, is a powerful multi-faceted component.</p> <p><a href="https://medium.com/@tuhinsharma121/riding-multi-headed-dragons-decoding-the-power-of-multi-head-attention-in-transformers-7c9d18dc2b68"><p><strong>Read more..</strong></p></a></p>