File:Attention-1-sn.png

Page contents not supported in other languages.
This is a file from the Wikimedia Commons
From Wikipedia, the free encyclopedia

Attention-1-sn.png(672 × 464 pixels, file size: 14 KB, MIME type: image/png)

Summary

Description
English: Left (black) part is the autoencoder. Middle (red) part is the Attention unit. Right (grey & colored) is the data calculated. Subscript shows examples of vector sizes, except for i-1 which shows time step.
Date
Source Own work
Author Numiri

Licensing

I, the copyright holder of this work, hereby publish it under the following license:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

Captions

encoder-decoder with attention

Items portrayed in this file

depicts

14 January 2021

image/png

f983a60bcec8833b6aad1e495ecb4c5f3df63df2

14,152 byte

464 pixel

672 pixel

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current21:04, 13 December 2021Thumbnail for version as of 21:04, 13 December 2021672 × 464 (14 KB)Numirichange grey arrow darkness
18:08, 13 December 2021Thumbnail for version as of 18:08, 13 December 2021720 × 486 (15 KB)Numiride-emphasize direct connection from encoder RNN to decoder RNN
14:49, 30 November 2021Thumbnail for version as of 14:49, 30 November 20211,031 × 724 (32 KB)Numirichanged input vocabulary from 10k to 9k
14:43, 30 November 2021Thumbnail for version as of 14:43, 30 November 20211,030 × 714 (32 KB)Numirichanged "y" to underscore "Y"
14:31, 30 November 2021Thumbnail for version as of 14:31, 30 November 20211,021 × 714 (32 KB)Numirirevert D1 and D2 to plain D
14:28, 30 November 2021Thumbnail for version as of 14:28, 30 November 20211,026 × 706 (32 KB)Numirienlarged final layer. changed D to D1 and D2.
19:14, 18 January 2021Thumbnail for version as of 19:14, 18 January 2021676 × 513 (16 KB)Numirisplit decoder into 2
05:43, 15 January 2021Thumbnail for version as of 05:43, 15 January 2021701 × 561 (27 KB)Numiriattention color change. added c = H*w inside decoder
14:19, 14 January 2021Thumbnail for version as of 14:19, 14 January 2021698 × 523 (30 KB)Numiriremoved subscript on red H
13:49, 14 January 2021Thumbnail for version as of 13:49, 14 January 2021698 × 523 (30 KB)NumiriUploaded own work with UploadWizard
The following pages on the English Wikipedia use this file (pages on other projects are not listed):

Global file usage

The following other wikis use this file:

Metadata