14_ Sequence to Sequence

下载 0

Pony2

发布于

1725

人观看

信息技术

Algorithm 1.RNN training loop 2.Sequence to Sequence training loop 3.Attention training loop

展开查看详情

1 .

2 .

3 .

4 .

5 .

6 .Sequence to Sequence http://www.wildml.com/2016/01/attention-and-memory-in-deep-learning-and-nlp/

7 .Lecture 1 4 : NSML, Smartest ML Platform

8 .DNN, CNN, RNN http://practicalquant.blogspot.hk/2013/10/deep-learning-oral-traditions.html

9 .Exercise 13-1 Implement Neural Machine Translation by Jointly Learning to Align and Translate: https://arxiv.org/abs/1409.0473 C t https://arxiv.org/abs/1409.0473

10 .loss = 0 hidden = encoder(x) input = SOS for label in labels: hidden, output = model(hidden, input) loss += criterion(output, label) input = one_hot(output.max(1)) loss.backward() optimizer.step() Summary: S2S (WIP) y t y t-1 x l h t y 1

6 点赞

1 收藏

0下载