Algorithm
1.RNN training loop
2.Sequence to Sequence training loop
3.Attention training loop
展开查看详情
6.Sequence to Sequence http://www.wildml.com/2016/01/attention-and-memory-in-deep-learning-and-nlp/
7.Lecture 1 4 : NSML, Smartest ML Platform
8.DNN, CNN, RNN http://practicalquant.blogspot.hk/2013/10/deep-learning-oral-traditions.html
9.Exercise 13-1 Implement Neural Machine Translation by Jointly Learning to Align and Translate: https://arxiv.org/abs/1409.0473 C t https://arxiv.org/abs/1409.0473
10.loss = 0 hidden = encoder(x) input = SOS for label in labels: hidden, output = model(hidden, input) loss += criterion(output, label) input = one_hot(output.max(1)) loss.backward() optimizer.step() Summary: S2S (WIP) y t y t-1 x l h t y 1
