1.

2.

3.

4.

5.

6.Sequence to Sequence http://www.wildml.com/2016/01/attention-and-memory-in-deep-learning-and-nlp/

7.Lecture 1 4 : NSML, Smartest ML Platform

8.DNN, CNN, RNN http://practicalquant.blogspot.hk/2013/10/deep-learning-oral-traditions.html

9.Exercise 13-1 Implement Neural Machine Translation by Jointly Learning to Align and Translate: https://arxiv.org/abs/1409.0473 C t https://arxiv.org/abs/1409.0473

10.loss = 0 hidden = encoder(x) input = SOS for label in labels: hidden, output = model(hidden, input) loss += criterion(output, label) input = one_hot(output.max(1)) loss.backward() optimizer.step() Summary: S2S (WIP) y t y t-1 x l h t y 1