Beam Search 4.Visit seq2seq implmentation

Goal

Understand how decoder works. Especially how it handles y(t) and y(t + 1). Do they come at once?

Step by step

• predict.py
  • token_ids (input to encoder)
  • run
  • returns outputs (output from decoder)
• What type is output_logits?
  • seq2seq.outputs
  • seq2seq.outputs is first return value of tf.contrib.legacy_seq2seq.model_with_buckets
  • it's seq2seq(encoder_inputs[:bucket[0]], decoder_inputs[:bucket[1]]) where seq2seq is passed into the model_with_buckets
• Who initiate outputs?
• Who will outputs?
• When outputs is filled?