Wednesday, Jan. 19- DAILY AGENDA

Build Language Models

Workshop will be an in-depth tutorial on transfer learning for natural language. Will cover state of the art models and how to perform transfer learning in general with practical examples. Topics that will be covered:

Concepts:

• Seq2Seq

• Attention & Self-attention

• Transformers

• Transfer learning

• SOTA models

• Network pruning

Workshop:

• Question answering model

• Dialog model

• Language models