Wednesday, Jan. 19- DAILY AGENDA
Build Language Models
Workshop will be an in-depth tutorial on transfer learning for natural language. Will cover state of the art models and how to perform transfer learning in general with practical examples. Topics that will be covered:
Concepts:
-
Seq2Seq
-
Attention & Self-attention
-
Transformers
-
Transfer learning
-
SOTA models
-
Network pruning
Workshop:
-
Question answering model
-
Dialog model
-
Language models