Moin Nadeem (MIT): The extraordinary future of natural language models

Machine Learning Engineered

Nov 3 2020 • 1 hr 24 mins

Moin Nadeem is a masters student at MIT, where he studies natural language generation. His research interests broadly include natural language processing, information retrieval, and software systems for machine learning. Learn more about Moin: ( ( Want to level-up your skills in machine learning and software engineering? Join the ML Engineered Newsletter: ( Comments? Questions? Submit them here: ( Follow Charlie on Twitter: ( Take the Giving What We Can Pledge: ( Subscribe to ML Engineered: ( Timestamps: 01:35 Follow Charlie on Twitter ( ( 03:10 How Moin got started in computer science 05:50 Using ML to identify depression on Twitter in high school 11:00 Building a system to track phone locations on MIT’s campus 14:35 Specializing in NLP 17:20 Building an end-to-end fact-checking system ( ( 25:15 Predicting statement stance with neural multi-task learning ( ( 27:20 Is feature engineering in NLP dead? 29:40 Reconciling language models with existing knowledge graphs 35:20 How advances in AI hardware will affect NLP research (crazy!) 47:25 Moin’s research into sampling algorithms for natural language generation ( ( 57:10 Under-rated areas of ML research 01:00:10 How research works at MIT CSAIL 01:04:35 How Moin keeps up in such a fast-moving field 01:11:30 Starting the MIT Machine Intelligence Community 01:16:30 Rapid Fire Questions Links: (FAKTA: An Automatic End-to-End Fact Checking System) (StereoSet: Measuring stereotypical bias in pretrained language models) (Neural Multi-Task Learning for Stance Prediction) (Rich Sutton - The Bitter Lesson) (A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation) (Strategies for Pre-training Graph Neural Networks) (Transformers For Image Recognition at Scale) (Cerebras CS-1) (Klarity: AI for Law Contract Review) (Jacob Andreas) (Jure Leskovec) (Shoe Dog) (Hamilton) (Becoming) (Mindset) (The Innovators)