Data synthesis for SOTA LLMs

Practical AI: Machine Learning, Data Science

Feb 6 2024 • 46 mins

Nous Research has been pumping out some of the best open access LLMs using SOTA data synthesis techniques. Their Hermes family of models is incredibly popular! In this episode, Karan from Nous talks about the origins of Nous as a distributed collective of LLM researchers. We also get into fine-tuning strategies and why data synthesis works so well.

You Might Like

Acquired
Acquired
Ben Gilbert and David Rosenthal
Darknet Diaries
Darknet Diaries
Jack Rhysider
Hard Fork
Hard Fork
The New York Times
Marketplace Tech
Marketplace Tech
Marketplace
WSJ’s The Future of Everything
WSJ’s The Future of Everything
The Wall Street Journal
Rich On Tech
Rich On Tech
Rich DeMuro
TechStuff
TechStuff
iHeartPodcasts
The Vergecast
The Vergecast
The Verge
Fortnite Emotes
Fortnite Emotes
Lawrence Hopkinson
Waveform: The MKBHD Podcast
Waveform: The MKBHD Podcast
Vox Media Podcast Network