The Future of ML and AI Infrastructure and Ethics with Dan Jeffries (Pachyderm, AI Infrastructure Alliance)

Machine Learning Engineered

Mar 16 2021 • 1 hr 36 mins

Dan Jeffries is the chief technical evangelist at Pachyderm, a leading data science platform. He's a prominent writer and speaker on all things related to the future. He's been in software for over two decades, many of those at Redhat, and is the founder of the AI Infrastructure Alliance and Practical AI Ethics. Learn more about Dan: https://twitter.com/Dan_Jeffries1 (https://twitter.com/Dan_Jeffries1) https://medium.com/@dan.jeffries (https://medium.com/@dan.jeffries) Every Thursday I send out the most useful things I’ve learned, curated specifically for the busy machine learning engineer. Sign up here: http://cyou.ai/newsletter (http://cyou.ai/newsletter) Follow Charlie on Twitter: https://twitter.com/CharlieYouAI (https://twitter.com/CharlieYouAI) Subscribe to ML Engineered: https://mlengineered.com/listen (https://mlengineered.com/listen) Comments? Questions? Submit them here: http://bit.ly/mle-survey (http://bit.ly/mle-survey) Take the Giving What We Can Pledge: https://www.givingwhatwecan.org/ (https://www.givingwhatwecan.org/) Timestamps: 02:15 How Dan got started in computer science 06:50 What Dan is most excited about in AI 14:45 Where we are in the adoption curve of ML 20:40 The "Canonical Stack" of ML 32:00 Dan's goal for the AI Infrastructure Alliance 40:55 "Problems that ML startups don't know they're going to have" 49:00 Closed vs open source tools in the Canonical Stack 01:00:05 Building out the "boring" part of the infrastructure to enable exciting applications 01:08:40 Dan's practical approach to AI Ethics 01:23:50 Rapid fire questions Links: https://www.pachyderm.com/ (Pachyderm) https://ai-infrastructure.org/ (AI Infrastructure Alliance) https://practical-ai-ethics.org/ (Practical AI Ethics Alliance) https://towardsdatascience.com/rise-of-the-canonical-stack-in-machine-learning-724e7d2faa75 (Rise of the Canonical Stack in Machine Learning) https://www.youtube.com/watch?v=q_KPNtmc9m8 (Rise of AI - The Age of AI in 2030) https://magenta.tensorflow.org/ (Google Magenta) https://www.youtube.com/watch?v=WXuK6gekU1Y (AlphaGo Documentary) https://www.annieduke.com/books/ (Thinking in Bets) https://www.goodreads.com/book/show/3872.A_History_of_the_World_in_6_Glasses (A History of the World in 6 Glasses) https://www.penguinrandomhouse.com/books/562923/super-thinking-by-gabriel-weinberg-and-lauren-mccann/ (Super-Thinking)