Unexplored Territory

Duncan Epping, Frank Denneman, Johan van Amersfoort

The Unexplored Territory Podcast is a bi-weekly show discussing topics such as cloud computing, virtualization, cloud-native applications, Kubernetes, machine learning, datacenter technology, and important VMware based or VMware related emerging technologies and news. The show is hosted by Duncan Epping, Frank Denneman, and Johan van Amersfoort and each episode will feature an industry-leading expert to dive deep into their area of expertise.

read less
TechnologyTechnology
NewsNews
EducationEducation
Tech NewsTech News

Episodes

#076 - AI Roles Demystified: A Guide for Infrastructure Admins with Myles Gray
May 26 2024
#076 - AI Roles Demystified: A Guide for Infrastructure Admins with Myles Gray
In this conversation, Myles Gray discusses the AI workflow and its personas, the responsibilities of data scientists and developers in deploying AI models, the role of infrastructure administrators, and the challenges of deploying models at the edge. He also explains the concept of quantization and the importance of accuracy in models. Additionally, he talks about the pipeline for deploying models and the difference between unit testing and integration testing. Unit testing is used to test the functionality of a single module or function within an application. Integration testing involves testing the interaction between different components or applications. MLflow and other tools are used to store and manage ML models. Smaller models are emerging as a solution to the resource constraints of large models. Collaboration between different personas is important for ensuring security and governance in AI projects. Data governance policies are crucial for maintaining data quality and consistency.TakeawaysThe AI workflow involves multiple personas, including data scientists, developers, and infrastructure administrators.Data scientists play a crucial role in developing AI models, while developers are responsible for deploying the models into production.Infrastructure administrators need to consider the virtualization layer and ensure efficient and easy consumption of infrastructure components.Deploying AI models at the edge requires quantization to reduce model size and considerations for form factor, scale, and connectivity.The pipeline for deploying models involves steps such as unit testing, scanning for vulnerabilities, building container images, and pushing to a registry.Unit testing focuses on testing individual components, while integration testing ensures the compatibility and functionality of the entire system. Unit testing is used to test the functionality of a single module or function within an application.Integration testing involves testing the interaction between different components or applications.MLflow and other tools are used to store and manage ML models.Smaller models are emerging as a solution to the resource constraints of large models.Collaboration between different personas is important for ensuring security and governance in AI projects.Data governance policies are crucial for maintaining data quality and consistency.Chapters00:00 Understanding the AI Workflow and Personas03:24 The Role of Data Scientists and Developers in Deploying AI Models08:47 The Responsibilities of Infrastructure Administrators15:25 Challenges of Deploying Models at the Edge20:29 The Pipeline for Deploying AI Models24:45 Unit Testing vs. Integration Testing28:22 Managing ML Models with MLflow and Other Tools32:17 The Emergence of Smaller Models39:58 Collaboration for Security and Governance in AI Projects46:32 The Importance of Data GovernanceDisclaimer: The thoughts and opinions shared in this podcast are our own/guest(s), and not necessarily those of Broadcom or VMware by Broadcom.
#075 - Newsflash - VMware Workstation and Fusion licensing changes! (Did I hear free?)
May 14 2024
#075 - Newsflash - VMware Workstation and Fusion licensing changes! (Did I hear free?)
SummaryFor this special edition of the podcast Duncan invited Michael Roy to discuss the latest VMware Workstation and VMware Fusion announcements. VMware Workstation and Fusion are desktop hypervisor products that allow users to run virtual machines on their PC or Mac. Starting today, Workstation and Fusion commercial licenses will only be available through annual subscriptions. The price for both products is now $199 per year. The free versions of Fusion Player and Workstation Player are being discontinued, but the Pro versions will be available for free for personal use. Support for personal use products will be community-based, while commercial users will have support included in their subscription. The focus of future innovation will be on the integration between vSphere and Workstation/Fusion, providing a local virtual sandbox for learning, development, and testing.TakeawaysVMware Workstation and Fusion are desktop hypervisor products for running virtual machines on PC and Mac.Commercial use of Workstation and Fusion is shifting from perpetual licenses to annual subscriptions.The free versions of Fusion Player and Workstation Player are being discontinued, but the Pro versions will be available for free for personal use.Support for personal use products will be community-based, while commercial users will have support included in their subscription.Future innovation will focus on integrating vSphere with Workstation and Fusion to provide a local virtual sandbox for learning, development, and testing.LinksAnnouncement BlogThe Register articleDisclaimer: The thoughts and opinions shared in this podcast are our own/guest(s), and not necessarily those of Broadcom or VMware by Broadcom.
#074 - Exploring the Cloud-Native Computing Foundation (CNCF) with William Rizzo
May 13 2024
#074 - Exploring the Cloud-Native Computing Foundation (CNCF) with William Rizzo
In this conversation, Johan van Amersfoort interviews William Rizzo about the Cloud Native Computing Foundation (CNCF) and its impact on cloud computing and modern infrastructure. They discuss the role of the CNCF in making cloud native technology ubiquitous and the support it provides to cloud native projects. They also explore the advantages of using CNCF projects for IT admins and platform engineers, including the ability to build platforms with integrated and efficient tools. They touch on the future trends and developments within the CNCF, such as platform engineering and AI/ML workloads, and how IT professionals can prepare for these changes. William also shares his personal project on platform engineering and the importance of calculating the return on investment for platform engineering practices.TakeawaysThe CNCF aims to make cloud native technology ubiquitous by providing support and resources to cloud native projects.Using CNCF projects allows IT admins and platform engineers to build integrated and efficient platforms.Platform engineering and AI/ML workloads are future trends within the CNCF.Calculating the return on investment for platform engineering practices is important.William Rizzo is working on a project to simplify the calculation of return on investment for platform engineering practices.Chapters00:00 - Introduction and William Rizzo's IT Career03:09 - Overview of the Cloud Native Computing Foundation06:39 - Other Core Projects and Technologies Hosted by the CNCF10:17 - Impact of CNCF Projects and Principles on Cloud Computing13:31 - Advantages of Using CNCF Projects for IT Admins and Platform Engineers14:45 - Interoperability and Standardization across Cloud Platforms23:45 - Resources for Learning about Cloud Native Technologies28:17 - Future Trends and Developments within the CNCF38:49 - William Rizzo's Personal Project on Platform Engineering46:04 - Calculating the Return on Investment for Platform Engineering Practices49:28 - Closing RemarksMore about William: https://www.linkedin.com/in/william-rizzo/The link to the CNCF website: https://www.cncf.io/Follow us on X for updates and news about upcoming episodes: https://x.com/UnexploredPod.Last but not least, make sure to hit that subscribe button and share the episode with your friends and colleagues!Disclaimer: The thoughts and opinions shared in this podcast are our own/guest(s), and not necessarily those of Broadcom or VMware by Broadcom.
#073 - What was announced for vSAN in the last month? Featuring Pete Koehler!
Apr 28 2024
#073 - What was announced for vSAN in the last month? Featuring Pete Koehler!
In episode 073 Duncan and Pete discuss various updates and changes related to vSAN, including ReadyNode configurations, licensing, vSAN Max, capacity reporting, and compression ratios. They highlight the improvements in compression ratios with vSAN ESA, which can result in significant space efficiency gains. They also discuss the use cases for vSAN Max and vSAN HCI, as well as the flexibility in making changes to ReadyNode configurations. Overall, they emphasize the ongoing development and exciting future of vSAN and VMware Cloud Foundation.TakeawaysvSAN ESA offers improved compression ratios, with an average of 1.5x and some customers achieving 1.7x or better.vSAN Max is a centralized shared storage solution for vSphere clusters, providing storage services to multiple vSphere clusters.Customers can choose between vSAN Max and vSAN HCI based on their needs, such as independent scaling of storage and compute, separate lifecycle management, extending the life of existing vSphere clusters, or specific application requirements.Changes in ReadyNode configurations for vSAN Max have reduced the minimum number of hosts required and lowered the hardware requirements, making it more accessible for smaller enterprises.Capacity reporting in vSAN has been improved with the introduction of L0FS overhead, providing more accurate information on capacity usage.vSAN ESA's improved compression ratios, combined with RAID 5 or RAID 6 erasure coding, can result in significant space efficiency gains compared to the original storage architecture.Ongoing development and updates are expected in vSAN and VMware Cloud Foundation, with exciting new capabilities on the horizon.Linkshttps://core.vmware.com/blog/smaller-vsan-esa-readynodes-accommodate-vmware-vsphere-foundations-trial-capacity-capabilityhttps://docs.vmware.com/en/VMware-vSphere/8.0/rn/vsphere-esxi-80u2b-release-notes/index.htmlhttps://core.vmware.com/blog/improved-capacity-reporting-vmware-cloud-foundation-51-and-vsan-8-u2 https://core.vmware.com/blog/greater-flexibility-vsan-max-through-lower-hardware-and-cluster-requirements Follow us on X for updates and news about upcoming episodes: https://x.com/UnexploredPod.Last but not least, make sure to hit that subscribe button and share the episode with your friends and colleagues!Disclaimer: The thoughts and opinions shared in this podcast are our own/guest(s), and not necessarily those of Broadcom or VMware by Broadcom.
#072 - Chris Gully and the rise of Small Language Models
Apr 14 2024
#072 - Chris Gully and the rise of Small Language Models
SummaryChris Gully discusses his current role in the new Broadcom organization and highlights of his career. He emphasizes the importance of staying relevant in the technology industry and the value of working with cool and smart people. The conversation then shifts to the topic of small language models (SLMs) and their role in the landscape of gen AI applications. Gully explains that SLMs offer a more progressive approach to working with large language models (LLMs) and enable more efficient and scalable deployments. The discussion also touches on the components of gen AI applications, the need for right-sizing models, and the challenges of scalability and efficiency. Gully highlights the importance of data and its role in driving business outcomes through AI. The conversation concludes with a discussion on the benefits and limitations of fine-tuning LLMs and the potential future of SLMs. The conversation explores the concept of SLMs (Small Language Models) and their role in AI development. It discusses the advantages of SLMs over LLMs (Large Language Models) regarding efficiency, optimization, and governance. The conversation also touches on the challenges of infrastructure management and resource allocation in AI deployments. It highlights the importance of right-sizing workloads, distributing workloads across data centers, and maximizing resource utilization. The conversation concludes with a discussion on the future trends in machine learning and AI, including advancements in math and the need for accessible and efficient technology.LinksVMware's Approach to Private AIMicrosoft Phi-2 - The surprising power of small language modelsMixtralMixtral on HuggingFaceTakeawaysStaying relevant in the technology industry is crucial for career success.Small language models (SLMs) offer a more efficient and scalable approach to working with large language models (LLMs).Data is the most important and untapped asset for organizations, and leveraging it through AI can drive business outcomes.Scalability and efficiency are key challenges in deploying gen AI applications.Fine-tuning LLMs can enhance their precision and reduce the need for extensive training.The future of SLMs may involve dynamic training and efficient distribution to support evolving business needs. SLMs offer advantages in terms of efficiency, optimization, and governance compared to LLMs.Infrastructure management and resource allocation are crucial in AI deployments.Right-sizing workloads and maximizing resource utilization are key considerations.Future trends in machine learning and AI include advancements in math and the need for accessible and efficient technology.Follow us on X for updates and news about upcoming episodes: https://x.com/UnexploredPod.Last but not least, make sure to hit that subscribe button and share the episode with your friends and colleagues!Disclaimer: The thoughts and opinions shared in this podcast are our own/guest(s), and not necessarily those of Broadcom or VMware by Broadcom.
#071 - Developer Experience & Spring with DaShaun Carter
Apr 1 2024
#071 - Developer Experience & Spring with DaShaun Carter
In this new episode of the Unexplored Territory Podcast, DaShaun Carter, a Spring Developer Advocate at VMware Tanzu and Broadcom, discusses his career highlights, his home lab setup, and his passion for Spring. He explains the concept of developer experience and how Spring and Tanzu contribute to it. DaShaun also highlights the innovations in Spring, such as AOT processing and native images, and their impact on use cases. He discusses the relationship between the open source aspect of Spring and the closed source solutions in the Tanzu portfolio. Finally, he explores the importance of developer experience in platform engineering. In this conversation, DaShaun and Johan discuss the importance of collaboration between developers and platform engineers, the value of Spring for platform engineers, the role of AI in developer experience and Spring, interesting topics for the VMware Explore conference, and where to learn more about Spring and open source.TakeawaysSpring and Tanzu provide an easy and efficient developer experience, allowing developers to focus on solving problems and delivering software.Innovations in Spring, such as AOT processing and native images, enable the deployment of enterprise-grade workloads on low-cost devices and at scale.The open source aspect of Spring allows flexibility and choice for customers, while the commercial solutions in the Tanzu portfolio provide additional support and 24/7 access to experts.Developer experience plays a crucial role in platform engineering, as it attracts developers to the platform and enables efficient onboarding and deployment processes. Collaboration between developers and platform engineers is crucial for successful software delivery.Platform teams should build relationships with developers and continuously iterate on meeting their needs.Spring provides enterprise-grade, production-ready tools and frameworks that make the life of platform engineers easier.AI is becoming increasingly important in the developer experience, and Spring AI provides an abstraction layer for consuming AI models.Interesting topics for the VMware Explorer conference include overcoming obstacles in software delivery, cost-saving solutions, and success stories.To learn more about Spring and open source, connect with DaShaun on X, YouTube, and LinkedIn, and check out the Spring Office Hours show.Follow us on X for updates and news about upcoming episodes: https://x.com/UnexploredPod.Last but not least, make sure to hit that subscribe button and share the episode with your friends and colleagues!Disclaimer: The thoughts and opinions shared in this podcast are our own/guest(s), and not necessarily those of Broadcom or VMware by Broadcom.