Utilizing Tech Season 6 - Utilizing AI

Tech Field Day

This is Utilizing Tech, the podcast about emerging Technology from Gestalt IT hosted by Stephen Foskett, Organizer of the Tech Field Day event series, part of The Futurum Group. In Season 6, we are returning to the topic of artificial intelligence where we will explore the practical applications and impact AI on technological innovations in enterprise IT. Season 6: Utilizing AI Season 5: Utilizing Edge Computing Season 4: Utilizing CXL Season 1-3: Utilizing AI read less
TechnologyTechnology

Episodes

06x10: Using AI in Modern Applications with Matthew Wallace
6d ago
06x10: Using AI in Modern Applications with Matthew Wallace
As we consider the impact of AI on modern applications, we should consider the ways that this technology will improve these products. This episode of Utilizing Tech brings Matthew Wallace, CTO of Kamiwaza AI, to discuss the adoption of AI in application development with Allyson Klein and Stephen Foskett. Large SaaS providers were the first to add AI-powered features but this technology is rapidly coming to market across the spectrum of applications. Matthew likens this to the evolution from spreadsheets to SaaS tools and cloud, which was a similar revolution. He mentions tools like ?, Cursor, Llama2, Mixtral, and more. We also discuss retrieval-automated generation (RAG), which enables LLMs to bring in external data at run time. We must also consider the source of the data, both in training and RAG, and questions of sovereignty, privacy, copyright, and safety. Looking forward, Matthew expects companies to customize their own models based on use case specific data. Looking forward, we expect new frameworks and models to be adopted rapidly to bring maturity and reliability to AI in enterprise applications throughout 2024. Hosts: Stephen Foskett, Organizer of Tech Field Day: ⁠⁠https://www.linkedin.com/in/sfoskett/⁠⁠ Allyson Klein: ⁠⁠https://www.linkedin.com/in/allysonklein/ Guest: Matthew Wallace, CTO and Cofounder of KamiwazaAI: https://www.linkedin.com/in/matthewwallaceco/ Follow Utilizing Tech Website: ⁠⁠https://www.UtilizingTech.com/⁠⁠ X/Twitter: ⁠⁠https://www.twitter.com/UtilizingTech ⁠⁠ Tech Field Day Website: ⁠⁠https://www.TechFieldDay.com⁠⁠ LinkedIn: ⁠⁠https://www.LinkedIn.com/company/Tech-Field-Day ⁠⁠ X/Twitter: ⁠https://www.Twitter.com/TechFieldDay Tags: @UtilizingTech, @SFoskett, @TechAllyson, @KamiwazaAI, @TechFieldDay, #AIFD4, #AI, #UtilizingAI,
06x09: Modern Application Development Using AI with Paul Nashawaty of The Futurum Group
Apr 15 2024
06x09: Modern Application Development Using AI with Paul Nashawaty of The Futurum Group
AI is accelerating application development and modernization in many ways, but developers are just ramping up their use of the technology. This episode of Utilizing Tech includes Paul Nashawaty, who focuses on application development at The Futurum Group, discussing this topic with Allyson Klein and Stephen Foskett. Use cases for AI include documentation, chatbots, data integration, programming co-pilots, and more. Regardless of how AI is used, organizations must accept that they are ultimately responsible for the products and outputs produced. Accelerating testing and thus the entire DevOps release cycle is one area where AI is making incredible growth. Another popular concept is retrieval-augmented generation (RAG) which brings existing datasets to generative AI to improve results. There is currently a lack of confidence in AI-based solutions and concern about the complexity and level of effort required to bring them to market, so vendors must help make deployment easier and better integrated. Product vendors are addressing this by delivering solutions with partners and popular platforms and frameworks. Open source tools and open data are also helping to move AI technologies forward. Developers want invisible infrastructure and platforms that just work, and the emerging AI PC segment promises more processing power on the desktop. 2024 is shaping up to be the year of AI in application development. Hosts: Stephen Foskett, Organizer of Tech Field Day: ⁠https://www.linkedin.com/in/sfoskett/⁠ Allyson Klein: ⁠https://www.linkedin.com/in/allysonklein/ Paul Nashawaty, Practice Lead, Application Development Modernization at The Futurum Group: https://www.linkedin.com/in/paulnashawaty/ Follow Utilizing Tech Website: ⁠https://www.UtilizingTech.com/⁠ X/Twitter: ⁠https://www.twitter.com/UtilizingTech ⁠ Tech Field Day Website: ⁠https://www.TechFieldDay.com⁠ LinkedIn: ⁠https://www.LinkedIn.com/company/Tech-Field-Day ⁠ X/Twitter: https://www.Twitter.com/TechFieldDay Tags: #UtilizingAI, #AppDev, #AI, @TheFuturumGroup, @GestaltIT, @TechFieldDay, @SFoskett, @TechAllyson, @PNashawaty,
06x08: Operationalizing AI with VAST Data
Apr 8 2024
06x08: Operationalizing AI with VAST Data
We are at a turning point, as AI has matured from theoretical experimentation to practical application. In this episode of Utilizing Tech, Neeloy Bhattacharyya joins Allyson Klein and Stephen Foskett to discuss how VAST Data's customers and partners are making practical use of AI. Data is the key to successful AI-powered applications, and VAST Data supports both unstructured and structured data sets. Neeloy emphasizes the interactive nature of AI application development and the flexibility required to support this. He also discusses the need for structured data to support LLMs and the challenges of keeping these up to date and synchronized. One of the biggest issues in deploying AI applications is the complexity inherent in these systems. That's why it's heartening to see companies working together to created integrations and standardized platforms to make AI easier to deploy. Collaboration is the key to making AI practical. Hosts: Stephen Foskett, Organizer of Tech Field Day: https://www.linkedin.com/in/sfoskett/ Allyson Klein: https://www.linkedin.com/in/allysonklein/ Guest: Neeloy Bhattacharyya, Director of AI/HPC Solutions Engineering at VAST Data: https://www.linkedin.com/in/neeloybhattacharyya/ Follow Utilizing Tech Website: https://www.UtilizingTech.com/ X/Twitter: https://www.twitter.com/UtilizingTech Tech Field Day Website: https://www.TechFieldDay.com LinkedIn: https://www.LinkedIn.com/company/Tech-Field-Day X/Twitter: https://www.Twitter.com/TechFieldDay Tags: #UtilizingAI, #AI, #Data, @VAST_Data,
06x06: AI Is My Co Pilot with Chris Grundemann
Mar 25 2024
06x06: AI Is My Co Pilot with Chris Grundemann
Everyone uses AI today, whether they know it or not, and it's critical for users of this technology to understand its capability and limitations. This episode of Utilizing Tech features Chris Grundemann, a fellow podcast host and Tech Field Day delegate, talking the many ways we use AI every day. Like Frederic Van Haren and Stephen Foskett, Chris uses AI to assist with content creation in many ways, from summarization and organization of data to image generation. Content creators are using AI tools like ChatGPT, Stable Diffusion, and more to process data, but we all agree that it's best to spend time and effort to refine the output, especially when it comes to tone and voice. We are also using AI based tools for coding and structuring data, especially interactively. Although some have suggested that AI will replace content creators or coders, the technology is instead democratizing access and making it easier to use on a daily basis. It also makes computing more available to those who were previously locked out, expanding the impact of the technology we have spent decades creating. Hosts: Stephen Foskett, Organizer of Tech Field Day: ⁠⁠⁠https://www.linkedin.com/in/sfoskett/⁠⁠⁠ Frederic Van Haren, CTO and Founder of HighFens, Inc.: ⁠⁠⁠https://www.linkedin.com/in/fredericvharen/⁠ Guest: Chris Grundemann, Managing Director at Grundemann Solutions: https://www.linkedin.com/in/cgrundemann/ Follow Gestalt IT and Utilizing Tech Website: ⁠⁠⁠⁠⁠https://www.GestaltIT.com/⁠⁠⁠⁠⁠ Utilizing Tech: ⁠⁠⁠⁠⁠https://www.UtilizingTech.com/⁠⁠⁠⁠⁠ X/Twitter: ⁠⁠⁠⁠⁠https://www.twitter.com/GestaltIT⁠⁠⁠⁠⁠ X/Twitter: ⁠⁠⁠⁠⁠https://www.twitter.com/UtilizingTech⁠⁠⁠⁠⁠ LinkedIn: ⁠⁠⁠⁠⁠https://www.linkedin.com/company/Gestalt-IT #UtilizingAI #Storage #AI #Datacenter #Hyperscale @UtilizingTech
06x04: Keeping Your GPUs Fed with a Data Pipeline from Hammerspace with Molly Presley
Mar 11 2024
06x04: Keeping Your GPUs Fed with a Data Pipeline from Hammerspace with Molly Presley
AI training is a uniquely data-hungry application, and it requires a special data pipeline to keep expensive GPUs fed. This episode of Utilizing Tech focuses on the data platform for machine learning, featuring Molly Pressley of Hammerspace along with Frederic Van Haren and Stephen Foskett. Nothing is worse than idle hardware, especially when it comes to expensive GPUs intended for ML training. Performance is important, but parallel access and access to multiple systems is just as important. Building an AI training environment requires identifying and eliminating bottlenecks at every layer, but many systems are simply not capable of scaling to the extent required by the largest GPU clusters. But a data pipeline goes way beyond storage: Training requires checkpoints, metadata, and access to different data points. And different models have unique requirements as well. Ultimately, AI applications require a flexible data pipeline not just high-performance storage. Hosts: Stephen Foskett, Organizer of Tech Field Day: ⁠⁠⁠https://www.linkedin.com/in/sfoskett/⁠⁠⁠ Frederic Van Haren, CTO and Founder of HighFens, Inc.: ⁠⁠⁠https://www.linkedin.com/in/fredericvharen/⁠ Guest: Molly Presley, Head of Global Marketing at Hammerspace: https://www.linkedin.com/in/mollyjpresley/ Follow Gestalt IT and Utilizing Tech Website: ⁠⁠⁠⁠⁠https://www.GestaltIT.com/⁠⁠⁠⁠⁠ Utilizing Tech: ⁠⁠⁠⁠⁠https://www.UtilizingTech.com/⁠⁠⁠⁠⁠ X/Twitter: ⁠⁠⁠⁠⁠https://www.twitter.com/GestaltIT⁠⁠⁠⁠⁠ X/Twitter: ⁠⁠⁠⁠⁠https://www.twitter.com/UtilizingTech⁠⁠⁠⁠⁠ LinkedIn: ⁠⁠⁠⁠⁠https://www.linkedin.com/company/Gestalt-IT Tags: #UtilizingAI #AI #AITraining @Hammerspace_Inc @UtilizingTech
06x02: Private AI is a Reality with Chris Wolf of VMware by Broadcom
Feb 26 2024
06x02: Private AI is a Reality with Chris Wolf of VMware by Broadcom
AI is all about data, so it is no surprise that enterprises are deploying their own private AI inside the firewall. This episode of Utilizing Tech brings Chris Wolf, Global Head of AI and Advanced Services at VMware by Broadcom, to discuss private AI with Frederic Van Haren and Stephen Foskett. Companies looking to deploy AI are finding that it doesn't require nearly as much hardware as expected, software is widely available, and are reluctant to trust sensitive data to a service provider. VMware by Broadcom is deploying their own private AI code assist, keeping proprietary software and standards inside the firewall. But the solution also helps the AI team be more agile and responsive to the needs of the business and customers. One of the first use cases they found for private AI was customer support, and this is tightly integrated with internal documentation and sources to ensure valid responses. The biggest challenge is to integrate unstructured data, which can be spread across many locations, and this is actively being investigated by companies like Broadcom as well as projects like LlamaIndex. VMware has contributed back to the open source community, notably with the Ray workload scheduler, open source models, and related projects. It's important to build community and long-term engagement and support for open source as well, and this is in keeping with the overall trends in the AI community. Organizations looking to get started with private AI should consider the VMware by Broadcom reference architecture, which incorporates best practices at a smaller scale and pick a use case that provides immediate value. Hosts: Stephen Foskett, Organizer of Tech Field Day: ⁠https://www.linkedin.com/in/sfoskett/⁠ Frederic Van Haren, CTO and Founder of HighFens, Inc.: ⁠https://www.linkedin.com/in/fredericvharen/⁠ Chris Wolf, Global Head of AI and Advanced Services at VMware by Broadcom: https://www.linkedin.com/in/cswolf/ Follow Gestalt IT and Utilizing Tech Website: ⁠⁠⁠https://www.GestaltIT.com/⁠⁠⁠ Utilizing Tech: ⁠⁠⁠https://www.UtilizingTech.com/⁠⁠⁠ X/Twitter: ⁠⁠⁠https://www.twitter.com/GestaltIT⁠⁠⁠ X/Twitter: ⁠⁠⁠https://www.twitter.com/UtilizingTech⁠⁠⁠ LinkedIn: ⁠⁠⁠https://www.linkedin.com/company/Gestalt-IT Tags: #UtilizingAI, #AI, #PrivateAI, @VMware, @Broadcom, @UtilizingTech, @GestaltIT, @SFoskett, @FredericVHaren,
06x01: The Bedrock of AI is Data with Nick Magnuson and Clive Bearman of Qlik
Feb 19 2024
06x01: The Bedrock of AI is Data with Nick Magnuson and Clive Bearman of Qlik
Data is the foundation on which AI models are built, and integration of enterprise data will be the key to generative AI applications. This episode of Utilizing Tech brings Nick Magnuson and Clive Bearman from Qlik to discuss the integration of data and AI with Frederic Van Haren and Stephen Foskett. Enterprises sometimes worry that their data will never be ready for AI or that they will feed models with too much low-quality data, and overcoming this issue is one of the first hurdles. Another application for machine learning is improving data quality, organizing and tagging unstructured data for applications. The concept of curated data is an interesting one, since it promises to elevate the value of enterprise data. But what if a flood of data causes the model to make the wrong connections? If data is to be a product it must be profiled, tagged, and organized, and ML can help make this happen. The trend of generative AI is driving budgets and priorities to make data more useful and organized, but even unstructured data streams can be valuable. The application of large language models to structured data is promising as well, since it enables people to query these data sets even if they lack the background and skills to construct queries. Hosts: Stephen Foskett, Organizer of Tech Field Day: https://www.linkedin.com/in/sfoskett/ Frederic Van Haren, CTO and Founder of HighFens, Inc.: https://www.linkedin.com/in/fredericvharen/ Guests: Nick Magnuson, Head of AI, Qlik: https://www.linkedin.com/in/nick-magnuson-0a253931/ Clive Bearman, Senior Director of Product Marketing, Qlik: https://www.linkedin.com/in/clivebearman/ Follow Gestalt IT and Utilizing Tech Website: ⁠⁠https://www.GestaltIT.com/⁠⁠ Utilizing Tech: ⁠⁠https://www.UtilizingTech.com/⁠⁠ X/Twitter: ⁠⁠https://www.twitter.com/GestaltIT⁠⁠ X/Twitter: ⁠⁠https://www.twitter.com/UtilizingTech⁠⁠ LinkedIn: ⁠⁠https://www.linkedin.com/company/Gestalt-IT
06x00: Looking Forward to the Year of AI with Frederic Van Haren and Mark Beccue
Feb 12 2024
06x00: Looking Forward to the Year of AI with Frederic Van Haren and Mark Beccue
In the two years since we focused on AI on this podcast, OpenAI added a simple conversational interface to their deep-learning model and AI has exploded on society. This season of Utilizing Tech focuses on practical applications for artificial intelligence and features co-hosts Frederic Van Haren and Mark Beccue along with Stephen Foskett. In this episode we return to AI with a look back at the incredible impact that generative AI has had on society. Humans traditionally interfaced with machines using keyboard and mouse, touch and gesture, but ChatGPT changed all that by enabling people to communicate with computers verbally. But this is just one of many potential AI model components that can be used to build business applications. The true power of generative AI will be realized when these other components appear, and when they are able to integrate custom data. We will also see innovation in the AI infrastructure stack, from GPUs to NPUs to CPUs, storage and data platforms, and even client devices. Follow Gestalt IT and Utilizing Tech Website: ⁠https://www.GestaltIT.com/⁠ Utilizing Tech: ⁠https://www.UtilizingTech.com/⁠ X/Twitter: ⁠https://www.twitter.com/GestaltIT⁠ X/Twitter: ⁠https://www.twitter.com/UtilizingTech⁠ LinkedIn: ⁠https://www.linkedin.com/company/Gestalt-IT Tags: @UtilizingTech, @GestaltIT, @TheFuturumGroup, @SFoskett, @FredericVHaren, @FutureBec, #UtilizingAI, #AI, #GenerativeAI, #AINetworking,
05x22: Edge Innovation is Coming from All Directions
Oct 2 2023
05x22: Edge Innovation is Coming from All Directions
As we've discussed all season on Utilizing Edge, innovation is coming from all directions, including hardware, software, and applications. This special crossover episode of the On-Premise IT and Utilizing Tech podcasts features Edge Field Day delegates Brian Knudtson, Ned Bellavance, and Jody Lemoine discussing their perspectives about edge innovation with Stephen Foskett. The primary drivers at the edge are integration, efficiency, and connectivity, as well as the unique needs of the applications there. Starting with hardware, customers are headed in two directions, with more enterprise availability features deployed in some locations and less-capable hardware in others, both in terms of compute and networking. At the software level, most edge infrastructure is hyper-converged, meaning that multiple layers of the stack are integrated in software and managed as one. Although intended as an application platform, Kubernetes is being deployed as a packaging abstraction and distribution solution at the edge. Host: Stephen Foskett: https://www.linkedin.com/in/sfoskett/ Guests: Ned Bellavance: https://www.linkedin.com/in/ned-bellavance/ Brian Knudtson: https://www.linkedin.com/in/bknudtson/ Jody Lemoine: https://www.linkedin.com/in/jodyl/ Follow Gestalt IT and Utilizing Tech Website: https://www.GestaltIT.com/ Utilizing Tech: https://www.UtilizingTech.com/ Twitter: https://www.twitter.com/GestaltIT Twitter: https://www.twitter.com/UtilizingTech LinkedIn: https://www.linkedin.com/company/Gestalt-IT Tags: #EFD2, #Edge, #UtilizingEdge, @UtilizingTech, @GestaltIT, @SFoskett, @Ned1313, @GhostInTheNet, @BKnudtson,
05x19: The Intersection of Edge, Blockchain, and IoT with Jason Benedicic
Sep 11 2023
05x19: The Intersection of Edge, Blockchain, and IoT with Jason Benedicic
Although blockchain technology has been tainted by scammers, the core idea of distributed consensus is relevant for certain edge applications. This episode of Utilizing Edge focuses on practical application of blockchain technology in edge and IoT, featuring Jason Benedicic, Alastair Cooke, and Stephen Foskett. Two key concepts in blockchain are the distributed ledger and consensus approach. There is a lot of work being done to apply blockchain in medical, finance, IoT, and proof of provenance. Although many applications can rely on authority or quorum, larger and more heterogeneous applications might benefit from consensus instead. The other aspect of blockchain, chain of custody and immutability of data, is potentially relevant in preventing supply chain attacks and dealing with transient devices. It's important to remember that many of the things that have put people off blockchain, from financialization to public exposure of transactions, are not necessarily required in all blockchains. Guest: Jason Benedicic: https://www.twitter.com/JBenedicic Hosts: Stephen Foskett: https://www.twitter.com/SFoskett Alastair Cooke: https://www.twitter.com/DemitasseNZ Follow Gestalt IT and Utilizing Tech Website: https://www.GestaltIT.com/ Utilizing Tech: https://www.UtilizingTech.com/ Twitter: https://www.twitter.com/GestaltIT Twitter: https://www.twitter.com/UtilizingTech LinkedIn: https://www.linkedin.com/company/Gestalt Tags: #UtilizingEdge, #Edge, #Blockhain, #IoT, @GestaltIT, @UtilizingTech, @SFoskett, @DemitasseNZ, @JBenedicic,
05x15: Addressing Data Challenges in Media and Entertainment with Jimmy Fusil of Tsecond
Aug 7 2023
05x15: Addressing Data Challenges in Media and Entertainment with Jimmy Fusil of Tsecond
Media and entertainment is one industry generating and moving vast amounts of data at the edge. This episode of Utilizing Edge brings Jimmy Fusil of Tsecond into a discussion with Alastair Cooke and Stephen Foskett about the unique data challenges in media and entertainment. There is a great need for local processing, secure data transport, and efficient storage utilization in managing the ever-increasing volume of data generated during film and TV production. The podcast explores the continued relevance of physical media, like tape, for long-term archiving, while also emphasizing the security measures necessary to protect creative privacy and prevent potential plot leaks in the industry. Fusil also discusses Tsecond’s groundbreaking product, Bryck, a portable NVMe storage device capable of holding up to a petabyte of data with a remarkable 40GBps data transfer speed. The discussion highlights how Bryck’s high-performance storage facilitates on-device data processing, ensuring quick backups and maintaining data integrity. It’s critical to consider edge storage solutions like Bryck in many data-intensive sectors beyond media and entertainment as well. Hosts: Stephen Foskett: https://www.twitter.com/SFoskett Alastair Cooke: https://www.twitter.com/DemitasseNZ Guest: Jimmy Fusil, M&E Expert and Business Development Manager, Tsecond https://www.linkedin.com/in/jimmyfusil/ Follow Gestalt IT and Utilizing Tech Website: https://www.GestaltIT.com/ Utilizing Tech: https://www.UtilizingTech.com/ Twitter: https://www.twitter.com/GestaltIT Twitter: https://www.twitter.com/UtilizingTech LinkedIn: https://www.linkedin.com/company/Gestalt-IT Tags: #UtilizingEdge #EdgeComputing #Bryck #EdgeStorage
05x14. Considering the Diversity of Edge Solutions with Brian Chambers and Alastair Cooke
Jul 31 2023
05x14. Considering the Diversity of Edge Solutions with Brian Chambers and Alastair Cooke
Edge computing comes in many forms and brings many challenges, including bandwidth limitations, network reliability issues, and limited space. This episode of Utilizing Edge brings Brian Chambers, Alastair Cooke, and Stephen Foskett together to discuss the state of the edge in 2023. Industries like retail, multi-tenant environments, and industrial IoT find practical applications, but defining the edge remains an ongoing exploration. Implementation varies, from repurposing existing technologies to adopting modern approaches like containers and function as a service. The debate between virtual machines and containers continues, driven by organizational comfort. Despite constraints, edge environments offer greater control and accountability. The future promises more innovation and adoption, cementing edge computing’s significance in the tech landscape. Hosts: Stephen Foskett: https://www.twitter.com/SFoskett Alastair Cooke: https://www.twitter.com/DemitasseNZ Brian Chambers: https://www.twitter.com/BriChamb Follow Gestalt IT and Utilizing Tech Website: https://www.GestaltIT.com/ Utilizing Tech: https://www.UtilizingTech.com/ Twitter: https://www.twitter.com/GestaltIT Twitter: https://www.twitter.com/UtilizingTech LinkedIn: https://www.linkedin.com/company/Gestalt-IT Tags: #UtilizingEdge, #EdgeDiversity, #EdgeComputing, #EdgeSolutions, @UtilizingTech, @SFoskett, @DemitasseNZ, @BriChamb, @GestaltIT,