06x02: Private AI is a Reality with Chris Wolf of VMware by Broadcom
Utilizing Tech - Season 7: AI Data Infrastructure Presented by Solidigm
English - February 26, 2024 14:00 - 31 minutes - 36 MB - ★★★★★ - 1 ratingTechnology Homepage Download Apple Podcasts Google Podcasts Overcast Castro Pocket Casts RSS feed
AI is all about data, so it is no surprise that enterprises are deploying their own private AI inside the firewall. This episode of Utilizing Tech brings Chris Wolf, Global Head of AI and Advanced Services at VMware by Broadcom, to discuss private AI with Frederic Van Haren and Stephen Foskett. Companies looking to deploy AI are finding that it doesn't require nearly as much hardware as expected, software is widely available, and are reluctant to trust sensitive data to a service provider. VMware by Broadcom is deploying their own private AI code assist, keeping proprietary software and standards inside the firewall. But the solution also helps the AI team be more agile and responsive to the needs of the business and customers. One of the first use cases they found for private AI was customer support, and this is tightly integrated with internal documentation and sources to ensure valid responses. The biggest challenge is to integrate unstructured data, which can be spread across many locations, and this is actively being investigated by companies like Broadcom as well as projects like LlamaIndex. VMware has contributed back to the open source community, notably with the Ray workload scheduler, open source models, and related projects. It's important to build community and long-term engagement and support for open source as well, and this is in keeping with the overall trends in the AI community. Organizations looking to get started with private AI should consider the VMware by Broadcom reference architecture, which incorporates best practices at a smaller scale and pick a use case that provides immediate value.
Hosts:
Stephen Foskett, Organizer of Tech Field Day: https://www.linkedin.com/in/sfoskett/
Frederic Van Haren, CTO and Founder of HighFens, Inc.: https://www.linkedin.com/in/fredericvharen/
Chris Wolf, Global Head of AI and Advanced Services at VMware by Broadcom: https://www.linkedin.com/in/cswolf/
Follow Gestalt IT and Utilizing Tech
Website: https://www.GestaltIT.com/
Utilizing Tech: https://www.UtilizingTech.com/
X/Twitter: https://www.twitter.com/GestaltIT
X/Twitter: https://www.twitter.com/UtilizingTech
LinkedIn: https://www.linkedin.com/company/Gestalt-IT
Tags: #UtilizingAI, #AI, #PrivateAI, @VMware, @Broadcom, @UtilizingTech, @GestaltIT, @SFoskett, @FredericVHaren,