MLOps.community
459 episodes - English - Latest episode: 11 days ago - ★★★★★ - 17 ratingsWeekly talks and fireside chats about everything that has to do with the new space emerging around DevOps for Machine Learning aka MLOps aka Machine Learning Operations.
Homepage Apple Podcasts Google Podcasts Overcast Castro Pocket Casts RSS feed
Episodes
What is AI Quality? // Mohamed Elgendy // MLOps Podcast #228
May 03, 2024 17:22 - 45 minutes - 42.1 MBMohamed Elgendy is the Co-Founder & CEO at Kolena. Additionally, Mohamed Elgendy has had 1 past job as the Director Of Product and Engineering at Synapse Technology Corporation. Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ MLOps podcast #228 with Mohamed Elgendy, Co-founder & CEO of Kolena Inc., What is AI Quality? // Abstract Delve into the multifaceted concept of AI Quality. Demetrios and Mo explore the idea that AI qual...
Handling Multi-Terabyte LLM Checkpoints // Simon Karasik // #228
April 30, 2024 17:57 - 55 minutes - 50.9 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com Simon Karasik is a proactive and curious ML Engineer with 5 years of experience. Developed & deployed ML models at WEB and Big scale for Ads and Tax. Huge thank you to Nebius AI for sponsoring this episode. Nebius AI - https://nebius.ai/ MLOps podcast #228 with Simon Karasik, Machine Learning Engineer at Nebius AI, Handling Multi-Terabyte LLM Checkpoints. // Abstract The talk p...
Leading Enterprise Data Teams // Sol Rashidi // #227
April 26, 2024 21:07 - 42 minutes - 39.4 MBSol Rashidi is an esteemed executive, leader, and influencer within the AI, Data, and Technology space. Having helped IBM launch Watson in 2011 as one of the earliest world applications of Artificial Intelligence, Sol has pioneered some of the early advancements of space. Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to @WeightsBiases for sponsoring this episode. WandB Free Courses - http://wandb.me/course...
The Rise of Modern Data Management // Chad Sanderson // #226
April 23, 2024 19:16 - 57 minutes - 53 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Chad Sanderson is passionate about data quality, and fixing the muddy relationship between data producers and consumers. He is a former Head of Data at Convoy, a LinkedIn writer, and a published author. He lives in Seattle, Washington, and is the Chief Operator of the Data Quality Camp. Huge thank you to @amazonwebservices for sponsoring this episode. AWS - https://aws.amazon.com...
Beyond AGI, Can AI Help Save the Planet? // Patrick Beukema // #225
April 19, 2024 19:36 - 54 minutes - 49.5 MBPatrick Beukema has a Ph.D. in neuroscience and has worked on AI models for brain decoding, which analyzes the brain's activity to decipher what people are seeing and thinking. Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to LatticeFlow for sponsoring this episode. LatticeFlow - https://latticeflow.ai/ MLOps podcast #225 with Patrick Beukema, Head / Technical Lead of the Environmental AI, Applied Science Org...
GenAI in Production - Challenges and Trends // Verena Weber // #224
April 17, 2024 00:56 - 48 minutes - 44.6 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Verena Weber believes that GenAI is going to transform the way we work and interact with devices. Her mission is to help companies prepare for this transformation. She has strong expertise in NLP and over 7 years of experience in Machine Learning. Huge thank you to @zilliz for sponsoring this episode. Zilliz - https://zilliz.com/ MLOps podcast #224 with Verena Weber, Generativ...
Introducing DBRX: The Future of Language Models // [Exclusive] Databricks Roundtable
April 12, 2024 16:12 - 48 minutes - 44.5 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ MLOps Coffee Sessions Special episode with Databricks, Introducing DBRX: The Future of Language Models, fueled by our Premium Brand Partner, Databricks. DBRX is designed to be especially capable of a wide range of tasks and outperforms other open LLMs on standard benchmarks. It also promises to excel at code and math problems, areas where others have struggled. Our panel of expe...
From MVP to Production // Day 2 Panel 2 // AI in Production Conference
April 09, 2024 20:56 - 36 minutes - 33.4 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ // Abstract Dive into the challenges of scaling AI models from Minimum Viable Product (MVP) to full production. The panel emphasizes the importance of continually updating knowledge and data, citing examples like teaching AI systems nuanced concepts and handling brand name translations. User feedback's role in model training, alongside evaluation steps like human annotation and he...
From MVP to Production // AI in Production Conference
April 09, 2024 20:56 - 36 minutes - 33.4 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ // Abstract Dive into the challenges of scaling AI models from Minimum Viable Product (MVP) to full production. The panel emphasizes the importance of continually updating knowledge and data, citing examples like teaching AI systems nuanced concepts and handling brand name translations. User feedback's role in model training, alongside evaluation steps like human annotation and ...
Data Engineering in the Federal Sector // Shane Morris // #223
April 05, 2024 17:00 - 1 hour - 58 MBShane Morris is now a Senior Executive Advisor at Devis. Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to @WeightsBiases for sponsoring this episode. WandB Free Courses - https://wandb.ai/telidavies/ml-news/reports/Introducing-W-B-MLOps-Courses-Free-Course-Effective-MLOps-Model-Development--VmlldzozMDk2ODA2 MLOps podcast #223 with Shane Morris, Senior Executive Advisor of Devis, Data Engineering in the Fede...
What Business Stakeholders Want to See from the ML Teams // Peter Guagenti // #222
April 02, 2024 10:46 - 1 hour - 74.6 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Peter Guagenti is an accomplished business builder and entrepreneur with expertise in strategy, product development, marketing, sales, and operations. Peter has helped build multiple successful start-ups to exits, fueling high growth in each company along the way. He brings a broad perspective, deep problem-solving skills, the ability to drive innovation amongst teams, and a pro...
MLOps - Design Thinking to Build ML Infra for ML and LLM Use Cases // Amritha Arun Babu & Abhik Choudhury // #221
March 29, 2024 13:30 - 1 hour - 55.2 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Amritha Arun Babu Mysore has been an expert in the field of consumer electronics, software products, and online marketplaces for the past 15 years. She has experience developing supply chains from the ground up, delivering AI-based products to millions of users, and advocating for ethical AI across Amazon, Wayfair, Salesforce, and NetApp. Abhik Choudhury is a Senior Analytics Man...
Looking Back on 4 Years of the MLOps Community // Demetrios Brinkmann // #220
March 26, 2024 13:46 - 1 hour - 59.1 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Demetrios Brinkmann is the founder of the MLOps Community. Brinkmann fell into the Machine Learning Operations world, and since, has interviewed the leading names around MLOps, Data Science, and Machine Learning. Huge thank you to Weights & Biases for sponsoring this episode. Weights & Biases - https://wandb.ai/site MLOps podcast #220 with our very own Founder of MLOps Community...
4 Years of the MLOps Community // Demetrios Brinkmann // #220
March 26, 2024 13:46 - 1 hour - 59.1 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Demetrios Brinkmann is the founder of the MLOps Community. Brinkmann fell into the Machine Learning Operations world, and since, has interviewed the leading names around MLOps, Data Science, and Machine Learning. Huge thank you to Weights & Biases for sponsoring this episode. Weights & Biases - https://wandb.ai/site MLOps podcast #220 with our very own Founder of MLOps Community...
The Art and Science of Training LLMs // Bandish Shah and Davis Blalock // #219
March 22, 2024 11:31 - 1 hour - 68.8 MBJoin us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to Databricks AI for sponsoring this episode. Databricks - http://databricks.com/ Bandish Shah is an Engineering Manager at MosaicML/Databricks, where he focuses on making generative AI training and inference efficient, fast, and accessible by bridging the gap between deep learning, large-scale distributed systems, and performance computing. Davis Blalock is a R...
Security and Privacy // Day 2 Panel 1 // AI in Production Conference
March 19, 2024 15:36 - 34 minutes - 31.7 MB// Abstract Diego, David, Ads, and Katharine, bring to light the risks, vulnerabilities, and evolving security landscape of machine learning as we venture into the AI-driven future. They underscore the importance of education in managing AI risks and the critical role privacy engineering plays in this narrative. They explore the legal and ethical implications of AI technologies, fostering a vital conversation on the balance between utility and privacy. // Bio Diego Oppenheimer - Moderator D...
[Exclusive] Zilliz Roundtable // Why Purpose-built Vector Databases Matter for Your Use Case
March 15, 2024 16:38 - 59 minutes - 54 MBFrank Liu is the Director of Operations & ML Architect at Zilliz, where he serves as a maintainer for the Towhee open-source project. Jiang Chen is the Head of AI Platform and Ecosystem at Zilliz. Yujian Tang is a developer advocate at Zilliz. He has a background as a software engineer working on AutoML at Amazon. MLOps Coffee Sessions Special episode with Zilliz, Why Purpose-built Vector Databases Matter for Your Use Case, fueled by our Premium Brand Partner, Zilliz. Engineering deep-di...
A Decade of AI Safety and Trust // Petar Tsankov // MLOps Podcast #218
March 12, 2024 11:25 - 58 minutes - 53.2 MBHuge thank you to LatticeFlow AI for sponsoring this episode. LatticeFlow AI - https://latticeflow.ai/.Dr. Petar Tsankov is a researcher and entrepreneur in the field of Computer Science and Artificial Intelligence. MLOps podcast #218 with Petar Tsankov, Co-Founder and CEO at LatticeFlow AI, A Decade of AI Safety and Trust. // Abstract // Bio Co-founder & CEO at LatticeFlow AI, building the world's first product enabling organizations to build performant, safe, and trustworthy AI systems....
The Real E2E RAG Stack // Sam Bean, Rewind AI // #217
March 08, 2024 16:02 - 1 hour - 64.2 MBThank you to Zilliz our wonderful sponsors of this episode create some amazing stuff with Zilliz RAG - https://zilliz.com/vector-database-use-cases/llm-retrieval-augmented-generation Sam Bean is a seasoned AI and machine learning expert, specializing in Large Language Models (LLMs) and search tech. With a computer science background and a drive for innovation, Sam leads the team at Rewind AI in leveraging advanced tech to tackle complex challenges. MLOps podcast #217 with Sam Bean, Softw...
The Real E2E RAG Stack // Sam Bean // #217
March 08, 2024 16:02 - 1 hour - 64.2 MBSam Bean is a seasoned AI and machine learning expert, specializing in Large Language Models (LLMs) and search tech. With a computer science background and a drive for innovation, Sam leads the team at Rewind AI in leveraging advanced tech to tackle complex challenges. MLOps podcast #217 with Sam Bean, Software Engineer (Applied AI) at Rewind.ai, The Real E2E RAG Stack. // Abstract What does a fully operational LLM + Search stack look like when you're running your own retrieval and inferen...
Managing Data for Effective GenAI Application // Anu Arora and Anass Bensrhir // #215
March 05, 2024 10:30 - 51 minutes - 46.7 MBAnass Bensrhir is the Associate Partner of McKinsey & Company Casablanca. Anu Arora is the Principal Data Engineering at McKinsey & Company. Check out mckinsey.com/quantumblack MLOps podcast #214 with QuantumBlack AI by McKinsey's Principal Data Engineer, Anu Arora and Associate Partner, Anass Bensrhir, Managing Data for Effective GenAI Application brought to you by our Premium Brand Partner QuantumBlack AI by @McKinsey . // Abstract Generative AI is poised to bring impact across all ...
Becoming an AI Evangelist // Alex Volkov // #215
March 01, 2024 12:37 - 1 hour - 68.2 MBAlex Volkov serves as the AI Evangelist with Weights & Biases, Host of ThursdAI, Founder and CEO Targum and AI Consultant GPU POOR Def. not an owl. MLOps podcast #215 with Alex Volkov, AI Evangelist at Weights & Biases, Becoming an AI Evangelist. // Abstract Follow Alex's journey into the world of AI, from being interested in running his first AI models to founding an AI startup, running a successful weekly AI news podcast & newsletter, and landing a job with @WeightsBiases . // Bio Ale...
LLM Use Cases in Production // AI in Production Conference // Panel 1
February 28, 2024 14:49 - 30 minutes - 28.2 MB// Abstract From startups achieving significant value with minor capabilities to AI revolutionizing sales calls and raising sales by 30%, we explore a series of interesting real-world use cases. Understanding the objectives and complexities of various industries, exploring the challenges of launching products, and highlighting the vital integration of the human touch with technology, this episode is a treasure trove of insights. // Bio Greg Kamradt - Moderator Greg has mentored thousands o...
Information Retrieval & Relevance // Daniel Svonava // #214
February 24, 2024 10:14 - 56 minutes - 51.3 MBDaniel Svonava is the Co-Founder of Superlinked. Daniel Svonava attended the Faculty of Informatics and Information Technologies, Slovak University of Technology. MLOps podcast #214 with Daniel Svonava, CEO & Co-founder at Superlinked, Information Retrieval & Relevance: Vector Embeddings for Semantic Search // Abstract In today's information-rich world, the ability to retrieve relevant information effectively is essential. This lecture explores the transformative power of vector embeddings...
Evaluating and Integrating ML Models // Morgan McGuire and Anish Shah // #213
February 21, 2024 10:35 - 51 minutes - 47.5 MBMorgan McGuire has held a variety of roles in the past 13 years. In 2008, he completed a Research Internship at Queen Mary, University of London. Currently, he is the Head of Growth ML and Growth ML Engineer at Weights & Biases. Anish Shah has been working in the tech industry since 2015. In 2015, he was a Technical Support at Fox School of Business at Temple University. In 2021, he has been an MLOps Engineer - Growth and a Tier 2 Support Machine Learning Engineer at Weights & Biases. ___...
Data Governance and AI // Alexandra Diem // #212
February 16, 2024 13:06 - 1 hour - 60.2 MBAlexandra Diem, PhD, has extensive experience in the field of AI, machine learning, and cloud analytics. Alexandra currently holds the position of Head of Cloud Analytics and MLOps at Gjensidige. Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners about how they are dealing with things such as cost optimization, latency requirements, trust of output, and debuggi...
Ads Ranking Evolution at Pinterest // Aayush Mudgal // #211
February 13, 2024 11:00 - 52 minutes - 48.2 MBAayush Mudgal is a Senior Machine Learning Engineer at Pinterest, currently leading the efforts around Privacy-Aware Conversion Modeling. Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners about how they are dealing with things such as cost optimization, latency requirements, trust of output, and debugging. You will also get the opportunity to join workshops th...
LLM Evaluation with Arize AI's Aparna Dhinakaran // #210
February 09, 2024 12:00 - 55 minutes - 51.1 MBLarge Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners about how they are dealing with things such as cost optimization, latency requirements, trust of output, and debugging. You will also get the opportunity to join workshops that will teach you how to set up your use cases and skip over all the headaches. Join the AI in Production Conference on February 15 and 22...
Powering MLOps: The Story of Tecton's Rift // Matt Bleifer & Mike Eastham // #209
February 06, 2024 11:46 - 1 hour - 58.6 MBMatt Bleifer is a Group Product Manager at Tecton, where he focuses on the core product experience such as building, testing, and productionizing feature pipelines as scale. Michael Eastham works as a Chief Architect at Tecton, which is a Business Intelligence (BI) Software company with an estimated 100 employees Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practition...
[Exclusive] QuantumBlack Round-table // Gen AI Buy vs Build, Commercial vs Open Source
February 02, 2024 11:40 - 56 minutes - 51.6 MBJoin our virtual conference 'AI in Production' Transform faster. Innovate smarter. Anticipate the future. At QuantumBlack, we unlock the power of artificial intelligence (AI) to help organizations reinvent themselves from the ground up—and accelerate sustainable and inclusive growth. MLOps Coffee Sessions Special episode with QuantumBlack, AI by McKinsey, GenAI Buy vs Build, Commercial vs Open Source, fueled by our Premium Brand Partner, QuantumBlack, AI by McKinsey. // Abstract Do you bu...
Micro Graph Transformer Powering Small Language Models // Jon Cooke // #208
January 30, 2024 13:56 - 57 minutes - 52.3 MBJon Cooke is the owner/founder of Dataception a Data, Analytics, and Data Product company, and the creator of the Data Product Pyramid, an adaptive Data Product operating model. MLOps podcast #208 with Jon Cooke, CTO of Dataception, Micro Graph Transformer - Specialist Small Language Models Using Graphs to Accelerate Data Product Eco-systems. // Abstract Specialist deconstructed Encoder/Decoder Transformers along with data product management and tech to vastly accelerate prototyping, build...
How Data Platforms Affect ML & AI // Jake Watson // #207
January 26, 2024 09:25 - 39 minutes - 35.9 MBJake Watson is the writer of thedataplatform.substack.com and Principal Data Engineer at The Oakland Group. MLOps podcast #207 with Jake Watson, Principal Data Engineer at The Oakland Group, How Data Platforms Affect ML & AI. // Abstract I’ve always told my clients and colleagues that traditional rule-based software is difficult, but software containing Artificial Intelligence (AI) and/or Machine Learning (ML)* is even more difficult, sometimes impossible. Why is this the case? Well, sof...
RAG Has Been Oversimplified // Yujian Tang // #206
January 23, 2024 09:31 - 48 minutes - 44.8 MBYujian is working as a Developer Advocate at Zilliz, where they develop and write tutorials for proof of concepts for large language model applications. They also give talks on vector databases, LLM Apps, semantic search, and tangential spaces. MLOps podcast #206 with Yujian Tang, Developer Advocate at Zilliz, RAG Has Been Oversimplified, brought to us by our Premium Brand Partner, Zilliz // Abstract In the world of development, Retrieval Augmented Generation (RAG) has often been oversimpl...
The Myth of AI Breakthroughs // Jonathan Frankle // #205
January 19, 2024 10:00 - 1 hour - 64.1 MBJonathan Frankle works as Chief Scientist (Neural Networks) at MosaicML (recently acquired by Databricks), a startup dedicated to making it easy and cost-effective for anyone to train large-scale, state-of-the-art neural networks. He leads the research team. MLOps podcast #205 with Jonathan Frankle, Chief Scientist (Neural Networks) at Databricks, The Myth of AI Breakthroughs, co-hosted by Denny Lee, brought to us by our Premium Brand Partner, Databricks. // Abstract Jonathan takes us behi...
MLOps at the Crossroads // Patrick Barker & Farhood Etaati // #204
January 16, 2024 10:21 - 49 minutes - 44.9 MBPatrick Barker is the Founder / CTO of Kentauros AI. Farhood Etaati is a Software Engineer at Yektanet. MLOps podcast #204 with Patrick Barker, CTO of Kentauros AI and Farhood Etaati, MLOps/Platform Team Lead at AIMedic, MLOps at the Crossroads. // Abstract MLOps is at a crossroads. The ever-increasing excitement for LLMs' ability to solve some interesting real-world problems has made many people interested in applying these models in new applications which comes with its own challenges, ...
Pioneering AI Models for Regional Languages // Aleksa Gordić // #203
January 12, 2024 12:18 - 1 hour - 58.9 MBAleksa Gordić is an ex-Google DeepMind / Microsoft ML engineer currently working on non-English LLMs at OrtusAI, open-sourcing Meta's NLLB (no language left behind) project and YugoGPT. MLOps podcast #203 with Aleksa Gordić, Founder of OrtusAI, Pioneering AI Models for Regional Languages. // Abstract Dive deep into Aleksa's work with the YugoGPT, a language model serving Serbian, Croatian, Bosnian, and Montenegrin dialects - emphasizing the need for multilingual AI developments. Explore ...
Small Data, Big Impact: The Story Behind DuckDB // Hannes Mühleisen & Jordan Tigani // #202
January 09, 2024 15:07 - 1 hour - 62.8 MBProf. Dr. Hannes Mühleisen is a creator of the DuckDB database management system and Co-founder and CEO of DuckDB Labs. Jordan is co-founder and chief duck-herder at MotherDuck, a startup building a serverless analytics platform based on DuckDB. MLOps podcast #202 with Hannes Mühleisen, Co-Founder & CEO of DuckDB Labs and Jordan Tigani, Chief Duck-Herder at MotherDuck, Small Data, Big Impact: The Story Behind DuckDB. // Abstract Navigate the intricacies of data management with Jordan Taga...
Language, Graphs, and AI in Industry // Paco Nathan // #201
January 05, 2024 12:31 - 1 hour - 71.9 MBPaco Nathan is the Managing Partner at Derwen, Inc., and author of Latent Space, along with other books, plus popular videos and tutorials about machine learning, natural language, graph technologies, and related topics. MLOps podcast #201 with Paco Nathan, Managing Partner at Derwen, Inc., Language, Graphs, and AI in Industry. // Abstract Let's talk about key findings from these conferences, specifically summarizing teams that have ROI on machine learning in production: what are the thing...
Founding, Funding, and the Future of MLOps // Mihail Eric // #200
January 02, 2024 13:20 - 57 minutes - 52.7 MBMihail Eric is an engineer, researcher, and educator who has helped start teams at innovative organizations such as Amazon Alexa and RideOS. Mihail is a cofounder of Storia AI where they build an AI-powered creative assistant for fast and delightful image and video generation. MLOps podcast #200 with Mihail Eric, Co-founder of Storia AI, Founding, Funding, and the Future of MLOps. // Abstract Demetrios and Mihail journey deep into the significance of human sentiment in an increasingly AI-...
Challenges Operationalizing ML (And Some Solutions) // Nathan Ryan Frank // #199
December 29, 2023 12:38 - 52 minutes - 48 MBNathan Ryan Frank is the Machine Learning Operations and platform Director of Grainger. Former Astrophysicist turned data scientist and machine learning engineer with a proven history of delivering results into production across a wide variety of domains while leading projects with international, cross-functional teams. MLOps podcast #199 with Nathan Ryan Frank, Director, Machine Learning Platform & Operations at WW Grainger, Challenges Operationalizing Machine Learning (And Some Solutions)...
Inferring Creativity // Nick Hasty // #198
December 26, 2023 13:04 - 55 minutes - 50.8 MBNick Hasty is the Director of Product, Discovery & Machine Learning at Giphy, an animated-gif search engine that allows users to search, share, and discover GIFs. MLOps podcast #198, Inferring Creativity. // Abstract Generative AI models have captured our imaginations with their ability to produce new "creative" works such as visually striking images, poems, stories, etc, and their outputs often rival or excel what most humans can do. I believe that these developments should make us re-thi...
The Role of Infrastructure in ML // Niels Bantilan // #197
December 22, 2023 09:45 - 1 hour - 59.9 MBMLOps podcast #197 with Niels Bantilan, Chief Machine Learning Engineer at Union, The Role of Infrastructure in ML Leveraging Open Source brought to us by Union. // Abstract When we start out building and deploying models in a new organization, life is simple: all I need to do is grab some data, iterate on a model that fits the data well and performs reasonably well on some held-out test set. Then, if you’re fortunate enough to get to the point where you want to deploy it, it’s fairly strai...
The Role of Infrastructure in ML Leveraging Open Source // Niels Bantilan // #197
December 22, 2023 09:45 - 1 hour - 59.9 MBMLOps podcast #197 with Niels Bantilan, Chief Machine Learning Engineer at Union, The Role of Infrastructure in ML Leveraging Open Source brought to us by Union. // Abstract When we start out building and deploying models in a new organization, life is simple: all I need to do is grab some data, iterate on a model that fits the data well and performs reasonably well on some held-out test set. Then, if you’re fortunate enough to get to the point where you want to deploy it, it’s fairly strai...
LLMs in Focus: From One-Size Fits All to Verticalized Solutions // Venky Ganti & Laurel Orr // #196
December 19, 2023 10:11 - 55 minutes - 50.6 MBLaurel Orr is a Principal Engineer at Numbers Station, a startup that applies Foundation Model technology to the enterprise data stack. Venky Orr is SVP of Product & Engineering. MLOps podcast #196 with Numbers Station's Venky Ganti SVP, Product & Engineering and Principal Engineer, Laurel Orr, LLMs in Focus: From One-Size Fits All to Verticalized Solutions. // Abstract Dive into the realm of large language models (LLMs) as we explore the merits and limitations of 'one-size fits all' LLMs,...
[Exclusive] Weights & Biases Round-table // Model Management in a Regulated Environment
December 15, 2023 12:30 - 58 minutes - 53.6 MBMLOps Coffee Sessions Special episode with Weights & Biases, Model Management in a Regulated Environment, fueled by our Premium Brand Partner, Weights & Biases. // Abstract Step into the fascinating world of Language Model Management (LLMs) in a Regulated Environment! Join us for an enlightening chat where we'll explore the intricacies of managing models within highly regulated settings, focusing on compliance and effective strategies. This is your opportunity to be part of a dynamic con...
Building the Future of AI in Software Development // Varun Mohan // #195
December 12, 2023 09:55 - 1 hour - 59.1 MBMLOps podcast #195 with Varun Mohan, CEO of Codeium, Building the Future of AI in Software Development brought to us by QuantumBlack. // Abstract This brief overview traces the evolution of Exafunction and Codeium, highlighting the strategic transition. It explores the inception of Codeium's key features, offering insights into the thoughtful design process. This emphasizes the company's forward-looking approach to preparing for a rapidly advancing technological landscape. Additionally, it...
AI in Education Fireside Chat // LLMs in Production Conference 3
December 08, 2023 14:14 - 31 minutes - 28.4 MB// Abstract Explore the transformative role of AI in EdTech, discussing its potential to enhance learning experiences and personalize education. The panelists share insights on AI use cases, challenges in AI integration, and strategies for building a differentiated business model in the evolving AI landscape. The discussion looks ahead at how the latest wave of GenAI is set to shape the future of education. Join us to understand the exciting prospects and challenges of AI in EdTech. Moderat...
[Exclusive] Tecton Round-table // Get your ML Application Into Production
December 07, 2023 17:22 - 55 minutes - 51 MBJoin our conference: https://home.mlops.community/public/events/llms-in-production-part-iii-2023-10-03 MLOps Coffee Sessions Special episode with Tecton, Get your ML Application Into Production, sponsored by Tecton. // Abstract Getting an ML application into production is more difficult than most teams expect—but with the right preparation, it can be done efficiently! Join us for this exclusive roundtable, where 4 machine learning experts from Tecton will discuss some of the most common ch...
DSPy: Transforming Language Model Calls into Smart Pipelines // Omar Khattab // #194
December 05, 2023 09:15 - 1 hour - 60.1 MBMLOps podcast #194 with Omar Khattab, PhD Candidate at Stanford, DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines. // Abstract The ML community is rapidly exploring techniques for prompting language models (LMs) and for stacking them into pipelines that solve complex tasks. Unfortunately, existing LM pipelines are typically implemented using hard-coded "prompt templates", i.e. lengthy strings discovered via trial and error. Toward a more systematic approach for...
Fireside Chat with LLM Startups // LLMs in Production Conference 3
December 01, 2023 13:15 - 31 minutes - 28.6 MB// Abstract Martian is focused on building a model router to dynamically route every prompt to the best LLM for the highest performance and lowest cost. Corti, the Al Co-Pilot for health care uses Al to improve patient care, demonstrating the potential of Al in healthcare and medical decision-making. They recently raised $60M, with Prosus being one of the lead investors. Transforms is pioneering in synthetic entertainment, showing how Al can transform the way we create and consume media. ...