Is deep learning hitting a wall? It’s 2025 and Mixture of Experts is back and better than ever. In episode 36, host Tim Hwang is joined by Chris Hay, Kate Soule and Kush Varshney to debrief one of the biggest releases of 2024, OpenAI o3. Next, DeepSeek-V3 is here! Finally, will AI exist in 2027? The experts dissect the AI bet between Miles Brundage and Gary Marcus. All that and more on the first Mixture of Experts of 2025. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity. ﻿00:00 — Intro00:49 — OpenAI o314:40 — DeepSeek-V328:00 — The Brundage/Marcus bet

Kate Soule

Director, Technical Product Management, Granite

Chris Hay

Distinguished Engineer, CTO Customer Transformation

Kush Varshney

IBM Fellow, AI Governance

Is deep learning hitting a wall? It’s 2025 and Mixture of Experts is back and better than ever. In episode 36, host Tim Hwang is joined by Chris Hay, Kate Soule and Kush Varshney to debrief OpenAI o3, DeepSeek-V3, and the Brundage/Marcus AI bet.

Episode 36: OpenAI o3, DeepSeek-V3, and the Brundage/Marcus AI bet

Let’s bust some early myths about DeepSeek. In episode 40 of Mixture of Experts, join host Tim Hwang along with experts Aaron Baughman, Chris Hay and Kate Soule. Last week, we covered the release of DeepSeek-R1; now that the entire world is up to speed, let’s separate the facts from the hype. Next, what is model distillation and why does it matter for competition in AI? Finally, Sam Altman among other tech CEOs shared his response to DeepSeek. Will R1 radically change the open-source strategy of other tech giants? Find out all this and more on Mixture of Experts. 00:01 – Intro 00:41 – DeepSeek facts vs hype 21:00 – Model distillation 31:21 – Open source and OpenAI The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Aaron Baughman

IBM Fellow, Master Inventor

Let’s bust some early myths about DeepSeek! In Mixture of Experts' episode 40, the panel tackles DeepSeek R1 misconceptions, explains model distillation, and dissects the open-source competition landscape.

Episode 40: DeepSeek facts vs hype, model distillation, and open source competition

DeepSeek facts vs hype, model distillation, and open source competition

Listen to episode 40 of Mixture of Experts: DeepSeek facts vs hype, model distillation, and open source competition. Mixture of Experts–an IBM podcast. #MoEPodcast #MixtureOfExperts #IBM

What does the future hold for DeepSeek? In episode 39 of Mixture of Experts, join host Tim Hwang along with experts Abraham Daniels, Kaoutar El Maghraoui and Skyler Speakman to discuss the release of DeepSeek-R1. Next, Mistral indicates going IPO. Then, FrontierMath’s new benchmark is particularly difficult, the experts debrief. Finally, IDC released a report on code assistants, what do we need to know about generalist and specialized coding assistants? Tune-in to this week’s episode to find out.&nbsp; 00:01 – Intro &nbsp;01:08 – DeepSeek-R1&nbsp;14:08 – Mistral indicates IPO&nbsp;20:54 – FrontierMath controversy&nbsp;30:04 -- IDC code assistants report&nbsp; The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.&nbsp;

Skyler Speakman

Senior Research Scientist

Kaoutar El Maghraoui

Principal Research Scientist, AI Engineering, AI Hardware Center

Abraham Daniels 

Senior Technical Product Manager, Granite

What does the future hold for DeepSeek? In episode 39 of Mixture of Experts, our panel debriefs DeepSeek-R1, Mistrals IPO indication, the FrontierMath controversy and the IDC gen AI code assistants report.

Episode 39: DeepSeek-R1, Mistral IPO, FrontierMath controversy, and IDC code assistant report

DeepSeek-R1, Mistral IPO FrontierMath controversy, and IDC code assistant report

What would you do with $2 billion? In episode 38 of Mixture of Experts, join host Tim Hwang along with experts Chris Hay, Kaoutar El Maghraoui and Vyoma Gajjar to discuss the Anthropic valuation rumors. Next, Microsoft CEO Nadella created a new CoreAI group to build and run apps for customers. Then, NotebookLM upgraded some of its features, including podcast intervention. Finally, AI agents are making their way into the financial services industry. Can an agent invest all of your money? Tune-in to this week’s episode to find out.&nbsp; 00:01 -- What would you do with $2 billion?&nbsp;00:51 -- Anthropic valuation&nbsp;12:14 -- Microsoft CoreAI&nbsp;25:01 -- NotebookLM upgrades&nbsp;35:17 -- AI agents in finance&nbsp; The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.&nbsp;

Vyoma Gajjar

AI Technical Solution Architect

 Distinguished Engineer, CTO Customer Transformation

What would you do with $2 billion? In episode 38 of Mixture of Experts, we discuss the Anthropic valuation rumors, CoreAI, NotebookLM upgrades, and AI agents within the financial services industry.

Episode 38: Anthropic valuation rumors, Microsoft CoreAI, NotebookLM upgrades, and AI agents in finance

What’s the most exciting CES AI announcement? In episode 37 of Mixture of Experts, host Tim Hwang is joined by Skyler Speakman, Volkmar Uhlig and Shobhit Varshney to debrief CES 2025. Specifically, the experts dive into NVIDIA’S Project DIGITS, among other announcements from the AI hardware giant. Next, a new enterprise AI development survey came out that detailing how developers really feel about AI implementation. Then, Apple Intelligence experienced some major hallucination fails, what does this tell us about Apple’s stake in the AI game? Finally, Sam Altman of OpenAI released a reflection blog, what does he say about the future of AI? All that and more on today’s Mixture of Experts. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Volkmar Uhlig

VP, AI Infrastructure Portfolio Lead

Shobhit Varshney

 VP & Sr. Partner, AI, US/Canada/LatAm

What’s the most exciting CES AI announcement? In episode 37 of Mixture of Experts, we debrief CES 2025, NVIDIA DIGITS, Apple Intelligence fails, Sam Altman’s reflection blog, and the challenges facing enterprise AI developers.

Episode 37: CES 2025, NVIDIA DIGITS, Apple Intelligence fails, and Sam Altman’s reflections

CES 2025, NVIDIA DIGITS, Apple Intelligence fails, and Sam Altman’s reflections

Will 2025 be the year of AI agents? In Episode 35 of Mixture of Experts, host Tim Hwang is joined by some show veterans to debrief 2024 in AI. This week, we review AI models, agents, hardware and product releases with some of the top industry experts. What was the best model of 2024? Is NVIDIA king? What are some of the AI trends in 2025? All that and more on this special edition of Mixture of Experts. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Marina Danilevsky

Senior Partner Consulting on AI for US/Canada/LatAm

Maya Murad

Product Manager, AI Incubation

Will 2025 be the year of AI agents? In Episode 35 of Mixture of Experts, host Tim Hwang is joined by some show veterans to debrief 2024 in AI and make predictions for 2025.

Episode 35: 2024 Rewind: Breakthroughs in AI models, agents, hardware and products

2024 Rewind: Breakthroughs in AI models, agents, hardware and products

Is pre-training a thing of the past? In Episode 34 of Mixture of Experts, host Tim Hwang is joined by Abraham Daniels, Vagner Santana and Volkmar Uhlig to debrief this week in AI. First, OpenAI cofounder Ilya Sutskever said that “peak data” was achieved, does this mean there is no longer a need to model pre-training? Next, IBM released Granite 3.1 with a slew of features, we cover them all. Then, there is a new way to steal AI models, how do we protect against model exfiltration. Finally, can NVIDIA Jetson for AI developers really increase hardware accessibility? Tune-in for more! The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity. ﻿00:01 — Intro00:49— Is pre-training over?10:25 — Granite 3.122:23 — AI model stealing33:38—NVIDIA Jetson

Vagner Figueredo de Santana

Staff Research Scientist, Master Inventor, Responsible Tech Team

Abraham Daniels

Is pre-training a thing of the past? In Episode 34 of Mixture of Experts we cover Granite 3.1, NVIDIA Jetson, stealing AI models, and more! Tune-in to this weeks episode to hear the latest AI news.

Episode 34: Granite 3.1, NVIDIA Jetson, stealing AI models, and is pre-training over?

Granite 3.1, NVIDIA Jetson, stealing AI models, and is pre-training over?

Podcasts at IBM

Learn more about AI

Welcome to Mixture of Experts, your weekly deep dive into the ever-evolving landscape of artificial intelligence—bringing you insightful discussions on the latest AI trends, innovations, and their impact on business. From breakthrough research to practical applications, each episode offers a balanced blend of expertise and analysis. Explore how AI is reshaping industries, driving efficiency, and unlocking new opportunities for growth. Whether you're a seasoned professional seeking to stay ahead of the curve or an enthusiast curious about the future of technology, Mixture of Experts delivers the perfect mix of insights and practical knowledge. Tune in and stay informed as we navigate the dynamic intersection of AI and business.

Episode 36: OpenAI o3, DeepSeek-V3, and the Brundage/Marcus AI bet

DESCRIPTION

Today's Host

Tim Hwang

Today's Guests

Kate Soule

Chris Hay

Kush Varshney

Recent Episodes

Episode 36: OpenAI o3, DeepSeek-V3, and the Brundage/Marcus AI bet

DESCRIPTION

Today's Host

Tim Hwang

Today's Guests

Kate Soule

Chris Hay

Kush Varshney

Related Resources

Recent Episodes

Episode 40: DeepSeek facts vs hype, model distillation, and open source competition

Episode 39: DeepSeek-R1, Mistral IPO, FrontierMath controversy, and IDC code assistant report

Episode 38: Anthropic valuation rumors, Microsoft CoreAI, NotebookLM upgrades, and AI agents in finance

Episode 37: CES 2025, NVIDIA DIGITS, Apple Intelligence fails, and Sam Altman’s reflections

Episode 35: 2024 Rewind: Breakthroughs in AI models, agents, hardware and products

Episode 34: Granite 3.1, NVIDIA Jetson, stealing AI models, and is pre-training over?