Can chat replace search? In Episode 26 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Kush Varshney and Petros Zerfos for IBM TechXchange week! First, the experts describe how the team created the Granite 3.0 models. Next, NVIDIA enters the open source model game, what does this mean for the competition? Finally, Perplexity AI is seeking over double their valuation in new funding rounds, what does this mean for start-ups? All that and more on today’s episode. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Kush Varshney

IBM Fellow, AI Governance

Kate Soule

Program Director, Generative AI Research

Petros Zerfos

Principal Research Scientist, Data Engineering for Generative AI

Can chat replace search? In Episode 26 of Mixture of Experts, host  Kate Soule, Kush Varshney and Petros Zerfos for IBM TechXchange week—we chat Granite 3.0, NVIDIA’s Nemotron AI model, and Perplexity’s fundraising!

Episode 26: Granite 3.0, NVIDIA’s Nemotron AI model, and Perplexity’s fundraising

Is pre-training a thing of the past? In Episode 34 of Mixture of Experts, host Tim Hwang is joined by Abraham Daniels, Vagner Santana and Volkmar Uhlig to debrief this week in AI. First, OpenAI cofounder Ilya Sutskever said that “peak data” was achieved, does this mean there is no longer a need to model pre-training? Next, IBM released Granite 3.1 with a slew of features, we cover them all. Then, there is a new way to steal AI models, how do we protect against model exfiltration. Finally, can NVIDIA Jetson for AI developers really increase hardware accessibility? Tune-in for more! The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity. ﻿00:01 — Intro00:49— Is pre-training over?10:25 — Granite 3.122:23 — AI model stealing33:38—NVIDIA Jetson

Vagner Figueredo de Santana

Staff Research Scientist, Master Inventor, Responsible Tech Team

Volkmar Uhlig

VP, AI Infrastructure Portfolio Lead

Abraham Daniels

Senior Technical Product Manager, Granite

Is pre-training a thing of the past? In Episode 34 of Mixture of Experts we cover Granite 3.1, NVIDIA Jetson, stealing AI models, and more! Tune-in to this weeks episode to hear the latest AI news.

Episode 34: Granite 3.1, NVIDIA Jetson, stealing AI models, and is pre-training over?

Granite 3.1, NVIDIA Jetson, stealing AI models, and is pre-training over?

Is o1 Pro worth the cost? In Episode 33 of Mixture of Experts, host Tim Hwang is joined by Marina Danilevsky, Kate Soule and Vyoma Gajjar. First, the experts debrief the 12 Days of OpenAI. Next, we review some of the top papers in NeurIPS, how are the experts keeping up with all these research papers? Then, we are back with another benchmark, can ARC Prize make AGI more tractable? Finally, Meta announced the launch of Llama 3.3 70B with the promise of 405B performance, can we have our cake and eat it too? Find out more on today’s Mixture of Experts! The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Director, Technical Product Management, Granite

Marina Danilevsky

Senior Research Scientist

Vyoma Gajjar

AI Technical Solution Architect

Is o1 Pro worth the cost? In Episode 33 of Mixture of Experts, host Tim Hwang is joined by Marina Danilevsky, Kate Soule and Vyoma Gajjar. Today, we cover 12 Days of Open AI, NeurIPS, ARC Prize and Meta’s Llama 3.3 70B release!

Episode 33: 12 Days of OpenAI, NeurIPS, ARC Prize, and Llama 3.3 70B

What’s the mystery behind the name ChatGPT refuses to discuss? In Episode 32 of Mixture of Experts host Tim Hwang dives into the hottest topics shaping the AI landscape with an all-star panel: Aaron Baughman, Vagner Figueredo de Santana, and Shobhit Varshney. First, they disect the biggest announcements and takeaways from AWS re:Invent 2024, Amazon’s premier AI event. Next, they talk about overcoming architectural vulnerabilities in AI systems, and finally, they uncover the curious case of a name ChatGPT won’t discuss—and the questions this raises about privacy and transparency in AI. Get ready for an episode packed with insights, debates, and forward-thinking perspectives! The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Shobhit Varshney

Senior Partner Consulting on AI for US/Canada/LatAm

Aaron Baughman

IBM Fellow, Master Inventor

Staff Research Scientist - Master Inventor, Responsible Tech Team

What’s the mystery behind the name ChatGPT refuses to discuss? In Episode 32 of Mixture of Experts, host Tim Hwang joins Aaron Baughman, Vagner Figueredo de Santana, and Shobhit Varshney to chat about AWS re:Invent 2024, LLM Flowbreaking, and David Mayer, a name that breaks ChatGPT.

Episode 32: Inside AWS re:Invent 2024, LLM Flowbreaking, and David Mayer

Inside AWS re:Invent 2024, LLM Flowbreaking, and David Mayer

How much future learning will be done with an AI assistant? In Episode 31 of Mixture of Experts, host Tim Hwang is joined by Phaedra Boinodiris, Marina Danilevsky and Skyler Speakman for the AI in education special episode. First, the experts give an update on the state of AI within education. Next, we cover concerns around AI safety and literacy, what do students and teachers need to be aware of? Finally, the panel gives their predictions on what the future of education holds as it relates to AI. Tune-in to this special episode for an in-depth analysis! The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Phaedra Boinodiris

IBM Consulting’s Global Leader for Responsible AI

Skyler Speakman

Senior Research Scientist 

How much future learning will be done with an AI assistant? In Episode 31 of Mixture of Experts, host Tim Hwang is joined by Phaedra Boinodiris, Marina Danilevsky and Skyler Speakman for the AI in education special episode!

Episode 31: AI in education: Safety, literacy, and predictions

Should your AI assistant remember everything about you? In Episode 30 of Mixture of Experts, host Tim Hwang is joined by Vagner Santana, Vyoma Gajjar and Shobhit Varshney. First, the experts breakdown claims of “near-infinite memory” within AI models. Next, Shobhit is fresh off the plane from Microsoft Ignite, he shares some of the exciting new announcements following the event. Then, a new benchmark has entered the chat, what do we know about FrontierMath? Finally, AlphaFold3 is now more open, why does this matter? Find out more on today’s episode! The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Should your AI assistant remember everything about you? In Episode 30 of Mixture of Experts, we cover “near-infinite memory,” Microsoft Ignite, FrontierMath and AlphaFold3! 

Episode 30: “Near-infinite memory,” Microsoft Ignite, FrontierMath, and AlphaFold3

Is 2024 the year scaling AI officially breaks? In Episode 29 of Mixture of Experts, host Tim Hwang is joined by Anthony Annunziata, Kate Soule and Naveen Rao. First, the experts discuss whether we are living in a post scale world. Next, we can’t have an episode without chatting AI agents, but what does the future hold for this technology? Finally, is AGI here to stay? Tune-in to this week’s Mixture of Experts to find out. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Anthony Annunziata

Director, AI Open Innovation

Naveen Rao

VP of AI, Databricks

Director, Technical Product Management, Granite 

Is 2024 the year scaling AI officially breaks? In Episode 29 of Mixture of Experts, host Tim Hwang is joined by Anthony Annunziata, Kate Soule and Naveen Rao. The experts chat scaling AI, agents and the race to AGI.

Episode 29: Scaling AI, agent-led future, and race to AGI

pjselma@mx1.ibm.com

Podcasts at IBM

Learn more about AI

Welcome to Mixture of Experts, your weekly deep dive into the ever-evolving landscape of artificial intelligence—bringing you insightful discussions on the latest AI trends, innovations, and their impact on business. From breakthrough research to practical applications, each episode offers a balanced blend of expertise and analysis. Explore how AI is reshaping industries, driving efficiency, and unlocking new opportunities for growth. Whether you're a seasoned professional seeking to stay ahead of the curve or an enthusiast curious about the future of technology, Mixture of Experts delivers the perfect mix of insights and practical knowledge. Tune in and stay informed as we navigate the dynamic intersection of AI and business.

Episode 26: Granite 3.0, NVIDIA’s Nemotron AI model, and Perplexity’s fundraising

DESCRIPTION

Today's Host

Tim Hwang

Today's Guests

Kush Varshney

Kate Soule

Petros Zerfos

Recent Episodes

Episode 26: Granite 3.0, NVIDIA’s Nemotron AI model, and Perplexity’s fundraising

DESCRIPTION

Today's Host

Tim Hwang

Today's Guests

Kush Varshney

Kate Soule

Petros Zerfos

Related Resources

Recent Episodes

Episode 34: Granite 3.1, NVIDIA Jetson, stealing AI models, and is pre-training over?

Episode 33: 12 Days of OpenAI, NeurIPS, ARC Prize, and Llama 3.3 70B

Episode 32: Inside AWS re:Invent 2024, LLM Flowbreaking, and David Mayer

Episode 31: AI in education: Safety, literacy, and predictions

Episode 30: “Near-infinite memory,” Microsoft Ignite, FrontierMath, and AlphaFold3

Episode 29: Scaling AI, agent-led future, and race to AGI