In Episode 10 of Mixture of Experts we are talking all hardware all the time. Guest host Bryan Casey is joined by Volkmar Uhlig, Chris Hay, and Kaoutar El Maghraoui to explore the intricacies of AI hardware. Is Apple creating a pattern for the industry with their on device and cloud architecture? Tune in to hear the experts debate the details. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Bryan Casey

Guest Host

Chris Hay

Distinguished Engineer, CTO Customer Transformation

Volkmar Ulig

VP, AI Infrastructure Portfolio Lead

Kaoutar El Maghraoui

Principal Research Scientist, AI Engineering, AI Hardware Center

In Episode 10 of Mixture of Experts we are talking all hardware all the time. Guest host Bryan Casey is joined by Volkmar Uhlig, Chris Hay, and Kaoutar El Maghraoui to explore the intricacies of AI hardware.

Episode 10: AI Hardware: Training, Inference, Devices and Model Optimization

AI Hardware: Training, Inference, Devices and Model Optimization

In Episode 9 of Mixture of Experts, guest host Bryan Casey is joined by Shobhit Varshney, Marina Danilevsky, and Michael Glass. The experts analyze both the release Anthropic’s Claude 3.5 and BIRD-SQL. Finally, we talk the latest in AI slop and is shrimp Jesus the best use case of AI content creation? The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Shobhit Varshney

VP & Sr. Partner, Americas AI GenAI Leader, IBM Consulting

Michael Glass

AI Researcher

Marina Danilevsky

Senior Research Scientist

The experts analyze both the release Anthropic’s Claude 3.5 and BIRD-SQL. Finally, we talk the latest in AI slop and is shrimp Jesus the best use case of AI content creation?

Episode 9: Claude 3.5 Sonnet, BIRD-SQL, and the latest in AI Slop

Claude 3.5 Sonnet, BIRD-SQL, and the latest in AI Slop

In Episode 8 of Mixture of Experts, host Tim Hwang is joined by Kush Varshney, Kate Soule, and Maya Murad. First, the experts react to NVIDIA’s Nemotron-4 340B model launch and the future of LLM training. Next, new developments in enterprise agents create a great discussion around the reality of AI agents. Finally, will Safe Superintelligence Inc. become a major player in the AI space?The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Kate Soule

Program Director, Generative AI Research

Kush Varshney

 IBM Fellow

Maya Murad

Product Manager, AI Incubation

In Episode 8 of Mixture of Experts, host Tim Hwang is joined by Kush Varshney, Kate Soule, and Maya Murad.

Episode 8: NVIDIA’s Nemotron-4 340B models, Safe Superintelligence Inc. and AI agents

In Episode 7 of Mixture of Experts, host Tim Hwang is joined by Shobhit Varshney, Skyler Speakman, and Kaoutar El Maghaoui. Today, the experts react to Apple’s WWDC24 announcements. Is Apple late to the AI game? Then, part 2 on interpretability this week, as OpenAI released their study mechanistic interpretability. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Skyler Speakman

In Episode 7 of Mixture of Experts, host Tim Hwang is joined by Shobhit Varshney, Skyler Speakman, and Kaoutar El Maghaoui. Today, the experts react to Apple’s WWDC24 announcements.

Episode 7: Apple's WWDC24 reactions and mechanistic interpretability

Episode 7: Apple's WWDC24 reactions and mechanistic interpretability | Mixture of Experts 

In Episode 6 of&nbsp;Mixture of Experts, host Tim Hwang is joined by Vagner Figueredo de Santana, Marina Danilesky, and Shobhit Varshney. Today, what’s the future of AGI? The experts unpack Leopold Aschenbrenner’s AI safety screed, Situational Awareness. We also break down the state of responsible AI amid the annual ACM Fairness, Accountability, and Transparency (FAccT) Conference. Finally, we chat about RAG benchmarking and what it tells us about the industry as a whole. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Vagner Figueredo de Santana

Staff Research Scientist & Master Inventor

In Episode 6 of Mixture of Experts, host Tim Hwang is joined by Vagner Figueredo de Santana, Marina Danilesky, and Shobhit Varshney. Today, what’s the future of AGI?

Episode 6: AI safety, RAG benchmarking and responsible AI at ACM FAccT Conference

Episode 6: AI safety, RAG benchmarking and responsible AI at ACM FAccT Conference | Mixture of Experts 

In Episode 5 of Mixture of Experts, Bryan Casey, our guest host, is joined by Kate Soule, Chris Hay, and Skyler Speakman. Today, our experts revisit a conversation from a previous episode around Google’s AI Overviews and the market reaction. Additionally, they break down Anthropic’s Golden Gate Claude. Finally, what is the “whale computer” and how does it relate to scaling laws? The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

In Episode 5 of Mixture of Experts we break down market reactions to Google's AI Overviews,  Anthropic's Golden Gate Claude AI Assistant, and scaling laws.

Episode 5: Google’s AI Overviews, Golden Gate Claude, the "whale computer" and scaling laws

Episode 5: Google’s AI Overviews, Golden Gate Claude, the "whale computer" and scaling laws | Mixture of Experts 

In Episode 4 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Marina Danilevsky, and Armand Ruiz. Kate explains the future of FMTI, Marina highlights innovations driving the open-source community, and Armand dives into the latest from IBM’s THINK 2024 event. Finally, the experts debrief: what’s going on between Scarlet Johansson and OpenAI? Subscribe for AI updates:https://www.ibm.com/account/reg/us-en/signup?formid=news-urx-52120Learn more about artificial intelligence: https://www.ibm.com/think/artificial-intelligence The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Armand Ruiz

Vice President, Product Management - AI Platform 

In Episode 4 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Marina Danilevsky, and Armand Ruiz. Kate explains the future of FMTI, Marina highlights innovations driving the open-source community, and Armand dives into the latest from IBM’s THINK 2024 event. Finally, the experts debrief: what’s going on between Scarlet Johansson and OpenAI? 

Episode 4: Scarlett Johansson, FMTI and Think 2024

Episode 4: Scarlett Johansson, FMTI and Think 2024 | Mixture of Experts 

Welcome to Mixture of Experts, your weekly deep dive into the ever-evolving landscape of artificial intelligence—bringing you insightful discussions on the latest AI trends, innovations, and their impact on business. From breakthrough research to practical applications, each episode offers a balanced blend of expertise and analysis. Explore how AI is reshaping industries, driving efficiency, and unlocking new opportunities for growth. Whether you're a seasoned professional seeking to stay ahead of the curve or an enthusiast curious about the future of technology, Mixture of Experts delivers the perfect mix of insights and practical knowledge. Tune in and stay informed as we navigate the dynamic intersection of AI and business.

Episode 10: AI Hardware: Training, Inference, Devices and Model Optimization

DESCRIPTION

Today's Host

Tim Hwang

Today's Guests

Bryan Casey

Chris Hay

Volkmar Ulig

Kaoutar El Maghraoui

Recent Episodes

Episode 10: AI Hardware: Training, Inference, Devices and Model Optimization

DESCRIPTION

Today's Host

Tim Hwang

Today's Guests

Bryan Casey

Chris Hay

Volkmar Ulig

Kaoutar El Maghraoui

Related Resources

Recent Episodes

Episode 9: Claude 3.5 Sonnet, BIRD-SQL, and the latest in AI Slop

Episode 8: NVIDIA’s Nemotron-4 340B models, Safe Superintelligence Inc. and AI agents

Episode 7: Apple's WWDC24 reactions and mechanistic interpretability

Episode 6: AI safety, RAG benchmarking and responsible AI at ACM FAccT Conference

Episode 5: Google’s AI Overviews, Golden Gate Claude, the "whale computer" and scaling laws

Episode 4: Scarlett Johansson, FMTI and Think 2024