Chip Design: Google’s TPU Infrastructure Innovations Enabling AI at Planetary Scale | Kisaco Research

Unlock massive AI workloads with Google's TPU innovations. We’ll discuss how TPUs enable efficient large-scale training and optimal inference workloads including exclusive details of the latest gen TPU system ( Ironwood),  differentiated chip design, data center infrastructure and software stack co-design that makes TPUs the most compelling choice for AI workloads. What exciting things might we expect to see next? What drives Google’s innovation in specialized AI hardware?

Session Topics: 
Compute
Speaker(s): 

Author:

Sabastian Mugazambi

Group Product Manager, AI Infrastructure
Google Cloud

Sabastian Mugazambi is a seasoned technology leader with a passion for artificial intelligence and machine learning. As a Group Product Manager for Cloud AI Infrastructure at Google, Sabastian plays a pivotal role in shaping the future of AI acceleration. His focus on Cloud TPUs, Google's custom-designed machine learning processors on GCP, has enabled him to lead the charge on groundbreaking advancements in Cloud AI Infra technology. Sabastian's leadership as lead product manager has been instrumental in the successful launch of several generations of Cloud TPUs, including the v5e, v5p, and Trillium TPU. These innovations have empowered researchers, developers, and businesses to tackle the world's most complex AI challenges, from LLMs to broader cutting-edge generative models. With over half a decade of experience at Google, Sabastian has honed his expertise in the design, development, and deployment of AI infrastructure, and his deep understanding of the evolving AI landscape and commitment to delivering exceptional user experiences have made him a driving force in democratizing AI accelerators and making their power accessible to all through Google Cloud Platform. Previously, he founded and led a Natural Language Processing start-up that was acquired by a larger tech company and consulted on AI/ML programs for large tech companies. 

Sabastian Mugazambi

Group Product Manager, AI Infrastructure
Google Cloud

Sabastian Mugazambi is a seasoned technology leader with a passion for artificial intelligence and machine learning. As a Group Product Manager for Cloud AI Infrastructure at Google, Sabastian plays a pivotal role in shaping the future of AI acceleration. His focus on Cloud TPUs, Google's custom-designed machine learning processors on GCP, has enabled him to lead the charge on groundbreaking advancements in Cloud AI Infra technology. Sabastian's leadership as lead product manager has been instrumental in the successful launch of several generations of Cloud TPUs, including the v5e, v5p, and Trillium TPU. These innovations have empowered researchers, developers, and businesses to tackle the world's most complex AI challenges, from LLMs to broader cutting-edge generative models. With over half a decade of experience at Google, Sabastian has honed his expertise in the design, development, and deployment of AI infrastructure, and his deep understanding of the evolving AI landscape and commitment to delivering exceptional user experiences have made him a driving force in democratizing AI accelerators and making their power accessible to all through Google Cloud Platform. Previously, he founded and led a Natural Language Processing start-up that was acquired by a larger tech company and consulted on AI/ML programs for large tech companies. 

Time: 
1:55 PM - 2:15 PM
Agenda Track No.: 
Track 1
Session Type: 
Track
Session Stage: