Saurabh Tiwary
Google vice president; former Microsoft CVP and Technical Fellow who led the Microsoft Turing group
- Vice President, Technical Fellow, Google DeepMind (page title); Vice President and General Manager of Cloud AI (bio), Google1
Saurabh Tiwary is a Vice President at Google. CapitalG's team page lists Tiwary's title as Vice President, Technical Fellow, Google DeepMind, and describes Tiwary as Vice President and General Manager of Cloud AI at Google, working closely with Google DeepMind on Gemini; Tiwary is also a Senior Advisor to CapitalG. Tiwary was previously a Corporate Vice President and Technical Fellow at Microsoft, where Tiwary led the Microsoft Turing group's large-scale model training, inference, and integration across Microsoft products and led Microsoft's technical partnership with OpenAI. Tiwary co-authored the 2022 paper on training Megatron-Turing NLG 530B with DeepSpeed and Megatron, and the MS MARCO dataset paper.123
Work
Megatron-Turing NLG 530B (external site: arxiv.org)Published research
Co-author of "Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model" (2022), a joint Microsoft and NVIDIA paper on the infrastructure, 3D parallelism, training process, and data curation behind a 530 billion parameter model.2
MS MARCO (external site: arxiv.org)Published research
Co-author of the 2016 paper introducing MS MARCO, a machine reading comprehension dataset built from questions sampled from Bing's search query logs.3
Other documented roles
Roles the sources document but that are not confirmed as current.
This profile covers public professional work only, from the sources below. It is not an endorsement or a ranking. To correct or remove it, use the correction form.