What runs ChatGPT? Inside Microsoft’s AI supercomputer | Featuring Mark Russinovich
Get an inside look at the AI supercomputer infrastructure built to run ChatGPT and other large language models, and see how to leverage it for your workloads in Azure, at any scale.
Go behind the scenes:
-For how we collaborated with NVIDIA to deliver purpose-built AI infrastructure with NVIDIA GPUs
-How Project Forge checkpointing works to restore job states if a long training job fails or needs to be migrated
-How we used LoRA fine-tuning to update a fraction of the base model for more training throughput and smaller checkpoints
-How UK-based company, Wayve, is using Azure’s AI supercomputer infrastructure for self-driving cars
-And how Confidential Computing works with Azure AI to combine datasets without sharing personally identifiable information for secure multiparty collaborations.
Mark Russinovich, Azure CTO, joins Jeremy Chapman to break it down.
► QUICK LINKS:
00:00 - Introduction
01:15 - AI innovation building specialized hardware and software
04:22 - Optimizing hardware
05:40 - Improved throughput
06:17 - Project Forge
08:01 - Project Forge checkpointing demo
10:02 - LoRA fine tuning
11:29 - Use AI supercomputer infrastructure for your workloads
12:34 - How Wayve is leveraging AI supercomputer infrastructure
13:47 - How Confidential Computing works with Azure AI
15:21 - Wrap up
► Link References:
Leverage Azure AI capabilities for yourself at
► Unfamiliar with Microsoft Mechanics?
As Microsoft’s official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.
• Subscribe to our YouTube:
• Talk with other IT Pros, join us on the Microsoft Tech Community:
• Watch or listen from anywhere, subscribe to our podcast:
► Keep getting this insider knowledge, join us on social:
• Follow us on Twitter:
• Share knowledge on LinkedIn:
• Enjoy us on Instagram:
• Loosen up with us on TikTok: @msftmechanics
#Azure #OpenAI #Supercomputer #LLM
1 view
201
52
5 months ago 00:03:19 1
Bobby Shmurda - Hot N*gga (Official Music Video)
5 months ago 00:02:19 1
IF | Final Trailer (2024 Movie) - Ryan Reynolds, John Krasinski, Steve Carell
5 months ago 00:01:30 1
Cowboy Bebop - Opening Template [download in description]
5 months ago 00:00:25 1
Joe finds out that Barry is The Flash #theflash
5 months ago 00:00:17 1
The Flash Realises What Time He’s In.. #theflash
5 months ago 00:06:59 1
Sultans of Swing (metal cover by Leo Moracchioli feat. Mary Spender)
5 months ago 01:00:46 1
[1 Hour] Badass Gaming Songs To Fight Your Demons 💀
5 months ago 00:03:55 1
Revenge 2
5 months ago 00:08:24 1
NATO Is SHOCKED By A New Tactic Of The Russian Army┃Russian Paratroopers Unleash HELL On Chasiv Yar
5 months ago 00:08:14 1
Deutsch lernen | Pets - Haustiere (A1) Lesson 1
5 months ago 00:14:04 1
Inside the Mind of a Master Procrastinator | Tim Urban | TED
5 months ago 00:04:15 1
Coolio - Gangsta’s Paradise (Official Music Video) [HD] ft. L.V.
5 months ago 00:05:35 1
Patagonia Wading Boot Comparison
5 months ago 00:49:28 1
DJ Shadow - Full Performance (Live on KEXP)
5 months ago 01:25:57 1
watch this to practise self care | Kitchen Nightmares | Gordon Ramsay
5 months ago 00:15:03 1
PILATES WORKOUT AT HOME FOR WEIGHT LOSS l LOSE BELLY FAT & GET SLIM BODY l 30 Day Pilates Challenge♥