Odd Lots

Anjney Midha's Plan to Radically Lower the Price of Compute

· PT50M21S

Összefoglaló

Anjney Midha, az AI-ipar ismert alakja, aki korábban az a16z partnere volt, új projektjével, az AMP PBC-vel a számítási kapacitás (compute) árának radikális csökkentését célozza. Midha egy olyan számítási hálózatot épít, amely a GPU-kat egységesített közüzemi szolgáltatássá…

Ebben az epizódban

Anjney Midha wrote the first check to Anthropic.

He teaches a viral course at Stanford on how AI works.

And he was, until recently, a partner at a16z.

In other words, he is AI-industry royalty.

Midha's new project is AMP PBC, a company that believes it can radically lower the price of compute.

To accomplish that, he is working on building a compute grid that turns GPUs into a standardized utility.

But right now, compute is too fragmented.

And given the way contracts are structured, he says that labs are being forced to spend money on capacity that often goes unused.

In other words, small labs are forced to pay up for big, long-term contracts, even though their own demand (particularly during model training) may be very spiky.

On this episode, Midha explains how the market for compute currently works and why he believes there's a software solution that could significantly improve compute utilization.

He also tells us why he does not anticipate one company will emerge as the dominate player and that instead we'll have a wide range of models, each optimally used in specific applications.

Read more: Amazon Says Its Data Centers Use 2.5 Billion Gallons of Water Oracle Falls Most in Six Months on Mounting Data Center Costs Only http://Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app.

Subscribe at  bloomberg.com/subscriptions/oddlots Subscribe to the Odd Lots Newsletter Join the conversation: discord.gg/oddlots See omnystudio.com/listener for privacy information.

Említett entitások

Témák

Személyek

Cégek

Tickerek

Hallgasd meg

Több epizód a Odd Lots-ből