AI inference startups Fal, Together and Baseten move to buy their own Nvidia chips, The Information reports

Key facts

• AI inference startups Fal, Together and Baseten are moving to buy their own Nvidia chips rather than rely entirely on cloud providers, according to The Information.
• The shift comes as access to computing power tightens for AI inference startups, per The Information.
• The Information reports the companies are being forced to rethink their business models as a result.
• Inference providers are increasingly buying their own Nvidia servers instead of renting them, per The Information.
• The Fireworks breach could speed the shift toward inference providers owning their servers, according to The Information.
• Owning servers could improve security and gross margins, per the report.
• The shift would require billions of dollars as capital markets seize up for smaller borrowers, The Information reports.
• The Fireworks breach could speed the shift toward inference providers owning their servers.
• The shift would require billions of dollars as capital markets seize up for smaller borrowers.