Hot French startup ZML releases free product to speed inference across lots of AI chips
ZML, a French AI startup, releases ZML/LLMD, an inference-performance software that enables open-source large language models to run on multiple chip architectures, aiming to break silos and improve AI efficiency. The startup collaborates with European chipmakers to co-design silicon, offering flexibility and cost savings for enterprises. ZML focuses on creating a versatile inference platform that can leverage different chip architectures, emphasizing the growing importance of inference in AI deployment and the "inference gold rush."
More from Techcrunch
Microsoft kills off unsuccessful AI features while merging its separate Copilot apps
Microsoft is simplifying Copilot by combining its consumer and business apps, and dropping AI-generated podcasts, Group Chats, Deep Research, and its Mico character.
techcrunch.com··Mads Kristian Nylund·AI ToolsAI InfrastructureAI Governance
Nvidia’s new $500B plan is risky but brilliant, especially for aging GPUs
Nvidia has a plan to make sure its GPUs won't lose value. It wants to convince a new crop of financiers to keep lending for AI buildouts.
techcrunch.com··Mads Kristian Nylund·AI DevelopmentAI InfrastructureAI Governance
Apple in talks to pay publishers to provide Siri with current news: report
The tech giant has considered a nine-figure budget for the payments, according to the WSJ.
techcrunch.com··Mads Kristian Nylund·AI ToolsAI EthicsAI Platforms