ZML develops inference-performance software, notably its newly launched LLM inference server ZML/LLMD, which enables a range of open-source large language models to run across Nvidia, AMD, Google TPU, Apple Metal, Intel Arc and other chips. The company’s earlier public project was an open-source inference-focused ML framework released in 2024 and updated in March; ZML/LLMD itself is not open source but launched as a free product to gather usage data. Founder Steeve Morin, formerly VP of engineering at Zenly, leads a tight team of about 20 people based in Paris. ZML positions itself to reduce vendor lock-in and allow enterprises and cloud providers to use mixed chip fleets for cost and energy efficiency. Its cap table includes prominent founders and researchers such as Solomon Hykes, Hugging Face’s Clément Delangue and Julien Chaumond, and Yann LeCun, signaling strong industry support. The company has raised $20 million from a syndicate of VCs to accelerate product development and future releases, while competing with inference-focused startups like Baseten, Inferact, and RadixArk.

Total raised

$20M

Funding rounds

1

Latest round

Equity

Latest activity

Jul 2026