Inference Startup Raises $150 Million for vLLM Commercialization
Inferact, the spin-off from the open-source vLLM project, has successfully secured $150 million in seed funding, achieving an impressive valuation of $800 million. This strategic move marks a significant transition from a popular open-source initiative to a venture capital-backed enterprise.
The establishment of Inferact aligns with recent trends in AI commercialization, as seen in the emergence of the SGLang project, which has attracted investment at a $400 million valuation, led by Accel. This shift in focus from model training to efficient application deployment, known as inference, underscores the growing demand for technologies that enhance the speed and cost-effectiveness of AI utilities.
Both vLLM and SGLang were developed in 2023 at the UC Berkeley lab, led by Databricks co-founder Ion Stoica. According to Inferact CEO Simon Mo, who is also one of the original creators of vLLM, notable users of the tool include Amazon’s cloud services and various shopping applications—highlighting its practical implications in real-world scenarios.
Key Points:
– Inferact is the first commercial venture from the vLLM open-source project.
– The startup has achieved an $800 million valuation.
– The funding will accelerate the commercialization of vLLM, targeting AI inference applications.
– Significant users include Amazon, emphasizing vLLM’s industry relevance.
As the AI landscape continues to evolve, investments like this signal a promising future for technologies that optimize application performance in real-world settings.
