vllm

Admin Auditedopen source

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-project

Categories

DevOps

Technical Details

open source

Model Type

Input:

Text

Output:

Text

Details

Open Source

License

Self-hosted

Hosting

Website

https://vllm.ai

Ratings & Reviews

No verified reviews yet.

Quick Facts

Status: Verified
License: Open Source
Hosting: Self-hosted
Languages: en