CVE-2024-8768:
vLLM denial of service vulnerability
7.5
CVSS Score
3.1
Basic Information
CVE ID
GHSA ID
EPSS Score
0.16939%
CWE
Published
9/17/2024
Updated
9/17/2024
KEV Status
No
Technology
Python
Technical Details
CVSS Vector
CVSS:3.1/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H
Package Name | Ecosystem | Vulnerable Versions | First Patched Version |
---|---|---|---|
vllm | pip | < 0.5.5 | 0.5.5 |
Vulnerability Intelligence
Miggo AI
Root Cause Analysis
The root cause was the lack of input validation in LLMEngine's request processing path (_add_processed_request), which allowed empty prompts to reach the scheduler. The scheduler's _get_num_new_tokens method then triggered an assertion on zero tokens, causing a crash. The high-confidence vulnerable function is the unpatched _add_processed_request, while the medium-confidence scheduler function represents the exploitable assertion (CWE-617). The commit added validation in LLMEngine to prevent empty prompts from reaching the assertion.