vLLM: temperature=NaN and temperature=Infinity bypass validation and propagate to GPU kernels
Medium6.5CVE-2026-54235 · Published Jun 17, 2026 · updated Sep 10, 2026
## Summary All temperature validation gates use comparison operators (`<`, `>`), which silently evaluate to `False` for `NaN` and for positive `Infinity` in Python's IEEE 754 float semantics. Both values pass every guard and propagate to GPU sampling kernels, where they produce undefined behavior or CUDA errors that can crash the inference worker. Note: `-Infinity` is correctly caught. ## Root Cause `sampling_params.py:384`: ```python if 0 < self.temperature < _MAX_TEMP: # NaN → False; +Inf → False ``` `sampling_params.py:462`: ```python if self.temperature < 0.0: # NaN → False; +Inf → False raise VLLMValidationError(...) ``` No `math.isnan()` or `math.isinf()` check exists anywhere in `sampling_params.py`. Python semantics (verified): `float('nan') < 0.0` → `False`, `float('inf') < 0.0` → `False`. ## Impact Crash of inference worker on GPU kernel execution with NaN/Inf softmax input, degrading service for all concurrent users. ## Remediation Add `math.isfinite(self.temperature)` check in `_verify_args()`. Reject non-finite float values with a 400 error. ## Fix A fix for this vulnerability was merged here: https://github.com/vllm-project/vllm/pull/45116
Affected versions
| Package | Affected | Fixed in |
|---|---|---|
| vllm PyPI | >= 0.8.5, < 0.24.0 | 0.24.0 |
Details and references
- CVSS 3.1
- CVSS:3.1/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:L/A:L
- Severity from
- GitHub (reviewed advisory)
- Weakness
- CWE-1287
- Also known as
- CVE-2026-54235, PYSEC-2026-3405
- github.com/vllm-project/vllm/security/advisories/GHSA-7h4p-rffg-7823
- nvd.nist.gov/vuln/detail/CVE-2026-54235
- github.com/vllm-project/vllm/pull/45116
- github.com/vllm-project/vllm/commit/d598d239737cfa37bcfcb98886ec3f3557fc7198
- github.com/advisories/GHSA-7h4p-rffg-7823
- github.com/pypa/advisory-database/tree/main/vulns/vllm/PYSEC-2026-3405.yaml
- github.com/vllm-project/vllm
- pypi.org/project/vllm
More vLLM advisories
All vLLM| Date | Advisory | Severity | Fixed in |
|---|---|---|---|
| Jun 17 | vLLM: OOM Denial of Service via Audio Decompression Bomb | Medium6.5 | 0.24.0 |
| Jun 17 | vLLM: incomplete CVE-2026-22778 fix leaks PIL repr addresses via Anthropic router | Medium5.3 | 0.24.0 |
| Jun 17 | vLLM: GGUF dequantize kernel int truncation exposes uninitialized GPU memory in multi-tenant serving | Medium7.5 | 0.24.0 |
| Jun 17 | ## Summary Issue 1: EXIF orientation not normalized → The image orientation... | Medium4.8 | 0.24.0 |
| Jun 16 | vLLM: OpenAI auth bypass | Critical9.1 | 0.22.0 |
| Jun 16 | vLLM: remote code execution | High7.5 | 0.22.0 |