CVE-2024-58400

Name of the Vulnerable Software and Affected Versions llama.cpp versions prior to b3701

Description An out-of-bounds read exists in the llama decode internal() and llama encode internal() functions. Remote unauthenticated attackers can read memory or cause a process crash by providing unvalidated token IDs. This is achieved by sending integer-array prompts to the /completion endpoint with IDs that fall outside the 0 to n vocab range, allowing access to embedding memory outside the intended boundaries.

Recommendations Update llama.cpp to version b3701 or later.