CVE-2024-58400

llama.cpp before b3701 contains an out-of-bounds read vulnerability in llama decode internal and llama encode internal that allows remote unauthenticated attackers to read memory by supplying unvalidated token IDs. Attackers can send integer-array prompts to the llama-server /completion endpoint with IDs outside 0 to n vocab to read embedding memory out of bounds or crash the process.