2024-11-04
Google LLM 'Big Sleep' Finds SQLite Zero-Day
A November 1 blog post from Google's Project Zero details "possibly the first example of an AI agent finding an exploitable memory safety issue in real-world software," in which their LLM, Project Naptime -- now "Big Sleep," involving both Google and DeepMind -- uncovered a stack-based buffer overflow in the SQLite open source database engine. Rather than open-ended searching, the project has been targeting in-the-wild vulnerabilities by looking for variations on patched flaws. Big Sleep took a known vulnerability as a starting point and investigated recent commits for similar security issues, finding the vulnerability in code yet to be released. Once discovered and disclosed, the flaw was patched by SQLite the same day. Google reports that its AFL fuzzer "has reached a natural saturation point" in its ability to uncover bugs in SQLite; 150 CPU-hours of fuzzing did not detect the same issue. The team still believes a "target-specific fuzzer" would have similar efficacy, but is optimistic about AI's potential for helping defenders gain an "asymmetric advantage."
Editor's Note
SQLite was selected after a null-pointer dereference flaw was discovered by Team Atlanta at the DARPA AixCC event earlier this year. This effort shows how an LLM could be used to augment your SQA processes, with the caveat that it's based on information from fixed flaws to find new flaws. With continued emphasis from CISA and others on secure code and continuous validation (and attestation) of that security/SBOMs/etc., keep an eye on this approach to aid your ability to meet those emerging requirements.
Lee Neely
Read more in
Project Zero: From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code
The Record: Google uses large language model to discover real-world vulnerability
Security Week: Google Says Its AI Found SQLite Vulnerability That Fuzzing Missed
The Hacker News: Google's AI Tool Big Sleep Finds Zero-Day Vulnerability in SQLite Database Engine