Preamble (company)
Artificial intelligence research company
From Wikipedia, the free encyclopedia
Preamble is a U.S.-based AI safety startup founded in 2021. It provides tools and services to help companies securely deploy and manage large language models (LLMs). Preamble is known for its contributions to identifying and mitigating prompt injection attacks in LLMs.
- Jonathan Cefalu
- Jeremy McHugh
 | |
| Type | Privately held company |
|---|---|
| Industry | Artificial intelligence |
| Founded | 2021 |
| Founders |
|
| Headquarters | Pittsburgh, Pennsylvania, U.S. |
| Website | preamble.com |
History
Preamble is particularly notable for its early discovery of vulnerabilities in widely used AI models, such as GPT-3, with a primary discovery of the prompt injection attacks.[1][2][3] These findings were first reported privately to OpenAI in 2022 and have since been the subject of numerous studies in the field.
Preamble has entered a partnership with Nvidia to improve AI safety and risk mitigation for enterprises.[4] They are a part of the Air Force security program as a notable Pittsburgh AI hub.[5] Since 2024, Preamble has partnered with IBM to combine their guardrails with IBM Watsonx.[6]
Research
Preamble's research revolves around AI security, AI ethics, privacy and regulation. In May 2022, Preamble's researchers discovered vulnerabilities in GPT-3 which allowed malicious actors to manipulate the model's outputs through prompt injections.[7][3] The resulting paper investigated the vulnerability of large pre-trained language models, such as GPT-3 and BERT, to adversarial attacks. These attacks are designed to manipulate the models' outputs by introducing subtle perturbations in the input text, leading to incorrect or harmful outputs, such as generating hate speech or leaking sensitive information.[8]
Preamble was granted a patent by the United States Patent and Trademark Office to mitigate prompt injection in AI models.[9]