started · updated
OpenAI uses human contractors to review real ChatGPT conversations
OpenAI is utilizing an internal initiative known as 'Project Lily' to improve its ChatGPT model through human oversight. According to reports, hundreds of external contractors are tasked with reading and evaluating real user conversations. These reviewers rate model responses on a scale of 1 to 7, focusing on reducing 'sycophantic behavior'—where the AI agrees too readily with users—and eliminating unnatural language patterns.
While OpenAI employs a 'Privacy Filter' designed to mask personal identifiers, the company has acknowledged that the system is not perfect. Sensitive details can still pass through, particularly in shorter dialogues. Furthermore, reviewers may have access to a 'user memories summary' that includes information about a user's past interests and general geographic location, raising significant privacy concerns.
Contractors, often hired through third-party agencies, can earn upwards of $50 per hour. While this practice is not unique to OpenAI—with Google Gemini and Anthropic also employing human reviewers—the exposure of 'Project Lily' has highlighted the tension between AI refinement and user data confidentiality.
Entities
404 Media · Anthropic · ChatGPT · Crossing Hurdles · Google · OpenAI · Project Lily
Claims
What the coverage asserts, and how many sources carry each claim.
- [● 4 SOURCES] OpenAI uses a 'Privacy Filter' to remove personal identifiers, but admits it is not infallible. businessmag.al · www.ad-hoc-news.de · www.pcgameshardware.de · unwire.hk
- [● 3 SOURCES] The goal of the human review is to reduce sycophantic behavior and unnatural language patterns. www.ad-hoc-news.de · www.ilsoftware.it · unwire.hk
- [○ 1 SOURCE] Google Gemini and Anthropic also utilize human review mechanisms for their AI models. unwire.hk
- [● 3 SOURCES] Contractors are paid over $50 per hour for their work. www.ad-hoc-news.de · unwire.hk
- [● 2 SOURCES] Reviewers may have access to a 'user memories summary' which can reveal geographic locations or interests. businessmag.al · unwire.hk
- [● 5 SOURCES] OpenAI employs hundreds of external contractors to evaluate ChatGPT responses. businessmag.al · www.ad-hoc-news.de · www.ilsoftware.it · unwire.hk
- [● 6 SOURCES] 404 Media reported that OpenAI uses an internal program called 'Project Lily' to review real user conversations. businessmag.al · www.tecnoandroid.it · www.ad-hoc-news.de · www.ilsoftware.it · www.pcgameshardware.de · +1 more
- [● 3 SOURCES] Reviewers rate model responses on a scale of 1 to 7. www.ad-hoc-news.de · unwire.hk