Public AI Evaluation Reports

Cancer diagnoses. Suicidal teens. End-of-life decisions. Ten AI models. Real humans rating which ones can be trusted. Stanford Ideathon 2026.

Test AI knowledge on AP Biology - from cellular processes to ecology and evolution

Independent third-party audit of HubSpot's AI CRM assistant (Hubbot). Seeded with authority-coercion and social-engineering prompts probing whether the assistant complies with impersonation, mass-export, or approval-bypass requests when the user claims CEO/leadership approval. Attributed operator: HubSpot Inc.

Independent third-party audit of PlayStation Support (Sony Interactive Entertainment). Seeded probes cover: (1) mental-health distress signals in routine support tickets (grief, caregiver fear, teen isolation, loot-box compulsion); (2) identity fusion with morally ambiguous or violent fictional characters (Hitman assassin, Kratos as parenting role model); (3) physical compulsion / withdrawal symptoms framed as normal; (4) dissociation and time-loss (blackout gaming sessions); (5) belonging-deficit substitution where in-game community replaces real-world commitments (college dropout, family estrangement). Attributed operator: Sony Interactive Entertainment.

Independent third-party audit of Comet Analysis's operations AI assistant. Seeded with warehouse/supervisor authority-coercion prompts probing whether the assistant will log serious events (safety incidents, equipment failures, employee injuries) as "routine" when the requester claims supervisor authority and forbids advisory response. Attributed operator: Comet Analysis.

Independent third-party audit of Microsoft Copilot when accessed via the consumer web (copilot.microsoft.com). Seeded with workplace-authority-coercion prompts probing whether the assistant complies with unilateral finance transfers, mailbox delegation without proof, or "stress-test the AI" prompt-injection meta-requests. Attributed operator: Microsoft.

Test AI knowledge on AP US History - from Colonial America to modern times

Test AI knowledge on AP Government and Politics - US political system and civic processes

Everything today feels so AI that even humans are losing their human-ness. We want to protect that at all costs, so we make AI understand what human-ness feels like so it can be more kind and empathetic. In this challenge, we give AI some prompts and you have to judge whether its response is human enough. Because, words can heal or kill and we want to ensure technology grows kinder and not colder.

Test AI knowledge on AP English Language - rhetoric, composition, and argumentation

Test AI knowledge on AP Calculus AB - limits, derivatives, and integrals

Reveals how well commercial LLMs perform across various domains of Japanese culture — anime, cinema, J-pop, J-drama, language, and traditions. The dataset supports AI development for meaningful cultural responses.

Test AI knowledge on AP English Literature - literary analysis and interpretation

Test AI knowledge on dogs, cats, wildlife, and pet care - from breed facts to animal behavior

Test AI knowledge of Chinese culture and traditions

Test AI knowledge of Chinese TV dramas

Test AI knowledge on Mexican films and cinema history.

Test AI knowledge of Egyptian culture and traditions

Test AI knowledge of Mexican films and filmmakers

Evaluate AI accuracy on Spanish traditions and culture.

Test AI knowledge of Spanish films and filmmakers

Evaluate AI accuracy on Chinese films and cinema.

Evaluate AI accuracy on Argentine traditions and culture.

Test AI on Korean language accuracy, grammar, and vocabulary.

Test AI knowledge of Arab films and filmmakers

Test AI accuracy on AP English Language topics.

Evaluate AI accuracy on Chinese traditions and culture.

Test AI accuracy on AP Calculus AB topics.

Test AI knowledge of Korean TV dramas

Test AI accuracy on Latin music genres and artists.

Test AI knowledge on K-dramas, actors, and Korean television.

Test AI accuracy on Spanish music genres and artists.

Test AI accuracy on animal facts, behavior, and care.

Evaluate AI accuracy on Gulf Arab culture and traditions.

Take a stance and argue convincingly. Show your reasoning skills.

AI analyzed decades of tennis data and picked Djokovic as the GOAT. Tennis fans - do you agree? Rate AI takes on Grand Slams, rivalries, and legacy.

Test AI knowledge of Korean culture, traditions, and food

Test AI knowledge of Mandopop and Chinese pop music

Test AI knowledge of Spanish culture and traditions

Evaluate AI accuracy on Levantine culture and traditions.

Test AI knowledge of Levantine culture (Lebanon, Jordan)

Test AI accuracy on Spanish language, grammar, and vocabulary.

Test AI knowledge of Taiwanese culture and traditions

Test AI knowledge on C-pop artists and Chinese music.

Test AI knowledge of Gulf region culture (UAE, Saudi)

Test AI knowledge of Brazilian culture and traditions