Apps & Tools
BullshitBench
A benchmark for testing AI sycophancy and pushback against nonsense questions.
Is this your creation?
Description
BullshitBench is a testing suite that poses 100 absurd, nonsensical questions to AI models to evaluate their reliability and sycophancy. It measures how effectively a model pushes back against false premises, such as the idea that bathroom cabinet screw types affect pantry food flavor, rather than hallucinating a supporting answer.
Descriptions, tags, and model credits may be AI-generated or inferred from public sources and can be incomplete or wrong. Learn more.