Samsung Electronics today unveiled TRUEBench (Trustworthy Real-world Usage Evaluation Benchmark), a proprietary benchmark developed by Samsung Research to evaluate AI productivity. TRUEBench provides a comprehensive set of metrics to measure how large language models (LLMs) perform in real-world workplace productivity applications. To ensure realistic evaluation, it incorporates diverse dialogue scenarios and multilingual conditions. Drawing on Samsung's in-house use of AI for productivity, TRUEBench evaluates commonly used enterprise tasks - such as content generation, data analysis, summarization and translation - across 10 categories and 46 sub-categories. The benchmark ensures reliable scoring with AI-powered automatic evaluation based on criteria that are collaboratively designed and refined by both humans and AI.

"Samsung Research brings deep expertise and a competitive edge through its real-world AI experience," said Paul (Kyungwhoon) Cheun, CTO of the DX Division at Samsung Electronics and Head of Samsung Research. "We expect TRUEBench to establish evaluation standards for productivity and solidify Samsung's technological leadership."