The Research Engineer, Evals role at Callosum focuses on the design and implementation of evaluation benchmarks for agentic systems, aiming to enhance the reliability and performance of AI evaluations. Key responsibilities include developing methodologies for statistical analysis, ensuring the quality of evaluation results, and creating structured evidence from raw data. Candidates should possess hands-on experience with language models and demonstrate strong engineering and communication skills