The Research Engineer, Evals role at Callosum focuses on developing evaluation methodologies for agentic AI systems. Key responsibilities include designing benchmarks, building evaluation infrastructures, and ensuring the quality of results through rigorous testing and validation processes. Candidates should possess hands-on experience with large language models and demonstrate strong engineering and communication skills.