Software Engineer - AI Evals and Test

P-1 AI is seeking a Software Engineer to join our AI Evaluations and Testing team. In this role, you’ll be instrumental in developing rigorous, domain-specific evaluations to ensure we’re making meaningful progress on real-world engineering challenges rather than just optimizing general benchmarks. This position requires a strong technical background in software engineering, with experience in designing and implementing systems for testing and evaluating AI models. You’ll work closely with researchers and engineers to create innovative solutions that validate the effectiveness of our AI systems across various engineering domains. The ideal candidate will have a passion for quality assurance and a deep understanding of how to measure progress in AI-driven engineering applications. This full-time, remote position offers a salary range of $160,000-$200,000 plus equity opportunities. We’re looking for someone with a proven track record in software engineering, particularly in testing frameworks, evaluation metrics, and domain-specific validation. Experience with AI/ML systems is highly valued, as is the ability to collaborate effectively across disciplines. Join our team to help ensure that our AI innovations deliver real-world impact!