Location: Remote (Global)   |   Full-Time   |   $60,000 - $180,000
Machine Learning Research LLM Evaluation Systems Synthetic Data Open Source AI Tooling AI Engineer
**About Lexoga:**

Lexoga One helps early-stage and high-growth startups find exceptional engineering and AI talent. We work with some of the most ambitious teams in tech to help them scale by finding the right people, fast. This role is part of our curated 
search process for a YC-backed AI tooling startup.

**About The Role:**
We are hiring an Applied Research Engineer who thrives at the intersection of machine learning, research, and real-world deployment for a YC-backed AI tooling startup. The company is building tooling to evaluate and align LLM-based systems, and your work will directly influence the next wave of developer-facing AI tools.

**Responsibilities:**
*   Design optimization algorithms to align LLM-based evaluators with human judgments
*   Develop data synthesis techniques to auto-generate test samples for RAG and tool-use workflows
*   Fine-tune and align LLMs for evaluation and oversight tasks
*   Read and apply cutting-edge research to practical engineering problems
*   Contribute to internal R&D and open-source initiatives

**Requirements:**
*   4+ years of experience in machine learning and applied research
*   Hands-on experience with LLMs, synthetic data generation, and evaluation systems
*   Passion for open research and staying updated with recent work on LLM-as-a-judge, synthetic benchmarking, etc.
*   Contributions to open-source projects or publications on relevant topics
*   Enjoy working in startup environments with small, focused teams

**Bonus Points:**
*   Publications or blog posts on LLM evaluation, synthetic data, or alignment
*   Contributions to projects like OpenEvals, RAGChecker, or similar
*   Experience contributing to impactful open-source AI tooling
Post Date: June 10, 2025