Member of Technical Staff - Research Engineering

Company: Skysight is an AI-infrastructure company based in San Francisco, CA, building large-scale batch inference infrastructure and tooling with a great user developer experience. Their mission is to build tools that increase human leverage.

Role: We are seeking a research-focused engineer to join a small, mighty team working at the forefront of large-scale inference technologies. You’ll be directly responsible for designing, owning, and improving research processes and systems pertaining to large-scale inference.

Responsibilities:
*   Creating private and public benchmarks to evaluate performance of open-source and proprietary LLMs on canonical batch inference tasks.
*   Researching novel inference, distillation, and evaluation techniques, and translating findings into production-ready products.
*   Writing performance profilers, job schedulers, cost attribution models, and other scientifically-oriented code.
*   Collaborating with customers and partners to iterate on their needs, share best practices, and contribute to their overall success - whether via our products or someone else’s.
*   Working on open-source examples of our tooling, sharing fascinating and novel learnings out into the world.

Ideal Candidate Fit:
*   Very technically curious, interested or experienced in leading AI research efforts through demonstrated experience (professional, academic, or personal).
*   Learns fast and takes ownership of outcomes.
*   Thinks from first principles, and questions default “expert” opinions.
*   Wants to contribute to the greater benefit of society, and win in doing so.
*   A kind, honest, and positive-sum person ready to have fun and learn a ton along the way.

Other: We will not be able to accommodate visa sponsorship at this time. For extra priority when applying via email, please include [HN] in the subject line.