Staff+ ML Infrastructure Engineer

Layer Health (Headquarters: Boston, NYC (Hybrid))

Location: Hybrid (Boston/ NYC)   |   Full-Time
Python GCP ML Infrastructure Kubernetes Docker Data Science

About Layer Health: Layer Health is a cutting-edge healthcare technology company founded in 2023 by leading machine learning researchers from MIT and Harvard Medical School. We are building an AI layer that accurately and scalably synthesizes information from medical records, with the mission to reduce friction everywhere in healthcare.

About The Role: As a Staff+ ML Infrastructure Engineer, you will be responsible for designing and implementing the infrastructure that powers our large language models and AI healthcare solutions. This role requires deep expertise in ML infrastructure and systems to support our growing AI needs.

Responsibilities:

  • Design and implement scalable ML infrastructure
  • Build and maintain our model serving and deployment systems
  • Optimize infrastructure for AI/ML workloads
  • Collaborate with ML researchers and engineers to develop infrastructure solutions
  • Ensure system reliability, security, and performance

Requirements:

  • 6+ years of experience in ML infrastructure
  • Strong knowledge of distributed systems and cloud platforms
  • Experience with containerization (Docker, Kubernetes)
  • Proficiency in Python and infrastructure-as-code tools
  • Excellent technical leadership and problem-solving skills

What You’ll Bring:

  • Proven experience building ML infrastructure
  • Deep understanding of distributed computing and ML systems
  • Experience with cloud ML services and frameworks
  • Strong background in Python and infrastructure automation
  • Ability to mentor junior engineers and drive technical strategy
Post Date: June 16, 2025