Senior DataOps Engineer

**About Black Canyon Consulting:** Black Canyon Consulting (BCC) partners with the National Center for Biotechnology Information (NCBI) to deliver cutting-edge technology solutions. We help organizations like NCBI build and maintain robust, scalable, and secure systems. Our team combines deep technical expertise with industry best practices to ensure client success.

**Job Description:** As a Senior DataOps Engineer at BCC, you will lead the development and improvement of an enterprise-wide DataOps platform for NCBI. This initiative aims to streamline data processing workflows and ensure compliance with Federal standards. You'll design and implement solutions for data pipelines, evaluate new technologies, and help NCBI developers adopt best practices in data operations.

**Responsibilities:**
- Develop and maintain the DataOps platform with tools like AirFlow, Kafka, and Kubernetes
- Create common tools and libraries for data processing
- Ensure compliance with Federal security standards through automated solutions
- Troubleshoot and optimize data pipelines
- Stay ahead of industry trends in data operations and cloud computing

**Requirements:**
- 7+ years of experience in data processing and cloud services
- Proficiency in Python, C++, or similar languages
- Expertise in Kubernetes, containerization, and cloud platforms (AWS, GCP, Azure)
- Experience with data processing frameworks and observability tools
- Strong understanding of Linux and networking fundamentals