Location: San Francisco, CA   |   Full-Time   |   $160,000 - $220,000
Python Linux PostgreSQL Dagster SQL Docker Web Crawling Data Pipeline Data Cleaning Kubernetes LLM DB Admin Mentorship Architecture DevOps Back End Engineer Data Engineer 
Company: Spice Data (YC S19) licenses data to leading Fortune 500 restaurants, focusing on sourcing (web crawling), cleaning, and formatting large datasets (150M+ points/month). We're a small, profitable, SF-based team founded in 2019, relying heavily on self-hosted open source/core services on bare VMs via docker compose.

Role: Join our small and nimble engineering team in downtown San Francisco (On Site required a few times per week) as an experienced engineer.

Responsibilities:
- Provide mentorship to teammates via code and architecture review.
- Improve, maintain, and expand our end-to-end data pipeline.
- Create and manage data collection/crawling scripts (HTTP, browser/mobile automation) - deep experience is a huge plus.
- Build and maintain automation/scheduling tooling (currently self-hosted Dagster).
- Create data cleaning and normalization scripts, with opportunities to integrate ML/LLMs.
- Assist with miscellaneous DevOps tasks managing infrastructure.

Ideal Candidate:
- 3+ years of experience.
- Enjoys working on a variety of projects and large data pipelines.
- Proficient (intermediate or higher) in Python (e.g., decorators, async/await, MRO, context managers).
- Proficient (intermediate or higher) in SQL (e.g., complex joins, efficient bulk updates, schema migrations).
- Basic understanding of Linux and Docker.
- Able to execute with minimal supervision.

Required Skills:
- Python
- SQL
- Linux
- Docker

Bonus Skills:
- Web Crawling (huge plus)
- Kubernetes
- LLM Pipelines
- DB Administration
- HomeLab/Server Administration
- Background in Statistics
- Full Stack Web Development
- Mobile App Development

Tech Stack: Python, Linux, PostgreSQL, Dagster

Benefits:
- Lunch provided when in office
- Unlimited PTO
- 401k
- Company paid Platinum PPO health and comparable dental & vision insurance
- Competitive equity (0.50% - 3.00%)
Post Date: April 23, 2025