Leads the team this role joins
In-house, owns the opening
Put the opening up
From your own Gmail and LinkedIn.
About the role
This is a full-time remote senior role building data pipelines and tooling that feed ZipRecruiter's products and internal AI tools. It suits engineers with at least four years of professional experience, including hands-on Apache Spark work and pipelines that feed a customer-facing product. The Tech Enablement team builds data infrastructure, AI enablement tools and the LLM gateway behind the company's customer-facing products.
What you’ll do
- Design, build and maintain pipelines that bring web events into the data lake and event streams.
- Process large, evolving datasets with batch and streaming methods, weighing speed, efficiency and reliability.
- Build and run MLOps frameworks that speed up model development and monitoring.
- Build tooling so people and automated systems can add, maintain and find data documentation.
- Build and maintain Sift, the agentic tool for data exploration and analysis.
What they’re looking for
- At least four years of professional software development, including building and operating data pipelines that feed a customer-facing product.
- Hands-on Apache Spark experience writing, tuning and debugging batch or streaming jobs at scale.
- Experience deploying and operating containerized services and batch jobs.
- Solid computer science fundamentals, including data structures, algorithms, distributed systems and testing.
- A degree in computer science, mathematics, physics or a related field, or equivalent practical experience.
Nice to have
- Four or more years focused on data-intensive systems.
- Working knowledge of AWS services such as S3, IAM, EC2 and MSK, plus metrics, logs and alerting.
- Data lake experience with Parquet, AWS Glue and Apache Iceberg or Delta Lake.
- Streaming experience with Kafka, Apache Flink or Spark Structured Streaming.
- Airflow experience, including DAGs, backfills and on-call for scheduled pipelines.
- Knowledge of open table format internals, including schema evolution, partitioning and compaction.
- Kubernetes and Docker deployment experience.
- Experience building a data platform for a user-facing product.
What’s on offer
- Base salary of $190,000-$250,000 USD per year across the U.S. range.
- Possible equity, bonus or commission, depending on the position.
- Medical, financial and other benefits, flexible vacation and paid time off.
- Employer-matched 401(k).
Skills
Questions about this role
Is this job remote?
Yes, the role is listed as remote.
How much does it pay?
The U.S. base salary range is $190,000-$250,000 per year.
How many years of experience do I need?
At least four years of professional software development, including data pipelines feeding a customer-facing product.
Do I need a degree?
A degree in computer science, mathematics, physics or a related field is listed, or equivalent practical experience.