Leads the team this role joins
Heads the group this role sits in
In-house, owns the opening
From your own Gmail and LinkedIn.
About the role
ZipRecruiter lists a Software Engineer, Big Data role in its Tech Enablement team, tagged as remote and open worldwide, for engineers with at least two years of professional experience. The work centers on the data pipelines, streaming and ML infrastructure that feed the company's customer-facing products. The employer describes a hybrid environment, noting most US-based positions can also be done remotely. The wider team also builds AI tooling, including a data analysis agent and an LLM gateway.
What you’ll do
- Own the pipelines and systems that deliver web event data into the data lake and onward through event streams.
- Handle large, changing datasets with batch and streaming techniques, weighing speed, efficiency and reliability.
- Build frameworks that speed up ML development and improve the quality and reliability of ML-powered products.
- Create tooling that lets people and automated systems add, maintain and find data documentation.
- Build and maintain an agentic data exploration tool that helps teams query, analyze and share insights.
What they’re looking for
- Two or more years of professional software development, including building and running data pipelines that feed a customer-facing product.
- Hands-on Apache Spark work: writing, tuning and debugging batch or streaming jobs at scale.
- Experience deploying and running containerized services and batch jobs.
- Solid computer science foundations, including data structures, algorithms, distributed systems and testing.
- A BS, MS or PhD in computer science, mathematics, physics or a related field, or equivalent practical experience.
Nice to have
- Four or more years of professional development with a focus on data-intensive systems.
- Working knowledge of AWS services such as S3, IAM, EC2 and MSK, plus metrics, logs and alerting.
- Data lake experience with Parquet on object storage, a catalog such as AWS Glue, and Apache Iceberg or Delta Lake.
- Streaming experience with Kafka, Apache Flink or Spark Structured Streaming.
- Workflow orchestration with Apache Airflow, including DAGs, backfills and on-call for scheduled pipelines.
- Understanding of open table format internals, including schema evolution, partitioning and compaction.
- Deploying services on Kubernetes with Docker.
- Building a data platform for a user-facing product, covering ingestion, ETL, data permissions and discovery.
What’s on offer
- US base salary range of $135,000 to $185,000 for the full-time role, set by role, level and location.
- Equity, bonuses, commission or other compensation may form part of the total package.
- Competitive compensation and an exceptional benefits package.
- Flexible vacation and paid time off.
- An employer-matched 401(k) plan.
Skills
Questions about this role
Is the job remote?
The listing is tagged as worldwide remote. The employer's text describes a hybrid environment and notes that most US-based positions can also be done remotely, so check the original posting for location terms.
What is the US salary range?
The US base salary range is $135,000 to $185,000.
How much experience is required?
The minimum is two or more years of professional software development experience, and the preferred level is four or more years with a data-intensive focus.
Is a degree required?
A BS, MS or PhD in a related field is listed, or equivalent practical experience.