Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
ZipRecruiterPosted 20 days ago

Senior Software Engineer, Big Data, Tech Enablement

Remote — WorldwideSeniorRemote or on-siteFull-time$190,000 – $250,000 a year
Who we'd reach at ZipRecruiterFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Team director

Heads the group this role sits in

Recruiter

In-house, owns the opening

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a senior big data engineering role at ZipRecruiter, listed as worldwide with a hybrid option, for engineers with at least 4 years of professional software development experience. The engineer works in the Tech Enablement group, which builds the data pipelines, data platform and developer tooling that other product teams depend on. Work covers ingesting web events into the data lake, batch and streaming processing, ML pipeline tooling and an agentic data analysis tool.

What you’ll do

  • Design, build and maintain pipelines that bring web events into the data lake and event streams.
  • Process large, changing datasets in batch and streaming, balancing speed, efficiency and reliability.
  • Build frameworks that speed up ML development and improve the observability and reliability of ML systems.
  • Build tooling that lets people and automated systems add, maintain and find data documentation.
  • Design, build and run an agentic data exploration tool that supports natural language querying.

What they’re looking for

  • 4+ years of professional software development, including building and running data pipelines that feed a customer-facing product.
  • Hands-on Apache Spark experience writing, tuning and debugging batch or streaming jobs at scale.
  • Experience deploying and operating containerized services and batch jobs.
  • Solid computer science fundamentals, including data structures, algorithms, distributed systems and testing.

Nice to have

  • 4+ years focused on data-intensive systems.
  • Working knowledge of AWS services such as S3, IAM, EC2 and MSK, plus metrics, logs and alerting.
  • Experience with a data lake stack, including Parquet on object storage, AWS Glue, and Apache Iceberg or Delta Lake.
  • Streaming experience with Kafka, Apache Flink or Spark Structured Streaming.
  • Experience authoring Airflow DAGs, running backfills and handling on-call for scheduled pipelines.
  • Familiarity with open table format internals such as schema evolution, partitioning and compaction.
  • Experience deploying services on Kubernetes with Docker.
  • Experience building a data platform for a user-facing product, including ingestion, ETL, permissions and discovery.

What’s on offer

  • Competitive compensation and an exceptional benefits package.
  • Flexible vacation and paid time off.
  • Employer-matched 401(k) plan.
  • US base salary range of $190,000-$250,000 per year, with equity, bonus or commission possible depending on the position.
  • Hybrid work environment, with most US-based positions also open to remote work.

Skills

Questions about this role

Is this role remote?

It is listed as worldwide, with a hybrid environment and remote options for most US-based positions.

How much does it pay?

The US base salary range is $190,000-$250,000 per year, with other compensation possible depending on the position.

How many years of experience are needed?

At least 4 years of professional software development experience is required.

Which skills matter most?

Apache Spark, containerized services, AWS, Airflow, Kubernetes and Docker are emphasized in the requirements.