Senior Software Engineer, Big Data
Skills
About the role
This is a senior big data software engineering role at ZipRecruiter, remote-eligible worldwide though the description centers on US-based positions. You'd build data processing pipelines, streaming and batch systems, and ML infrastructure powering an employment marketplace serving millions of jobseekers. It's a full-time engineering role on a distributed systems team.
What you’ll do
- Build data processing and exploration pipelines and ML infrastructure
- Deploy cloud-based technologies for critical projects
- Write, test, instrument and deploy code to a Kubernetes environment
- Help drive innovation and evolution of the ZipRecruiter platform
What they’re looking for
- 5+ years of professional software development experience focused on Python and big data technologies
- Experience with Spark, Kafka, Hadoop, Hive or similar big data technologies
- Comprehensive computer science fundamentals in coding, OOP, data structures and algorithms
- Experience with containerization technologies like Docker and/or Kubernetes
Nice to have
- 8+ years of professional software development experience
- BS/MS/PhD in Mathematics, Computer Science, Physics or related field
- Experience with data integration tools like Apache Kafka, Flume and NiFi
- Familiarity with Delta Lake, HBase, Cassandra and MongoDB
- Familiarity with Apache Hudi, Beam, Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics or Azure Databricks
What’s on offer
- US base salary range of $170,000–$240,000
- Competitive compensation and exceptional benefits package
- Flexible vacation and paid time off
- Employer-matched 401(k) plan
- Hybrid work environment, with most US-based positions also able to be performed remotely
Questions about this role
Is this role remote?
The posting describes a hybrid environment where most US-based positions can also be performed remotely.
How much does it pay?
The US base salary range listed is $170,000–$240,000.
How many years of experience do I need?
5+ years of professional software development experience, with 8+ years preferred.
Related roles
Senior Software Engineer - DevOps Engineer
A senior DevOps engineering role at Wells Fargo in Bengaluru, building CI/CD pipelines and driving automation.
Software Engineering Senior Manager - Data Engineering - GEN AI
A senior engineering management role leading data engineering teams for Wells Fargo's Treasury Technology group in Bengaluru. Suited to an experienced people leader with a data engineering background in regulated financial services.
Senior Software Engineer (Python, AI ML Engineer)
Optum is hiring a senior software engineer in Gurugram to build and operate AI, ML, and LLM-powered enterprise solutions. The role suits engineers with production AI experience, Python or similar software skills, and knowledge of RAG, orchestration, cloud services, and evaluation.
Senior Software Engineer-Python,spark,Iceberg,Hive
A senior software engineering role at Wells Fargo in Hyderabad, modernizing large-scale data platforms with Python, Spark, Iceberg, and Hive.
Software Development Engineer, Amazon Traffic Engineering
A software development engineer role at Amazon in Hyderabad, building service onboarding and tax-compliance systems at scale.
Senior Software Engineer (AI & Data)
Senior AI and data software engineer role in Bengaluru focused on production data platforms, analytics infrastructure and agent orchestration. The role suits engineers with four or more years of relevant experience who value reliable and auditable systems.