Runs the team day to day
In-house, owns the opening
Joined the team recently
From your own Gmail and LinkedIn.
How this role compares
One of 77 open Senior Data Engineer roles we are tracking today.
This posting does not state pay. The middle of the 16 that do advertises £90,000 – £110,000 a year.
Posted 13 days ago, with 49 of the others posted since and 27 still open from before.
Counted across the roles Frontrunner has open right now.
About the role
This is a full-time senior big data engineering role at Kohl's, listed as remote with the posting location in Menomonee Falls, Wisconsin, for engineers with four or more years of experience. You build and maintain batch and streaming ETL pipelines and cloud data platforms on GCP, with attention to PCI and PII compliance.
What you’ll do
- Develop, automate and maintain batch and streaming ETL pipelines using Airflow, Spark, Python and Scala.
- Build and manage cloud data ecosystems on GCP, including BigQuery, Bigtable, Dataproc, Pub/Sub and Cloud Storage.
- Design SQL and NoSQL data models for data lakes and warehouses.
- Write complex SQL for transformation and analytics optimisation.
- Apply test-driven development to pipelines, Airflow workflows and Spark jobs.
- Apply data mesh and data-as-a-product principles.
- Implement real-time ingestion with Kafka Connect and stream processing with Spark Streaming or Flink.
- Optimise performance, scalability and cost across GCP components.
- Ensure PCI and PII compliance under standards such as GDPR, PCI DSS, SOX and CCPA.
- Work with stakeholders, data scientists and full stack engineers on documented, reusable data products.
What they’re looking for
- Four or more years of software development experience.
- Understanding of application design patterns, event-driven architecture, databases, schemas and testing strategies.
- In-depth experience with continuous integration, continuous deployment and test-driven development.
Nice to have
- A bachelor's degree or equivalent in MIS, computer science or a related field.
- Experience troubleshooting large-scale applications and tuning performance.
- Exposure to GCP, AWS or Azure.
- Familiarity with XP (Extreme Programming).
What’s on offer
- Full-time employment in the retail industry; the posting does not state salary or benefits.
Skills
Questions about this role
Is this role remote?
The job is listed as remote, with the posting location shown as Menomonee Falls, Wisconsin.
How many years of experience do I need?
The posting requires at least four years of software development experience.
Which cloud tools are used?
The posting lists GCP services including BigQuery, Bigtable, Dataproc, Pub/Sub and Cloud Storage, along with Airflow and Spark.