Runs the team day to day
In-house, owns the opening
Joined the team recently
From your own Gmail and LinkedIn.
How this role compares
One of 9 open Senior Data Engineer roles in US we are tracking today.
Posted 20 days ago, with 8 of the others posted since.
Counted across the roles Frontrunner has open right now.
About the role
This is a senior data engineering role that is fully remote within the United States, with the listing tied to Illinois. The engineer designs and runs data pipelines and products on Microsoft Fabric that support digital products and analytics. The work is owned end to end, from design through production support, data quality and performance. The employer is Allstate, which describes its work as protecting families and their belongings.
What you’ll do
- Design, build and extend scalable pipelines and data processing systems.
- Create reusable ingestion, transformation and storage patterns.
- Bring together data from APIs, databases, event streams and third-party systems.
- Model data so business operations share one consistent view.
- Use version control, testing, CI/CD and automated deployments.
- Monitor data quality and reliability, and improve cost and performance.
- Document data flows, lineage and technical components.
- Work with product managers, engineers and analysts in an agile team.
- Set governance and metadata standards and mentor less experienced engineers.
What they’re looking for
- Strong Python and PySpark for pipeline development.
- Experience with Apache Spark, Kafka, Flink or dbt.
- Strong SQL and NoSQL knowledge, with data modelling and architecture skills.
- Experience building batch or streaming data solutions.
- Hands-on work with Microsoft Fabric notebooks.
- Experience with Docker and Kubernetes.
- Monitoring and observability work, with Datadog preferred.
- Strong communication and troubleshooting skills.
Nice to have
- Cloud data services on Azure or AWS.
- Fabric components such as Lakehouse, Warehouse, Data Pipelines, Dataflows Gen2 and Semantic Models.
- CI/CD with Jenkins, GitHub Actions or Azure DevOps.
- Performance tuning for pipelines, databases and queries.
- Use of generative and agentic AI tools for engineering productivity.
What’s on offer
- Salary of 80,000 to 136,625 USD a year, based on experience and qualifications.
- Full-time, fully remote.
- Company-provided laptop, monitors, headset, keyboard and mouse.
- Monthly connectivity reimbursement for eligible remote staff.
- Internet of at least 50 MB download and 5 MB upload, plus a private workspace.
- Visa sponsorship is generally not offered for this role.
- A background investigation is required.
Skills
Questions about this role
Is this data engineer role remote?
Yes, it is fully remote, with the listing placed in Illinois.
What is the pay range?
80,000 to 136,625 USD a year, depending on experience and qualifications.
Does Allstate sponsor visas for this role?
Generally not, according to the listing.