Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)
Skills
About the role
This is a Lead Data Engineer role at Capital One's Enterprise Platforms Technology group, on the Marketing and Messaging team. It suits an experienced data engineer skilled in Python, SQL, AWS and GenAI-assisted development who wants to lead within an Agile team. The role is based in McLean, Virginia or Chicago, Illinois.
What you’ll do
- Design, develop, test, implement and support technical data movement solutions with Agile teams
- Lead a team of developers experienced in data movement and distributed computing
- Use Python, SQL and cloud data warehousing services like Snowflake and Databricks
- Optimize information systems for end-user and downstream consumers
- Share technical knowledge and mentor other engineers
- Collaborate with product managers to deliver cloud-based solutions
- Perform unit tests and code reviews for performance and design quality
What they’re looking for
- Bachelor's degree
- At least 4 years of application development experience
- At least 2 years of experience with big data technologies
- At least 1 year of experience with cloud computing (AWS, Azure or Google Cloud)
Nice to have
- 7+ years of application development including Python, SQL, Spark, ETL tools, AWS Glue
- 4+ years with a public cloud platform
- 4+ years with distributed data tools like Hadoop, Hive, EMR, Kafka or Spark
- 4+ years working on real-time data and streaming applications
- 4+ years of NoSQL experience (Mongo, Cassandra)
- 4+ years of data warehousing experience (Redshift or Snowflake)
- 4+ years of UNIX/Linux and shell scripting experience
- 4+ years of data modeling for data warehousing
- 2+ years of Agile engineering practices
- 1+ years using AI-assisted coding tools like Claude Code or GitHub Copilot
What’s on offer
- Chicago, IL: $179,400-$204,700
- McLean, VA: $197,300-$225,100
- Performance-based incentive compensation including cash bonus and/or long-term incentives
- Comprehensive health, financial and other benefits
Questions about this role
How much does it pay?
$197,300-$225,100 in McLean, VA, or $179,400-$204,700 in Chicago, IL.
How many years of experience do I need?
At least 4 years of application development experience, including 2 years with big data technologies and 1 year with cloud computing.
Is visa sponsorship available?
No, Capital One will not sponsor a new applicant for employment authorization for this position.
Related roles
Lead Data Engineer – Databricks & AI | Remote Canada
Lead data engineer role for a financial services client, requiring 10+ years of Databricks expertise and experience collaborating with AI/ML teams to build scalable data infrastructure.
Data Architect / Data Engineering Lead
A principal data architecture and engineering leadership role at UnitedHealth Group's Optum/LHI, based in Minnetonka, Minnesota. Suited to a senior data leader with deep Snowflake/Databricks and Airflow experience who wants to combine architecture ownership with hands-on delivery.
Data Analyst - Data Quality & Databricks
A data analyst role centered on data quality, profiling and reconciliation using Databricks, SQL and PySpark, open across Bangalore, Chennai and Pune for candidates with 7-11 years of experience.
Data Engineer, Data Platform & ML (Remote)
A Poland-remote Data Engineer role building a cloud-based corporate data warehouse for business analytics and machine learning. It suits a data engineer with at least three years of experience in Python, SQL, warehouse design, and modern data tooling.
Data Engineer, Data Platform & Machine Learning (Remote)
A Serbia-remote data engineering role building Tabby's corporate data warehouse, data integrations, and pipelines. It is intended for a data engineer with warehouse design, Python, SQL, and cloud data-stack experience.
Senior Data Engineer, Data Platform & ML (Remote)
A remote senior data engineering role in Yerevan focused on feature-store development, data services, streaming, and production data pipelines. It is suited to an engineer with scalable systems experience across data, machine learning, or backend development.