Who we'd reach at Neoware Technology SolutionsFound and reached by Power Apply
Best leadEngineering manager
Leads the team you would join
Technical recruiter
Owns the opening
Team member
On the team, can refer you
From your own Gmail and LinkedIn.
About the role
This is a full-time AWS data engineering role in Bangalore or Chennai for engineers with three to six years of experience building data pipelines on AWS. You will design, implement, optimize and maintain data engineering solutions for customers, covering data warehouse, data lake and lakehouse patterns. Strong hands-on SQL, Python and Spark skills are central to the role, along with Databricks and streaming pipelines.
What you’ll do
- Design, implement and optimize data engineering solution components for customers.
- Build data pipelines with PySpark or Spark Scala.
- Develop and manage large-scale data processing and analytics workloads on Databricks.
- Tune SQL and optimize queries.
- Build streaming pipelines for near real-time analytics.
- Maintain solutions on AWS services and set up CI/CD for data engineering components.
- Apply data governance practices to data platforms and analytical solutions.
What they’re looking for
- Three or more years of hands-on design, development and implementation of data engineering solutions
- Strong SQL development, including performance tuning and query optimization
- Good Python programming skills
- Strong PySpark or Spark Scala pipeline experience
- Hands-on Databricks experience
- Understanding of streaming data pipelines
- Hands-on experience with AWS data services such as Glue, Lambda, Step Functions, Redshift, EMR and Kinesis
- Experience with at least one NoSQL database
- Understanding of modern data architecture and data governance
- Git and CI/CD pipeline experience
- Strong analytical, problem-solving and communication skills
Nice to have
- AWS certifications, ideally in data engineering
- Experience with Amazon AppFlow, EKS, API Gateway or NoSQL database services
- Experience with Tableau or Power BI
Skills
Questions about this role
Where is this job based?
Bangalore or Chennai, listed as a full-time role.
How many years of experience do I need?
Three to six years, with at least three years of hands-on data engineering work stated as a requirement.
Is Databricks experience required?
Yes. Hands-on Databricks experience is listed under requirements.