Leads the team this role joins
Runs the team day to day
Decides on early hires
From your own Gmail and LinkedIn.
How this role compares
One of 25 open Data Engineer roles in IN we are tracking today.
Counted across the roles Frontrunner has open right now.
About the role
This is a mid-level, remote Data Engineer role in India for engineers with at least three years of data engineering experience. Particle41 builds data solutions for its clients, and the work spans ETL pipelines, data storage and joining data from many sources. The role also includes requirements gathering, Agile delivery, testing and documentation alongside the engineering.
What you’ll do
- Design, build and maintain ETL pipelines for large volumes of data from varied sources
- Build and tune data lakes and warehouses for efficient retrieval and processing
- Combine structured and unstructured data into one unified view
- Validate, cleanse and transform data to keep it accurate and complete
- Document data processes, tools and systems
- Gather requirements with product managers and other stakeholders
- Take part in sprint planning, stand-ups and sprint reviews
- Write unit and integration tests, and resolve defects and bottlenecks
What they’re looking for
- A bachelor's degree in computer science, engineering or a related field
- At least three years as a data engineer
- Strong Python
- SQL databases such as MySQL or PostgreSQL, and NoSQL databases such as MongoDB
- Familiarity with Spark, PySpark, pandas, Databricks, Flask and lakehouse concepts
- Working knowledge of at least one cloud data stack on Azure, AWS or GCP
- Git and Linux, with shell scripting
- Understanding of software engineering principles and design patterns
- Strong problem-solving, analytical and communication skills
Nice to have
- Experience with Redis, the ELK stack or distributed task queues
- Familiarity with machine learning libraries such as scikit-learn or OpenCV
- Experience with pytest and parallel processing concepts
What’s on offer
- Remote working from India
Skills
Questions about this role
Is this role remote?
Yes, the role is listed as India, remote.
How many years of experience do I need?
At least three years as a data engineer.
Is a degree required?
A bachelor's degree in computer science, engineering or a related field is listed.
Which cloud platforms are needed?
Familiarity with at least one of Azure, AWS or GCP.