Who we'd reach at latinum hr solutionsFound and reached by Power Apply
Best leadEngineering lead
Leads the team you would join
CTO
Signs off on engineering hires
Technical recruiter
Owns the opening
From your own Gmail and LinkedIn.
About the role
This is a full-time data engineering role for someone with 5+ years of experience, based in Bangalore or Chennai, India. The work centers on building and running the data pipelines, storage and platforms that feed analytics, reporting and generative AI and LLM projects. Latinum is recruiting on behalf of a client, so the hiring company is not named in the listing.
What you’ll do
- Design, build and maintain scalable ETL and ELT pipelines and data workflows.
- Ingest data from both structured and unstructured sources.
- Model data and shape data warehouses and data lakes, then tune complex SQL for speed.
- Apply cleansing, validation, transformation and quality checks to datasets.
- Build batch and real-time processing pipelines on large distributed datasets with Apache Spark and PySpark.
- Connect data solutions to AWS, Azure or GCP.
- Support the data needs of generative AI and LLM-based products.
- Work alongside data scientists, analysts and application teams.
- Follow good engineering practice with Git, CI/CD, testing, monitoring and documentation.
What they’re looking for
- 5+ years of hands-on data engineering experience.
- Strong Python skills.
- Hands-on work with PySpark and Apache Spark.
- Advanced SQL, including query optimization and performance tuning.
- Experience with AWS, Azure or GCP.
- A track record of building scalable ETL and ELT pipelines.
- Hands-on experience with generative AI and large language models.
- Solid grasp of data warehousing and dimensional modeling.
- Experience with large-scale distributed data.
- Familiarity with Git and CI/CD, and with Agile or Scrum.
- A bachelor's degree in computer science, IT, engineering or a related technical field.
Nice to have
- Experience with Apache Airflow or similar orchestration tools.
- Knowledge of Kafka and real-time streaming.
- Exposure to Databricks and open table formats such as Delta Lake, Apache Iceberg or Apache Hudi.
- Familiarity with Docker, Kubernetes and Terraform or other infrastructure as code.
- Understanding of data governance and metadata management.
What’s on offer
- Full-time position based in Bangalore or Chennai.
Skills
Questions about this role
How many years of experience does this role need?
The posting asks for at least 5 years of hands-on data engineering experience.
Where is this job based?
The listing gives Bangalore or Chennai, India.
Who is the employer?
Latinum HR Solutions is hiring for a client, and the client is not named in the posting.