Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
CogninePosted 10 days ago

Big Data Engineer

Who we'd reach at CognineFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Founder

Decides on early hires

Head of talent

Runs hiring at the company

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a full-time Big Data Engineer role for mid-level engineers with 5 to 10 years of experience, based in Hyderabad, India. The job centers on building PySpark data pipelines, including streaming data and cloud platform work. Experience with Palantir Foundry is preferred but not required.

What you’ll do

  • Design, build and maintain ETL and data pipelines in Python and PySpark.
  • Work with real-time and streaming data systems.
  • Build and tune data processing on cloud platforms.
  • Work with cross-functional teams to turn business requirements into data solutions.
  • Build and maintain CI/CD pipelines.
  • Keep data quality, performance and scalability in good shape.

What they’re looking for

  • 5 to 10 years of data engineering experience.
  • Strong Python and PySpark skills.
  • Experience with Kafka, Flink and Kubernetes.
  • Hands-on work with Big Data tools such as Hadoop, Spark and MongoDB.
  • Experience with Azure, AWS or GCP.
  • A good grasp of data architecture and pipeline design.

Nice to have

  • Experience with Palantir Foundry.
  • Knowledge of Java.
  • Experience in consulting or the utilities sector.

Skills

Questions about this role

How many years of experience does this role need?

The posting asks for 5 to 10 years of experience in data engineering.

Is Palantir Foundry required?

No. The posting describes it as highly preferred, not required.

Where is this job based?

The role is in Hyderabad, Telangana, India.