Leads the team this role joins
In-house, owns the opening
Put the opening up
From your own Gmail and LinkedIn.
About the role
This is a full-time remote role for a data engineer and data scientist with 5 to 8 years of experience, working with Python, PySpark and Azure Databricks. It suits a mid-level individual contributor who can build batch and streaming pipelines and also support machine learning work and model deployment. The listing marks this as an immediate requirement. The hiring group sits within a services business that delivers analytics and contact center insight to its clients.
What you’ll do
- Build scalable data processing with Python, PySpark and Azure Databricks.
- Build and maintain batch and streaming pipelines.
- Develop and tune Spark DataFrame transformations.
- Debug Spark jobs in Azure Databricks.
- Implement Delta Lake for reliability, versioning and fast queries.
- Build APIs in Python or Scala for data and machine learning applications.
- Support ML projects, MLOps workflows and model deployment.
- Set up Databricks job clusters and notebook workflows.
- Validate processed data with DataFrame checks.
What they’re looking for
- Bachelor's or Master's degree in computer science, data science, engineering, IT or a related field.
- 5 to 8 years in data engineering, data science, machine learning or cloud analytics.
- Strong hands-on Python and PySpark.
- Good working knowledge of Microsoft Azure and Azure Databricks.
- Hands-on MLOps practice and a basic understanding of model deployment.
- Experience building and debugging Spark applications.
- Ability to work independently and with project teams.
Nice to have
- Databricks notebook development.
- Spark DataFrame work in Scala.
- Azure services such as Event Hubs, Storage Accounts, Key Vault, Service Bus, Functions and Data Lake Storage.
- Kafka and streaming sources such as Event Hubs or IoT data.
- MLflow or similar experiment tracking.
- CI/CD for data and machine learning workloads.
- Spark and Databricks performance tuning.
- Data quality monitoring and production support.
- Secure Azure integration using managed identities and secrets.
What’s on offer
- Full-time, remote role.
Skills
Questions about this role
Is this role remote?
The listing says remote. It also gives a Bangalore office location.
How many years of experience do I need?
5 to 8 years of relevant experience in data engineering, data science, machine learning or cloud analytics.
Which tools does the role use?
Python, PySpark, Azure Databricks, Delta Lake and MLOps tooling are central to the role.