Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
Compunnel Inc.Posted today

Data Engineer Python/PySpark/OpenShift

Who we'd reach at Compunnel Inc.Found and reached by Power Apply
Best leadTeam lead

Runs the team day to day

Recruiter

In-house, owns the opening

Recent hire

Joined the team recently

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a senior data engineering role in Mississauga, Ontario, for an engineer who builds Python and PySpark pipelines and deploys containerised workloads. The engineer builds and tests ETL and ELT workflows, manages Snowflake and data lake storage and deploys applications on OpenShift. Compunnel Inc. posted the role, which supports enterprise data initiatives.

What you’ll do

  • Build, test and maintain scalable data pipelines and ETL and ELT workflows using Python, PySpark and SQL.
  • Manage and optimise data storage in Snowflake and data lakes.
  • Integrate data from several sources while protecting quality, integrity and security.
  • Automate workflows with Azure Data Factory or similar orchestration tools.
  • Deploy and manage containerised applications on OpenShift.
  • Monitor pipelines and resolve performance bottlenecks.
  • Document data architecture and workflows and ensure governance compliance.

What they’re looking for

  • A bachelor's or master's degree in computer science, data engineering or a related field.
  • 10 or more years of experience in data engineering or similar roles.
  • Strong Python and PySpark skills.
  • Expertise in SQL and Snowflake.
  • Hands-on experience with orchestration tools such as Azure Data Factory.
  • Knowledge of data lake architecture.
  • Experience deploying containers on OpenShift or Kubernetes.
  • Familiarity with Azure, AWS or GCP.
  • Understanding of data security and governance practices.
  • Strong problem-solving skills and clear communication.

Nice to have

  • Experience with Kafka or Hadoop.
  • Knowledge of CI/CD pipelines and DevOps practices.
  • Familiarity with additional cloud data services.

Skills

Questions about this role

How many years of experience do I need?

Ten or more years in data engineering or similar roles is listed.

Do I need a degree?

A bachelor's or master's degree in a related field is listed.

Which tools are required?

Python, PySpark, SQL, Snowflake and OpenShift experience are listed as required.