Who we'd reach at Compunnel Inc.Found and reached by Power Apply
Best leadTeam lead
Runs the team day to day
Recruiter
In-house, owns the opening
Recent hire
Joined the team recently
From your own Gmail and LinkedIn.
About the role
This is a senior data engineering role in Mississauga, Ontario, for an engineer who builds Python and PySpark pipelines and deploys containerised workloads. The engineer builds and tests ETL and ELT workflows, manages Snowflake and data lake storage and deploys applications on OpenShift. Compunnel Inc. posted the role, which supports enterprise data initiatives.
What you’ll do
- Build, test and maintain scalable data pipelines and ETL and ELT workflows using Python, PySpark and SQL.
- Manage and optimise data storage in Snowflake and data lakes.
- Integrate data from several sources while protecting quality, integrity and security.
- Automate workflows with Azure Data Factory or similar orchestration tools.
- Deploy and manage containerised applications on OpenShift.
- Monitor pipelines and resolve performance bottlenecks.
- Document data architecture and workflows and ensure governance compliance.
What they’re looking for
- A bachelor's or master's degree in computer science, data engineering or a related field.
- 10 or more years of experience in data engineering or similar roles.
- Strong Python and PySpark skills.
- Expertise in SQL and Snowflake.
- Hands-on experience with orchestration tools such as Azure Data Factory.
- Knowledge of data lake architecture.
- Experience deploying containers on OpenShift or Kubernetes.
- Familiarity with Azure, AWS or GCP.
- Understanding of data security and governance practices.
- Strong problem-solving skills and clear communication.
Nice to have
- Experience with Kafka or Hadoop.
- Knowledge of CI/CD pipelines and DevOps practices.
- Familiarity with additional cloud data services.
Skills
Questions about this role
How many years of experience do I need?
Ten or more years in data engineering or similar roles is listed.
Do I need a degree?
A bachelor's or master's degree in a related field is listed.
Which tools are required?
Python, PySpark, SQL, Snowflake and OpenShift experience are listed as required.