Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
Smarter.globalPosted 4 days ago

Senior Big Data Engineer (Python)

Who we'd reach at Smarter.globalFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Recruiter

In-house, owns the opening

Posted this job

Put the opening up

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a remote, full-time senior big data engineering role for someone with at least six years of software or data engineering experience who has moved from software engineering into data work. The engineer builds and runs pipelines on Databricks and PySpark, and helps unify the data platform of a company that builds trading technology for regulated brokers. Pine Software Technology, which posts through Smarter.global, is the employer and applications are made through Djinni.

What you’ll do

  • Design, build and maintain scalable batch and streaming data pipelines with PySpark, SQL and Databricks.
  • Implement and manage change data capture pipelines that sync source systems into the data platform.
  • Build and tune ETL and ELT workflows with a focus on data quality, reliability and performance.
  • Design and evolve medallion (bronze, silver, gold) data models within the Databricks lakehouse.
  • Work with analysts, data scientists and product teams to turn data requirements into reliable datasets.
  • Provision and manage infrastructure as code using dab and Terraform.

What they’re looking for

  • Six or more years of software or data engineering experience, with a software engineering base.
  • Strong Python and SQL skills.
  • A track record of building and scaling ETL or ELT pipelines with PySpark and Databricks.
  • Hands-on work with change data capture and streaming pipelines.
  • Working knowledge of the Databricks lakehouse, medallion architecture and dimensional modeling (star schema, Kimball).
  • Practical Terraform experience.
  • High autonomy, owning work from idea through delivery, with a product mindset.
  • English at upper-intermediate level or higher.

Nice to have

  • Financial domain knowledge in capital markets, brokerage or trading operations.
  • Hands-on experience with Apache Beam or Apache Flink.

What’s on offer

  • Medical insurance from day one, including dental, massage and psychological support.
  • 25 days of paid vacation and 30 days of paid sick leave.
  • Partial reimbursement for sports and fitness.
  • Coverage for English or Ukrainian language courses and a professional development budget.
  • Access to an office library and an online library.
  • Up to 14 days per year at the company villa in Cyprus.
  • Office options in Unit City (Ukraine) or Larnaca, Cyprus.

Skills

Questions about this role

Is this role remote?

Yes, the role is listed as remote and full-time.

How many years of experience do I need?

At least six years of overall software or data engineering experience is required.

What tools does this role use?

The role uses Python, SQL, PySpark, Databricks, change data capture pipelines and Terraform.