Contact us

Data Engineering Lead (Databricks / Python / PySpark)

Recruiter

img

Halyna Zhuk

Data Engineering Lead (Databricks / Python / PySpark)

As a part of devspiration, you will join as a Data Engineering Lead, taking ownership of the architecture, scalability, and evolution of enterprise data platforms.
The role combines technical leadership with hands-on contribution, guiding the team in building reliable, efficient, and scalable data solutions.

PROJECT TECH STACK:

Databricks, Python, PySpark, Delta Lake, Azure Cloud, Git, Docker, Kubernetes, CI/CD

RESPONSIBILITIES:

  • Lead architecture and development of scalable ETL/ELT data pipelines using Databricks

  • Provide technical leadership, mentorship, and guidance to the Data Engineering team

  • Define and enforce best practices in data modeling, pipeline performance optimization, and automation

  • Collaborate with cross-functional teams to improve data accessibility, governance, and scalability

  • Drive implementation of CI/CD processes, deployment automation, and monitoring strategies

  • Participate in technical design discussions and support strategic data platform decisions

  • Contribute hands-on to development and optimization of distributed data processing solutions

REQUIREMENTS:

  • 6+ years of experience in Data Engineering, including strong experience with Databricks

  • Expertise in Python, PySpark, and distributed data processing

  • Proven experience leading engineering teams or acting as a technical lead

  • Strong experience designing scalable and reliable data architectures

  • Hands-on experience with CI/CD pipelines, Git, Docker, Kubernetes

  • Experience with Delta Lake and Databricks ecosystem tools

  • Strong understanding of data governance, performance tuning, and optimization techniques

  • Experience working with Azure data engineering services

  • English: Upper-Intermediate or higher

WE OFFER: 

  • A brand-new office in a BC “Natsionalnyy” + remote working options 
  • 18 business days of vacation, 10 days of sick leave, national holidays off 
  • Compensation for technical conferences/events participation 
  • Free English classes 
  • Medical insurance 

 

Become part of a professional and patriotic team that supports the Armed Forces of Ukraine and those in need. Join us in making a meaningful impact.  💙