Data Engineer (with Databricks expertise)
Пълно описание
Over 20 years of market experience, we brings together technologists, creators and innovators in Europe, North and Latin America, and the Middle East. Join our international team and take the mission to solve the advanced tech challenges of tomorrow!
What project we have for you:
This new initiative focuses on establishing a dedicated Operational Data Product Team to address the critical fragmentation and slow utilisation of Supply Chain Management data trapped in complex SaaS systems. The project’s primary goal is to sustainably provide integrated, governed, and timely Supply Chain Management data to the organisation, enabling strategic reporting, direct integration into transactional processes, and unlocking the potential for advanced AI. The resulting Data Product will serve as a robust blueprint for future data solutions across the business.
What you will do:
Participate in the development and maintenance. Troubleshoot and debug Databricks platform to resolve issues. Write clean, efficient, and self-documented code. Implement automation tests to ensure code quality. Collaborate with team members to identify and solve technical problems. Participate in code reviews to ensure code quality and maintainability. Monitor Databricks performance and provide optimization recommendations. Stay up to date with the latest technologies and industry trends.
What you need for this:
Ideal candidate: Experienced Python developer with expertise in both batch and streaming ETL/ELT processes on Databricks and 3+ years of experience as an engineer.
Core technical skills:
Python –advanced SQL – advanced Databricks expertise:
Delta Lake Structured Streaming, Auto Loader, Delta Live Tables Unity Catalog Databricks Workflows Git integration Azure expertise:
Azure Data Lake Storage Gen2, Azure Data Factory, Azure Functions Certifications are nice to have:
Databricks Certified Data Engineer Associate or Databricks Certified Data Engineer Professional
What it’s like to work with us:
We are committed to being an equal opportunity employer, fostering equity, diversity, and inclusion. We welcome and celebrate the differences of all qualified applicants. Join our team for a career where your unique perspectives are not only valued but crucial to our success.
What project we have for you:
This new initiative focuses on establishing a dedicated Operational Data Product Team to address the critical fragmentation and slow utilisation of Supply Chain Management data trapped in complex SaaS systems. The project’s primary goal is to sustainably provide integrated, governed, and timely Supply Chain Management data to the organisation, enabling strategic reporting, direct integration into transactional processes, and unlocking the potential for advanced AI. The resulting Data Product will serve as a robust blueprint for future data solutions across the business.
What you will do:
Participate in the development and maintenance. Troubleshoot and debug Databricks platform to resolve issues. Write clean, efficient, and self-documented code. Implement automation tests to ensure code quality. Collaborate with team members to identify and solve technical problems. Participate in code reviews to ensure code quality and maintainability. Monitor Databricks performance and provide optimization recommendations. Stay up to date with the latest technologies and industry trends.
What you need for this:
Ideal candidate: Experienced Python developer with expertise in both batch and streaming ETL/ELT processes on Databricks and 3+ years of experience as an engineer.
Core technical skills:
Python –advanced SQL – advanced Databricks expertise:
Delta Lake Structured Streaming, Auto Loader, Delta Live Tables Unity Catalog Databricks Workflows Git integration Azure expertise:
Azure Data Lake Storage Gen2, Azure Data Factory, Azure Functions Certifications are nice to have:
Databricks Certified Data Engineer Associate or Databricks Certified Data Engineer Professional
What it’s like to work with us:
We are committed to being an equal opportunity employer, fostering equity, diversity, and inclusion. We welcome and celebrate the differences of all qualified applicants. Join our team for a career where your unique perspectives are not only valued but crucial to our success.