Data Integration Engineer

Growth through diversity, equity, and inclusion. As an ethical business, we do what is right — including ensuring equal opportunities and fostering a safe, respectful workplace for each of us. We believe diversity fuels both personal and business growth. We're committed to building an inclusive community where all our people thrive regardless of their backgrounds, identities, or other personal characteristics.

We are looking for Cloud Data Engineer with experience in Azure and Databricks. The ideal candidate will have hands-on experience in designing, implementing data pipelines, data warehousing solutions and ETL workflow for a one of biggest company from FMCG sector. The focus is on inventory data.

Tasks:

Designing and implementing data processing systems using Azure. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data.
Building data pipelines to ingest data from various sources such as Unity Catalog, Storage Accounts, Sharepoint. Integrating and transforming data to ensure its compatibility with the target data model or format.
Designing and implementing data models that support efficient data storage, retrieval, and analysis. Collaborating with data scientists and analysts to understand their requirements and provide them with well-structured and optimized data for analysis and modeling purposes.
Utilizing frameworks like Spark to perform distributed computing tasks, such as parallel processing, distributed data processing, or machine learning algorithms.
Identifying and resolving issues related to data processing, storage, or infrastructure. Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations. 
Collaborating with cross-functional teams including analysts, and business stakeholders to understand their requirements and provide technical solutions. Communicating complex technical concepts to non-technical stakeholders in a clear and concise manner.
Independence and responsibility for delivering a solution.
Ability to work under Agile and Scrum development methodologies.
Staying updated with emerging technologies, tools, and techniques in the field of big data engineering. Exploring and recommending new technologies to enhance data processing, storage, and analysis capabilities.

What We're Looking For:

Strong experience in Databricks and Unity Catalog concept.
Proven experience with SQL, PySpark, Python.
Experience with Azure cloud-based infrastructure like Azure SQL Databases, Azure Data Factory, App Functions.
Very good level of communication, the ability to clearly and specifically convey information, experience in working with business users.
Experience working in the Agile (Scrum) methodology, Jira is a plus.
English at least at B2 level, ideally C1.
Good knowledge of data storage architectures, including delta lakes, data warehouses, or distributed file systems.
Knowledge of data orchestration tool will be beneficial.
Experience in designing and creating integration and unit test will be beneficial.
Strong problem-solving abilities to identify and resolve issues related to data processing, storage, or infrastructure. Analytical mindset to analyze and interpret complex datasets for meaningful insights.
Proficient in data modeling techniques and database optimization. Knowledge of query optimization, indexing, and performance tuning is necessary for efficient data retrieval and processing.
Strong understanding of distributed computing principles, including parallel processing, data partitioning, and fault-tolerance.

What Will Set You Apart:

Working with SAP BW data will be beneficial.

Missing one or two of these qualifications? We still want to hear from you! If you bring a positive mindset, we'll provide an environment where you feel valued and empowered to learn and grow.

We offer: