We are seeking an experienced Cloud Data Engineer proficient with SQL, Azure cloud stack and Databricks. The ideal candidate will have hands-on experience in designing and implementing data pipelines, data warehousing solutions, and ETL workflows.
Tasks:
-
Designing and implementing data processing systems on Azure platform. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data.
-
Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms.
-
Integrating and transforming data to ensure its compatibility with the target data model or format.
-
Hands-on experience in designing and optimizing of data storage (data lakes, data warehouses, distributed file systems).
-
Familiarity with partitioning, compression, optimization of data storage and retrieval.
-
Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency.
-
Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders to understand their requirements and provide technical solutions.
-
Independence and responsibility in delivering solutions.
-
Ability to work under agile methodologies.
Requirements:
-
Proven experience in Azure cloud-based infrastructure, Databricks implementation.
-
6+ years of experience in Data Engineering.
-
Hands on experience with of T-SQL (min. 5 years).
-
Proven experience in Python, PySpark.
-
Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders.
-
Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps).
-
English at least at B2 level, ideally C1.
-
Experience or familiarity with other cloud technologies, data warehouses, data governance, and business analysis is a plus.
We offer:
-
Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
-
“Office as an option” model. You can choose to work remotely or in the office, depending on your location.
-
Flexibility regarding working hours and your preferred form of contract.
-
Comprehensive online onboarding program with a “Buddy” from day 1.
-
Cooperation with top-tier engineers and experts.
-
Unlimited access to the Udemy learning platform from day 1.
-
Certificate training programs. Lingarians earn 500+ technology certificates yearly.
-
Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
-
Internal Gallup Certified Strengths Coach to support your growth.
-
Grow as we grow as a company. 76% of our managers are internal promotions.
-
A diverse, inclusive, and values-driven community.
-
Autonomy to choose the way you work. We trust your ideas.
-
Create our community together. Refer your friends to receive bonuses.
-
Activities to support your well-being and health.
-
Plenty of opportunities to donate to charities and support the environment.
-
Modern office equipment. Purchased for you or available to borrow, depending on your location.