Tasks
-
Implementing data ingestion pipelines from multiple sources using Azure Data Factory, Azure Databricks or other ETL Tools
-
Developing scalable and re-usable, self-service frameworks for data ingestion and processing
-
Integrating the end to end data pipleline to take data from source systems to target data repositories ensuring the quality and consistency of data
-
Working within an Agile delivery and DevOps methodologies to deliver proof of concept and production implementation in iterative sprints
-
Creating quality products in accordance with current state of knowledge and guidelines received from superior
-
Processing performance analysis and optimization
-
Working directly with Customer
-
Working with event based technologies to ingest and process data
-
Bringing best practices in following areas:
-
Analysis
-
Cost-wise scalability
-
Automation (Pipelining, IaC etc)
-
Testing
-
Monitoring
-
Documentation
-
Requirements
-
At least 4 years of experience as a Data Engineer, including min. 2 years of experience in developing Azure
-
Experience in building ETL / data warehouse transformation processes
-
Extensive SQL knowledge
-
Direct experience of building data piplines using (at least 2 of the following):
-
Azure Data Factory
-
Apache Spark (preferably Databricks)
-
Azure Synapse
-
Azure Analysis Services
-
-
Hands on experience designing and delivering solutions using Azure Data Lake
-
Ability to work with structured and unstructured data
-
Knowledge of DevOps environment with technologies as Azure DevOps, Terraform
-
Strong knowledge of data management principles
-
Experience in cloud-based solutions
-
Strong communication skillset
Nice to have:
-
Experience in working with Azure Power Apps / Power Automate / Talend / Snowflake
Offer
-
Stable employment. On the market since 2008, 1200+ talents currently on board in 7 global sites.
-
“Office as an option” model. You can choose to work remotely or in the office.
-
Flexibility regarding working hours and your preferred form of contract.
-
Comprehensive online onboarding program with a “Buddy” from day 1.
-
Cooperation with top-tier engineers and experts.
-
Certificate training programs. Lingarians earn 500+ technology certificates yearly.
-
Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
-
Grow as we grow as a company. 76% of our managers are internal promotions.
-
A diverse, inclusive, and values-driven community.
-
Autonomy to choose the way you work. We trust your ideas.
-
Create our community together. Refer your friends to receive bonuses.
-
Activities to support your well-being and health.
-
Plenty of opportunities to donate to charities and support the environment.
-
Modern office equipment. Purchased for you or available to borrow, depending on your location.