Andersen, an international IT company, invites a Data Engineer (Azure) to work on a project for one of our German partners.
The project is the development of an online platform providing insurance services globally.
The customer is the largest insurer in Germany and one of the largest insurers in the world, which is included in the list of global systematically important companies. The business is also listed in the Fortune Global 500.
Responsibilities:
- Developing, testing, and maintaining daily pipeline ETL processes for collecting data in the cloud;
- Developing and ensuring ETL processes for data processing;
- Creating tools for operating and monitoring the data platform;
- Creating data models and building a data showcase for Data Analysts and ML Engineers;
- Creating services to handle real-time data via Kafka for subsequent analysis using Azure tools;
- Collaborating with all stakeholders to achieve a deep and clear understanding of requirements.
Must-haves:
- Experience as a Data Engineer for 3+ years;
- Understanding of data processing algorithms and principles;
- Experience with Azure cloud storage solutions;
- Experience with Python, Apache Airflow, and PySpark;
- Experience with Kafka;
- Knowledge of PL SQL or SQL;
- Experience with Azure Databricks and Azure Event Hub;
- Experience in building ETL processes;
- Experience with modern Agile software development and testing methodologies using modern ALM tools, such as GitHub/Azure DevOps;
- Level of English – from Intermediate.
Nice-to-haves:
- Experience with Apache Hive, Apache Impala, Amazon Redshift, Snowflake, PostgreSQL, Greenplum, and Vertica;
- Experience in creating cloud applications based on container platforms, such as Microsoft Azure Kubernetes Services or Lambda Azure Functions;
- Experience in building MLOps and data-driven applications.
Reasons why this job would be interesting to you:
-
Andersen cooperates with such businesses as Samsung, Johnson & Johnson, Ryanair, Europcar, TUI, Verivox, Media Markt, Shypple, etc. This project is just your beginning here – working with us means reliability and prospects;
-
We have been strengthening our expertise since 2007. During this time, we have formed excellent teams with streamlined processes, where you can learn something new from your colleagues every day and enjoy your work;
-
We welcome specialists from every part of the world;
-
Salaries at Andersen are pegged to the US dollar, and our employees are provided with a benefit package and an extensive set of bonuses;
-
There are many different ways to grow and develop at our company. You can improve as a specialist or a manager, and all your activities will be decently rewarded;
-
Our employees have access to Andersen Knowledge Base, where they can take courses on the art of negotiation, project management, Machine Learning and Data Analysis, DevOps practices, programming languages, cloud services, and more.
We invite you to join our team!
https://people.andersenlab.com/
Contacts:[email protected]
We only consider candidates with a CV. To make sure we receive your CV, use the "send CV" function on your right
https://people.andersenlab.com/
