Descrizione dell'offerta
Job Overview
Data Engineer role within MSC Mediterranean Shipping Company’s EDMA Data Hub team responsible for building an interconnected data platform that serves business users across domains. The position focuses on designing and maintaining large-scale data pipelines, optimizing performance and ensuring data quality.
Responsibilities
- Build data ingestion and transformation pipelines, ensuring they are performant and optimized.
- Orchestrate pipelines and processes: scheduling, triggering, fault-tolerance, retry logic, monitoring, and alerting.
- Embed data quality guarantees in the pipelines to meet service level agreements.
Qualifications
- Minimum 5 years experience as a data engineer.
- Proficiency with Databricks, including implementation of medallion architecture.
- Strong knowledge of SQL, Python, Azure Data Factory, Spark, Data Lake, Data Warehouse, and Data Lakehouse.
- Experience using GIT for version control.
- Willingness to be on call outside office hours a few times a year for support.
Nice to Have
- Experience ingesting data from a distributed event-streaming platform such as Kafka.
- Knowledge of Microsoft Fabric.
Benefits
- Learning opportunities.
- Comprehensive welfare system.
- Life and health insurance.
- Modern workstation.
- Discounts within the MSC group.
Our company provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics.
#J-18808-Ljbffr