Data Engineer
Prefer a full account with a password? Sign Up to Apply
Job Description
We are looking for a Data Engineer Analyst with at least 2 years of experience in Data Engineering or Big Data environments to join a data-driven project focused on the development and evolution of a DataLake and Limits solution.
The ideal candidate combines strong hands-on experience with Python, SQL, ETL development and data pipelines with the analytical ability to understand complex data models, transformations, dependencies, and data quality requirements.
Key Responsibilities
• Analyze and understand existing data models, data flows and transformation processes.
• Understand existing datasets, mappings and dependencies within the DataLake.
• Develop, maintain and optimize Python processes, ETLs and data pipelines.
• Build and maintain Control-M jobs and batch processing workflows.
• Implement data ingestion, transformation and processing logic.
• Develop and adapt data models and datasets required for the Limits solution.
• Perform SQL-based data analysis, validation and reconciliation across multiple data sources.
• Implement data quality controls and investigate and resolve data inconsistencies.
• Support testing, certification, deployment and production releases.
• Create and maintain technical documentation covering data models, processes, mappings and transformations.
• Collaborate with technical and functional teams to ensure data solutions meet business and technical requirements
Requirements
Department: Engineering & Development IT
Function: Consulting
Experience Level: Mid-Senior Level