Position Description:
The Data Engineer Senior acts as a specialist in the design, development, integration and optimisation of data solutions. They contribute to the implementation of pipelines, integration flows, data models and consumption layers, enabling clients to utilise reliable, integrated and high-quality data.
They work in modern analytics environments, primarily Azure, and collaborate with technical teams, business analysts, architects, BI teams and business stakeholders to deliver solutions tailored to clients’ operational and analytical needs.
Your future duties and responsibilities:
1. Design, develop and optimise robust, scalable and maintainable data pipelines.
2. Develop and maintain ETL/ELT flows for the integration, transformation and consolidation of data from multiple sources.
3. Contribute to the design of data models, consumption layers and analytical structures tailored to business needs.
4. Work with cloud and data environments, including Azure Data Factory, Data Lake, Synapse, Databricks or comparable technologies.
5. Develop or support data products, reports, dashboards or value-added analytical solutions.
6. Ensure the quality, validation, traceability, performance and documentation of data processing.
7. Collaborate with business analysts, architects, developers, BI teams and business partners.
8. Participate in the integration of solutions with various data platforms, APIs, source systems and consumption tools.
9. Contribute to the testing, validation, deployment and support of delivered solutions.
10. Take part in Agile ceremonies, work estimation and continuous improvement.
11. Interact directly with clients to understand their needs, explain technical issues in layman’s terms and contribute to discussions on solutions.
Required qualifications to be successful in this role:
Technical skills required
1. Excellent command of SQL and Python.
2. Significant experience in the design, development and optimisation of data pipelines.
3. Experience with ETL/ELT concepts, data integration, transformation and orchestration.
4. Experience with Azure environments, ideally Azure Data Factory, Data Lake, Synapse or comparable technologies.
5. Experience with Databricks is highly desirable.
6. Good understanding of data modelling, consumption models and analytical environments.
7. Knowledge of the principles of data quality, validation, governance, traceability and security.
8. Experience with BI or data visualisation tools.
9. Experience in an Agile environment.
Technical Assets
1. Knowledge of AWS, Microsoft Fabric, Power BI or Snowflake.
2. Experience with ETL tools such as Informatica, Talend, SSIS or e