Data Engineer (3 Year Contract)

About the job

We are looking for a Data Engineer to design, build, and optimise modern cloud-native data platforms that power enterprise-scale analytics and AI initiatives. You will play a key role in developing scalable data architectures, implementing high-performance data pipelines, and enabling data-driven decision-making across the organisation.

Working within a collaborative engineering team, you will contribute to Data Lakehouse architectures, cloud migration initiatives, DataOps practices, and the integration of AI capabilities into enterprise data platforms while mentoring junior engineers and driving engineering best practices.

Key Responsibilities

Cloud Data Platform & Architecture

Design and implement scalable, secure, and highly available cloud-based data platforms.

Architect and develop modern Data Lakehouse solutions.

Work closely with stakeholders to gather business requirements and translate them into scalable technical solutions.

Produce and maintain architecture documentation and technical standards.

Data Engineering & Pipeline Development

Develop and maintain robust ETL/ELT pipelines using modern data engineering frameworks.

Build reliable, production-grade data ingestion and transformation workflows.

Optimise pipeline performance, scalability, reliability, and cloud cost efficiency.

Implement automated data quality validation, monitoring, and alerting.

Cloud Solution Architecture

Design cloud-native Data & AI solutions aligned with business and technical objectives.

Lead cloud migration initiatives and support complex multi-cloud deployments.

Integrate AI capabilities into enterprise data platforms.

Evaluate emerging technologies and recommend modern cloud-native approaches.

Cloud Infrastructure & Operations

Build and manage cloud infrastructure using native cloud services.

Implement Infrastructure as Code (IaC) using Terraform.

Ensure platforms comply with security standards, governance policies, and operational best practices.

Support platform reliability, monitoring, and continuous improvement.

Technical Leadership

Mentor and guide junior data engineers on technical implementation and best practices.

Participate in architecture reviews and contribute to the evolution of the organisation's data strategy.

Collaborate with cross-functional engineering, analytics, and business teams.

Requirements

Essential Skills & Experience

Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or a related discipline.

Minimum 3 years of experience in data engineering, data architecture, or enterprise data platform development.

Strong hands-on experience building production-scale data pipelines and cloud-native data platforms.

Strong proficiency in:

Python

SQL

Apache Spark

Experience with modern data engineering tools such as:

Apache Kafka

Apache Airflow (or similar workflow orchestration tools)

Good understanding of:

Cloud computing principles

Infrastructure as Code (Terraform)

Containerisation

Microservices architecture

Distributed systems

Cloud networking

Identity & Access Management (IAM)

Cloud security best practices

Experience with DataOps, Data Lakehouse, or modern data platform architectures.

Familiarity with AI/ML platform operations including MLOps or LLMOps.

Strong analytical, problem-solving, and communication skills.

Ability to translate business requirements into scalable technical solutions.

Nice to Have

Experience with Amazon Web Services (AWS).

Experience with AWS services such as:

S3

Glue

Lake Formation

SageMaker

Bedrock

Amazon Quick Suite

AWS certifications such as:

AWS Certified Solutions Architect – Professional

AWS Certified Data Engineer – Associate

Experience with machine learning deployment pipelines and MLOps.

Knowledge of metadata management and data governance frameworks.

Familiarity with serverless computing, edge computing, or IoT architectures.

Experience with business intelligence or data visualisation platforms.

Why Join Us?

Work on enterprise-scale cloud and AI data platforms.

Design and build modern Data Lakehouse architectures.

Be part of large-scale cloud transformation initiatives.

Collaborate with experienced engineers on cutting-edge data and AI technologies.

Opportunity to mentor engineers while shaping the future of enterprise data platforms.