Senior Data Engineer with ML

Our client is a global technology and consulting organization delivering innovative digital solutions for major sports organizations. They are currently looking for a Senior Data Engineer to support the development of a next-generation mobile application designed to enhance fan engagement and deliver advanced digital experiences for millions of users.

Skills and Requirements:

Strong experience with Python, Spark (PySpark), and SQL for data engineering and analytics. Experience building batch and streaming data pipelines using AWS Glue and Spark. Deep knowledge of AWS data services including S3, Athena, Kinesis, and DynamoDB. Hands-on expertise with Apache Iceberg, including schema evolution, partitioning, and performance optimization. Experience designing streaming architectures, ideally using Kinesis. Proven ability to design reliable and cost-efficient data pipelines and optimize performance. Strong experience working with large datasets and data analysis. Understanding of data warehousing concepts and data architecture. Strong problem-solving skills and ability to understand broader technical context. Excellent communication and collaboration skills in cross-functional teams.

Role and Responsibilities:

Design and implement scalable data pipelines supporting real-time and batch processing. Develop data infrastructure capable of supporting millions of concurrent application users. Integrate multiple data sources across the technology stack and ensure reliable data flow. Build and maintain AWS-based data architecture supporting analytics and machine learning. Implement streaming solutions to support real-time insights and personalization features. Collaborate with engineering and product teams to support cross-platform mobile experiences. Ensure compliance with security and regulatory requirements including GDPR and related standards. Optimize data models and pipelines for performance, scalability, and cost efficiency.

For more information – please apply for this job or send your CV directly and I will call you back to provide you with more details.

Cavendish (Recruitment) Professionals Ltd are proud to be an equal opportunity employer and we believe that inclusivity begins with the candidate experience. All qualified applicants will receive consideration for employment regardless of gender, race, age, sexual orientation, religion, or belief.