Senior Data Engineer
We are recruiting for a Senior Data Engineer (Team Lead) for an exciting project with one of the world’s largest professional-services firms.
Technologies you will work with:
Our clients’ infrastructure runs on MS Azure cloud and they use Terraform as IaC.
They test with Terratest (Go)
They use Azure Data Factory for pipelines and orchestration and Databricks for processing and transforming data
You will build the core functional data components as part of the product and automate the way they are tested and deployed
Understand the needs of your various customers from different units and translate them to modular solutions which are usable by the vast majority
Brainstorm and design solutions to optimize the data platform solution architecture
Share knowledge in the data engineering community, pair program and collaborate on code together with other data engineers
Enable business teams to run successful data and AI projects
Proven work experience as a team leader or supervisor
You have 5+ years of relevant software, data and/or platform engineering experience, building platforms which are modular, testable, scalable and easily consumable
Have 3+ years hands-on experience on one or more cloud services (Azure/GCP/AWS) like: ADF, Data-lake, Delta-lake, Databricks, Key Vaults, BigQuery, Cloud Dataflow, Dataproc, Datapipeline, Kinesis, etc.
Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, branching, containerization, etc.
Demonstrated programming and debugging experience with Python/PySpark, SQL, Go
Preferably experience with open source projects run with a “build once, deploy often” mindset & Experience or interest in Domain Driven Design
Good communication skills, fluent English
Remote vs Onsite: Combined – partly onsite in Prague office
If interested, please get in touch via contact details provided or click “Apply” to forward an up to date copy of your CV.
Cavendish (Recruitment) Professionals Ltd are proud to be an equal opportunity employer and we believe that inclusivity begins with the candidate experience.
All qualified applicants will receive consideration for employment regardless of, gender, race, age, sexual orientation, religion, or belief.