Principal Data Engineer
£70,000 - £87,000 + 15% Bonus
Belfast based - Hybrid working
Must be willing and eligible to go through SC Clearance
A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful change is seeking to add a Principal Data Engineer to the team based in Belfast.
Requirements of a Principal Data Engineer;
- Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks.
- Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing.
- Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and SQL.
You should also have some, if not all, of the following;
- Capability in scripting, data extraction via APIs, and the composition of SQL queries.
- Practical experience in integrating data engineering components into production systems, along with expertise in data cleaning, data wrangling, data visualisation, and reporting.
- Proficiency in handling substantial volumes of structured and unstructured data, including the integration of data through AWS and Azure cloud-based ingestion and curation processes.
- Knowledge of data mining, machine learning, and natural language processing is considered an advantage.
- Familiarity with Agile methodologies and participation in Scrum ceremonies.
- Competence in the design and construction of solutions tailored for the AWS and Azure cloud environments, which may involve expertise in Platform-as-a-Service components, serverless architecture, and container technologies.
- Experience working on the strategy to build out a capability
- Experience training of junior members of the team
- Strong leadership experience
Principal Data Engineer
- £70,000 - £87,000
- 15% Bonus + £5,900 car allowance (can be taken as cash on top of base salary)
