Job Title: Junior Data Engineer
Company: Krystal Clarity
Location: London/Remote
Job Type: Full-Time
About Us:
Krystal Clarity is a rapidly emerging data engineering consultancy that helps businesses leverage data to achieve their strategic objectives. As a lean, fast-paced, and dynamic company, we are looking for a Junior Data Engineer who is passionate about data and eager to learn and grow in an entrepreneurial environment.
Position Overview:
We are seeking a dedicated and motivated Junior Data Engineer with some experience or qualifications in Azure or Databricks. The successful candidate will have the opportunity to work on diverse and exciting data-centric projects, collaborating closely with senior engineers and making meaningful contributions. This role provides an excellent platform to further develop your skills and gain valuable experience in a vibrant entrepreneurial environment.
Responsibilities:
- Assist in the design, building, and management of Azure-based data pipelines, including Databricks integration, to cater to the analysis and reporting needs of our clients.
- Contribute to the development, testing, and optimisation of Databricks data pipelines, workflows, dashboards and reports.
- Work closely with the senior engineering team to understand project requirements and play a hands-on role in their realisation.
- Utilise Azure data services (including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and others) to extract, transform, and load (ETL) data from various sources.
- Assist in data governance and quality control tasks, ensuring the integrity and security of client data within the Azure platform.
- Monitor, evaluate, and optimise performance within Azure cloud services, including Databricks workflows.
- Identify and implement ways to enhance system performance and efficiency within the Azure and Databricks ecosystem, including optimisations.
- Gain experience with Databricks, including Unity Catalog, Medallion architecture, and building data platform products as part of a small team of developers.
Requirements:
- Bachelor's Degree in Computer Science, Data Science, or a related field.
- Some work experience in data engineering or relevant internships/projects.
- Azure or Databricks certifications are a plus.
- Familiarity with SQL and Azure SQL databases.
- Basic knowledge of Python or another relevant programming language.
- Exposure to the Azure Data Platform Stack and Databricks is beneficial.
- Strong problem-solving skills and attention to detail.
- Good communication skills and the ability to work effectively in a team.
- Willingness to learn and adapt in a dynamic environment.
- Proactive mindset and enthusiasm for taking on new challenges.
What We Offer:
- A chance to be part of a pioneering data consultancy during its formative phase and directly contribute to its growth and success.
- Mentorship from experienced data engineers and a rich, hands-on experience across a spectrum of innovative projects.
- Competitive compensation and benefits package.
- The flexibility and convenience of remote work.
To apply, please forward your CV along with a cover letter expressing your enthusiasm for the role to recruitment@krystalclarity.com.