We are seeking an experienced Azure Data Engineer with expertise in machine learning (ML) and Snowflake. The ideal candidate will have a strong background in designing, developing, and maintaining scalable data solutions on the Azure cloud platform, integrating machine learning models, and working with Snowflake data warehousing solutions.
Key Responsibilities
- Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
- Implement and optimise data solutions in Snowflake, focusing on performance and scalability.
- Collaborate with data scientists and ML engineers to integrate machine learning models into the data pipeline and support model deployment and monitoring.
- Develop and manage data workflows and transformations using Azure Data Lake and Azure Databricks.
- Ensure data quality and integrity by implementing robust data validation and monitoring mechanisms.
- Optimise and troubleshoot Snowflake environments, ensuring efficient data storage and query performance.
- Collaborate with cross-functional teams to deliver data engineering solutions that support business needs.
- Work closely with stakeholders to understand data requirements and translate them into technical solutions.
Qualifications
- 5+ years of experience as a Data Engineer, specifically with Azure cloud services.
- Strong experience with Snowflake for data warehousing and ETL pipelines.
- Hands-on experience in implementing and deploying machine learning models within data solutions.
- Proficient with Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.
- Experience in programming languages such as Python and SQL.
- Familiarity with data orchestration tools like Airflow or similar.
- Experience with version control tools such as Git.
- Strong problem-solving and communication skills, with the ability to collaborate effectively with technical and non-technical teams.
#SeniorLevel