Azure Data Engineer (US-based)
We are seeking an Azure Data Engineer (US-based) to join our team and play a key role in building and maintaining business intelligence infrastructures for our customers.
Responsibilities:
- Design, develop, and maintain scalable and secure data pipelines using Azure Data Lake, Synapse Serverless, Synapse Pipelines, and Apache Spark.
- Implement data quality checks and data transformations to ensure reliable and accurate data for reporting and analysis.
- Design and build data models for efficient data storage and retrieval in Azure Synapse Analytics.
- Develop and implement CI/CD pipelines for automated deployment and testing of data pipelines.
- Collaborate with data analysts, data scientists, and business stakeholders to understand data needs and translate them into technical solutions.
- Identify and evaluate new technologies and solutions, including Microsoft Fabric, for potential integration into customer data platforms.
- Stay up-to-date with the latest advancements in Azure data services and cloud technologies.
- Document data pipelines, workflows, and design decisions for knowledge sharing and future maintenance.
Requirements:
- Proven experience with Azure Data Lake, Synapse Serverless, Synapse Pipelines, and Apache Spark.
- Strong understanding of data modeling, data quality, and ETL/ELT processes.
- Experience with CI/CD pipelines and DevOps principles.
- Excellent communication and collaboration skills.
- Ability to work independently and as part of a team.
- Strong problem-solving and analytical skills.
- Experience with Python, SQL, and other relevant programming languages.
- Demonstrated interest and initial exploration of Microsoft Fabric and its potential applications.
Desired Skills:
- Experience with Azure Data Factory.
- Knowledge of cloud security best practices.
- Experience with machine learning and data science concepts.
- Experience with Power BI for data visualization and reporting (a plus).