Azure Data Engineer
Hybrid: 2x week (Chicago, IL… Downers Grove)
W2 (Green Card or United States Citizen)
Top Skills
Azure
ADF
Databricks (need to be strong)
PowerBI
SQL
Python
DevOps
Job Description
National Express is currently seeking an experienced Data Engineer to join our development team. The right person will have proven Specialization in Data Engineering following Medallion Data Architecture Principles and experience in building/supporting large data structures.
• Design and build data processing pipelines using tools and frameworks in the Databricks/Azure ecosystem using ADLS.
• Design, develop, optimize, and maintain data pipelines, storage, and compute components using Azure Services.
• Understand the Data Platforms & Services strategy, and information architecture, and help build modern data lakes and maintain high standards of data quality and integrity.
• Design and build ETL pipelines to automate structured and unstructured data ingestion.
• Analyzes requirements and architecture specifications to create a detailed design document. - Responsible for data engineering functions including, but not limited to data extraction, transformation, loading, and integration in support of modern cloud computing platforms like Azure and Databricks.
• Work with DevOps engineers on CI/CD processes; perform code reviews and develop processes for improving code quality.
• Strong in scalability, performance, and availability of our systems.
• Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
• Assist in the evaluation, implementation, and deployment of emerging tools to modernize the data platform.
• Partner with analysts and architects to support technical architectures for data engineering projects.
• In-depth experience using SQL Server DB for ETL processes