Azure Data Engineer

Hybrid: 2x week (Chicago, IL… Downers Grove)

W2 (Green Card or United States Citizen)

Top Skills

Azure

ADF

Databricks (need to be strong)

PowerBI

SQL

Python

DevOps

Job Description

National Express is currently seeking an experienced Data Engineer to join our development team. The right person will have proven Specialization in Data Engineering following Medallion Data Architecture Principles and experience in building/supporting large data structures.

• Design and build data processing pipelines using tools and frameworks in the Databricks/Azure ecosystem using ADLS.

• Design, develop, optimize, and maintain data pipelines, storage, and compute components using Azure Services.

• Understand the Data Platforms & Services strategy, and information architecture, and help build modern data lakes and maintain high standards of data quality and integrity.

• Design and build ETL pipelines to automate structured and unstructured data ingestion.

• Analyzes requirements and architecture specifications to create a detailed design document. - Responsible for data engineering functions including, but not limited to data extraction, transformation, loading, and integration in support of modern cloud computing platforms like Azure and Databricks.

• Work with DevOps engineers on CI/CD processes; perform code reviews and develop processes for improving code quality.

• Strong in scalability, performance, and availability of our systems.

• Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.

• Assist in the evaluation, implementation, and deployment of emerging tools to modernize the data platform.

• Partner with analysts and architects to support technical architectures for data engineering projects.

• In-depth experience using SQL Server DB for ETL processes

Stark Dev, LLC jobs

Data Engineer