Role: - Azure Data Engineer
Location: - (Chicago, IL) Hybrid
Duration: - Long Term - C2H
Job Description
- Experienced Data Engineer to join our development team. The right person will have proven Specialization in Data Engineering following Medallion Data Architecture Principles and experience in building/supporting large data structures.
- Design and build data processing pipelines using tools and frameworks in the Databricks/Azure ecosystem using ADLS.
- Design, develop, optimize, and maintain data pipelines, storage, and compute components using Azure Services.
- Understand the Data Platforms & Services strategy, and information architecture, and help build modern data lakes and maintain high standards of data quality and integrity.
- Design and build ETL pipelines to automate structured and unstructured data ingestion.
- Analyzes requirements and architecture specifications to create a detailed design document. - Responsible for data engineering functions including, but not limited to data extraction, transformation, loading, and integration in support of modern cloud computing platforms like Azure and Databricks.
- Work with DevOps engineers on CI/CD processes; perform code reviews and develop processes for improving code quality.
- Strong in scalability, performance, and availability of our systems.
- Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
- Assist in the evaluation, implementation, and deployment of emerging tools to modernize the data platform.
- Partner with analysts and architects to support technical architectures for data engineering projects.
- In-depth experience using SQL Server DB for ETL processes
Additional Skills & Qualifications
- Bachelor’s degree in computer science or a similar field with 5 Years experience as a data engineer or SQL developer.
- 5 Years experience developing SQL and Python.
- In-depth knowledge of Azure Data Factory, Azure Databricks, and Azure Service Bus.
- Excellent understanding of T-SQL programming, ETL Processes, and Microsoft SQL Server.
- Experience working with data using structured (SQL) and/or unstructured (NoSQL) approaches, Redshift experience a plus
- Experience with or exposure to data visualization principles and practices, especially with Power BI or Tableau.
- BS/MS degree in Computer Science, Engineering, or a related subject
- Sense of ownership and pride in your performance and its impact on the company’s success
- Employee Value Proposition (EVP)
- This position will utilize latest Azure technology and help to grow their cloud presence across multiple applications
Top Required Skills: -
- Azure
- ADF
- Databricks
- PowerBI
- SQL
- Python
- DevOps