Position – Azure Data Architect
Location – Chicago, IL (Hybrid)
Duration – Contract
Mandatory skills :- AZURE, Medallion Architecture, SQL, Unity Catalog and Delta Lake
Responsibilities: -
- Design and architect scalable, high-performance, and cost-effective cloud-based solutions using Azure services and Databricks.
- Develop comprehensive architecture blueprints that include data pipelines, data warehousing, and advanced analytics solutions.
- Architect and implement big data processing solutions using Databricks, leveraging Apache Spark for data transformation, ETL processes, and machine learning workflows.
- Design data pipelines that handle large-scale data ingestion, processing, and storage.
- Implement data security, data governance, and compliance measures within the Databricks environment using Unity Catalog.
- Work closely with Data engineers, DevOps teams, and other stakeholders to ensure seamless integration of solutions.
- Collaborate with project managers and business analysts to gather and interpret requirements, ensuring technical feasibility and alignment with business objectives.
- Analyze and optimize system performance, identifying bottlenecks and implementing solutions to enhance processing speed and efficiency.
- Implement monitoring tools and strategies to proactively manage the health and performance of the Azure and Databricks environments.
- Ensure that all solutions adhere to security best practices and compliance requirements, including data encryption, access control, and logging.
- Implement strategies to protect sensitive data and ensure compliance with relevant regulations, such as GDPR, HIPAA, etc.
Please share your updated resume at charanjit.s@panaceadirect.com