Data Architect
(Hybrid)
Experience: 10+ Years
Location: Hybrid
Mandatory: Azure, Medallion Architecture, SQL, Databricks, Data Lake
Key Responsibilities
- Design and architect scalable, high-performance, and cost-effective cloud-based solutions using Azure services and Databricks.
- Develop architecture blueprints for data pipelines, data warehousing, and advanced analytics solutions.
- Architect and implement big data processing solutions leveraging Apache Spark for ETL, data transformation, and machine learning workflows.
- Design data pipelines for large-scale data ingestion, processing, and storage.
- Implement data security, governance, and compliance measures within Databricks using Unity Catalog.
- Collaborate with data engineers, DevOps teams, and stakeholders to ensure seamless solution integration.
- Analyze system performance, identify bottlenecks, and implement performance optimization solutions.
- Implement monitoring tools for Azure and Databricks environments to ensure system health.
- Ensure data security and compliance with GDPR, HIPAA, and other regulations through encryption, access control, and logging strategies.
- Proficient in Azure services like Azure Data Factory, Azure Storage, Azure SQL, and Azure Functions.
- Expertise in Databricks, Apache Spark, and big data technologies.
- Strong scripting skills in Python and SQL, with experience in Terraform or CloudFormation.
- Experience with Kubernetes, Docker, and containerized applications.
- Familiarity with data lake architectures, Delta Lake, and advanced analytics.
- Strong knowledge of CI/CD pipelines, DevOps practices, and Infrastructure as Code (IaC).
Educational Qualifications
- Engineering Degree – BE/ME/BTech/MTech/BSc/MSc
- Technical certifications in multiple technologies are desirable.