Company Overview
Innovya Technologies is a growing, dynamic software consulting organization and technology powerhouse. We help businesses achieve greater levels of automation across their organization with our world-class advisory and solutions. Here you will learn and grow in a fast-paced, supportive, and phytologically safe environment that will take your career to the next level. We are looking for people who can demonstrate teamwork, results orientation, a growth mindset, disciplined execution, and a winning attitude to join our growing team!
Role – Azure Data Architect
Years of experience – 7+ Years (minimum)
Key Responsibilities
Responsible for leading a team of Data Engineers to deliver the following:
- Design and implement the data engineering framework and data pipelines using Databricks.
- Document the high-level design components of the Databricks data pipeline framework.
- End-to-end Data Engineering and Analytics solutions including data, technology infrastructure and models.
- Lead on the Design and implementation an MVP Databricks framework.
- Providing data architecture guidance around complex efforts within established Software Development Lifecycles and methodologies including agile, scrum, and using blended resources
- Support the development team’s capability.
- Support the implementation of data pipelines against the new framework in line with the agreed migration plan.
- Ensure data quality management including profiling, cleansing and deduplication to support build of data products for clients.
Skills Knowledge and Expertise
- 7+ years of experience in designing and implementing a fully operational solution.
- Experience working in Azure Cloud using Azure SQL, Azure Databricks, Azure Data Lake, Delta Lake, and Azure DevOps.
- Proficient in SQL.
- Profiling data and data modelling experience on large data transformation projects creating data products and data pipelines.
- Good understanding of architectural roadmap discussions and present different architecture and design options.
- Good understanding on design/implement data platform solutions for Datawarehouse modernization, Data Lake House architecture, green-field data platforms on Cloud (Azure).
- Experience of reviewing datasets for data products in terms of data quality management and populating data schemas set by Data Modellers.
- Experience with data profiling, data quality management and data cleansing tools.
- Experience and use of ETL tools such as Databrick/ADF/Informatica.
- Strong communication, presentation and consulting skills, including technical writing skills and the ability to listen and understand client issue.