Position - Sr. Solution Architect
Location - Lake Forest, IL (Hybrid)
Duration - Contract
Responsibilities
- Designed Batch and Real time data ingestion end to end. Additional
- Data Governance – Data Lineage using Talend Data Catalog – maintained that and used the tool to discover data sources and targets; Designed Data Quality Strategies – identify CDE -critical data elements, assigning data stewards from business side and coded the DQ metrics generation in curated zone/silver layer.
- Designed CDC/incremental loads, full load strategies – using hash keys, key columns and merge designs.
- Designed Data Security – PII/NPI, RBAC- role based access control.
- Azure Data factory pipeline creation Azure DevOps
- Designed using Azure Data factory pipeline and Databricks – writing out to azure blob and then finally to snowflake as consumption were from Tableau /snowflake.
- Initially worked with client team and did extensive data analysis to create the model, data delivery mechanism, cloud storage, retention requirement, security, RBAC [role based access control]…etc
- Streaming datasets/file- were captured using AUTOLOADER – delta live tables into raw and designed to be updated into silver, gold.
- Provide guidance on Azure cost management strategies, including resource tagging, budgeting, and monitoring.
- Conduct Azure security assessments, vulnerability scanning, and threat modeling to enhance cloud security.
- Develop custom Azure API solutions focusing on Blob Storage, Azure Functions, and Azure MySQL
Environment: Cloud migration -AWS, Azure, Snowflake, Databricks, Glue, Python, docker, DevOps/CI/CD
Please share your updated resume at charanjit.s@panaceadirect.com
Note :- This is a Fulltime Onsite role.