Job Title
Solution Architect
Relevant Experience
(in Yrs)
10+
Must Have Technical/Functional Skills
Certification: Python and AWS
Primary Skillset:
- AWS Services: Strong understanding and hands-on on services like Ss3, Redshift, Glue, Lambda.
- Python and SQL: Strong programming skills in either Python. Should be able to write modular code. Debug issues and SQL as these are the primary languages used for writing Spark applications.
- Front End Technology: Strong understanding on Flask framework and Power App to build application.
- Data Processing and Analysis: Experience in designing and implementing data processing and analysis pipelines using SQL and Python.
- Should have strong Data Warehouse concepts and Delta Lake architecture understanding.
- Cloud Platform: Familiarity with Azure cloud platform and its services, including Azure Data Factory, Azure access, Azure Storage, Azure Data Lake, and Azure SQL Database.
- Data Engineering: Understanding of data engineering concepts and experience with ETL processes, data modeling, and data warehousing.
- DevOps: Experience with CI/CD pipelines, version control systems (e.g., Git), and automated deployment of Spark applications.
- Data Security and Governance: Understanding of data security and governance practices, including data encryption, access controls, and compliance regulations.
- Monitoring and Troubleshooting: Proficiency in monitoring and troubleshooting Spark applications, identifying and resolving performance bottlenecks or issues.
- Collaboration and Communication: Excellent communication skills and the ability to collaborate effectively with cross-functional teams, including data scientists, data engineers, and business stakeholders.
Secondary Skillset:
- Machine Learning: Familiarity with machine learning concepts and experience with implementing machine learning algorithms using Python or other machine learning frameworks.
- Data Visualization: Knowledge of data visualization tools and libraries like Tableau and Power BI
Experience Required
10+ years
Roles & Responsibilities
Technical Lead
Generic Managerial Skills
Stakeholder Management, Team Management, Conflict Management