Relevant Experience
(in Yrs)
- 7-10 years of hands on Pyspark/Databricks development experience.
- Knowledge in Terraform, S3, API Gateway, Lamba, SNS and SQS.
- Should have wide experience in AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL
- Should have CICD experience using tools like GIT, Jenkins etc
- Should have extensive handson experience with SPARK and real time analytic frameworks, data streaming & Structured streaming.
- Knowledge in Databricks reporting.
- They need to be experienced in programming language (Python, Pyspark)
- Hands-on experience integrating open-source components into data-analytic solutions
- Working with vendors to enhance tool capabilities to meet enterprise needs
- Willingness to continuously learn & share learnings with others
- Strong troubleshooting and performance tuning skills.
- Experience building multi-tenant, virtualized infrastructure a strong plus
Technical/Functional Skills
AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL, Sprak Streaming, Data Streaming
Experience Required
Demonstrated experience in Agile development, application design, software development, and testing
Roles & Responsibilities
Involved in gathering requirements, installing, configuring and overseeing the implementation of Project.
Interface with the internal business and technical resources.
Design, build, and test Databricks tables.
Working with an established and dynamic development team that includes outside vendor personnel and remote project team members.
Generic Managerial SkillsVery good communication skills
Good Analytical skills