AWS – Databricks Architect (12 +Yrs of Experience)
Location: San Diego USA
- Lead and manage a team of engineers and Sr engineers by providing guidance, mentorship, and fostering a collaborative work environment.
- Establish and maintain positive relationships with client stack holders
- Consult with client on project status, proposals, and technical issues and provide post-implementation support to them
- Facilitates communication and collaboration between onshore and offshore teams, and ensure the successful design, development and execution of the product\project\deliverables on time
- Experience in POC development, Capacity sizing, Tool Evaluation
MUST Have
· Possess excellent written and verbal communication skills.
· Ability to run ETL jobs in Databricks
· Unity catalog with delta, MongoDB, regular s3 based parquet files
· Delta format based S3
· Ability to articulate pros and cons of delta format
· Ability to run Databricks with AWS glue catalog
· Monitoring of Databricks jobs
· Operations related experience of Databricks jobs
· Best practices of setting up nested ETL jobs
· Scheduling of jobs in Databricks
· Passing runtime parameters to ETL jobs
· Handling experience in AWS in data engineering project
· Ability to coordinate/work with team in India
· Good to Have
o Experience in client facing role