Role-AWS Databricks and Python Developer
Hire type- Full time
Location- New York, NY
Job Description
We are seeking an AWS Databricks and Python Developer. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.
Required Qualifications:
•Candidate must be located within commuting distance of New York, NY or be willing to relocate to the area. This position may require travel in the US
•Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
•At least 4 years of Information Technology experience
•At least 2 years of AWS and Databricks experience
•Experience in end-to-end implementation using technologies such as AWS and Databricks
•Strong knowledge and hands-on experience in SQL, Unix shell scripting, and Python, Hands-on experience in building/implementing cloud platforms/applications on AWS platform.
• Expertise in AWS Compute (EC2, EMR), AWS Storage (S3, EBS), AWS Databases (RDS, DynamoDB), AWS Data Integration (Glue), Lambda and AWS Core services.
• Expertise in AWS Compute (EC2, EMR), AWS Storage (S3, EBS), AWS Databases (RDS, DynamoDB), AWS Data Integration (Glue).
• Excellent knowledge of Spark, data bricks.
• Advanced understanding of Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services.
• Good understanding of AWS Identify and Access management, AWS Networking and AWS Monitoring tools.
• Proficiency in CI/CD and deployment automation using GITLAB pipeline.
• Proficiency in Cloud infrastructure provisioning tools e.g., Terraform.
• Strong technical skill in software engineering for Java EE /Cloud technologies and proficiency in Java Lambdas, Java Streams API, Java functional programming.
• Hands-on experience of building distributed system with micro-services, Spring boot and Spring cloud.
• Proficiency in Java, Python, Scala
• Expert level skills in SQL queries in databases like Oracle, SQL Server
Preferred Qualifications:
•Experience in Banking/Financial domain
•Strong knowledge Data structures, Data Engineering concepts, Algorithms, Collections, Multi-threading and memory management and concurrency
•Experience in large scale cloud data migrations using Databricks, Python, Spark, SQL
•Sound knowledge of software engineering design patterns and practices
•Good understanding of Agile software development frameworks
•Strong communication and Analytical skills
- •Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams