Hi,

We are hiring Senior Data Engineer for our client a dynamic and innovative company specializing in cutting-edge AI/ML solutions.

Role: Senior Data Engineer

Years of experience:6-9 years

Budget: 12 LPA(Minimum)-15 LPA(Maximum)

Notice Period - 30days

Senior Data Engineer to join our team. The ideal candidate will have 6+ years of experience in data engineering, with strong proficiency in Python, Databricks, and working on Snowflake. This role involves working on covert raw material to extract valuable information for business insights.

Role & responsibilities

Work with architects and leads for solutions to meet functional and non-functional requirements.

Must have excellent coding skills either Python or Scala, preferably Python.

Must have at least 5+ years of experience in the Data Engineering domain with a total of 7+ years.

Must have implemented at least 2 projects end-to-end in Databricks.

Must have at least 2+ years of experience on Databricks which consists of various components such as Delta lake,dbConnect, db API 2.0, and Databricks workflows orchestration.

Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.

Must have good understanding to create complex data pipeline.

Must have extensive knowledge of Spark and Hive data processing framework.

Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases

Good to have if worked on migration project to build Unified data platform.

Good to have knowledge of DBT.

Good to have knowledge of docker and Kubernete

Almighty HRD Consultants jobs

Senior Data Engineer