DataBricks Engineer
Experience: 7-12 Years
Location: US (should have B1 visa)
Job Description:
We are seeking a skilled Lead DataBricks Engineer to join our team. In this role, you will be
responsible for engineering reliable data pipelines for sourcing, processing, distributing, and
storing data in various ways using cloud data platform infrastructure. Your primary focus will
be on developing data engineering techniques to automate manual processes and solve
complex business problems. Additionally, you will ensure the highest level of data quality
and validation checks within enterprise data lakes.
Roles and Responsibilities:
● Design and engineer reliable data pipelines for sourcing, processing, distributing, and
storing data using cloud data platform infrastructure.
● Develop data engineering techniques to automate manual processes and address
challenging business problems.
● Implement and maintain data quality and validation checks within enterprise data
lakes.
● Collaborate with cross-functional teams to understand data requirements and deliver
scalable solutions.
Qualifications:
● Bachelor's degree in Computer Science, Engineering, or a related field.
● 4+ years of experience working with Big Data Technologies such as Apache Spark,
Kafka, and Data Lakes.
● 2+ years of experience with Databricks capabilities related to data engineering
(Legacy Migration, Delta Lake, Pipeline modernization).
● Proficiency in writing code in either Python or Scala, with strong skills in SQL (stored
procs & triggers, dynamic SQL, query optimization).
● Hands-on experience with at least one of the leading public cloud data platforms
(Azure / AWS / GCP).
● Familiarity with data validation and quality frameworks, as well as data lineage
frameworks.
● Preferred: Databricks Certified Data Engineer Associate/Professional Certification.
About Us
Techment is an innovative software solution provider that empowers enterprises with
cutting-edge technology solutions. We are a fast-growing IT firm venturing into AI, data
engineering, cloud data warehousing, and process automation.
Headquartered in Bhilai, Techment has a successful track record of 10+ years. We have a
team of passionate techno-functional experts that work as an extension of client teams.
Our clientele is based in the US, and we are continuously expanding our global footprints in
Texas. For more information, please log on to www.techment.com