Job Title: Databricks Engineer
Location: Atlanta, GA; Dallas, TX (On-site)
Duration: 6+ Months
Implementation Partner: Infosys
End Client: To be disclosed
Jd
- 4 to 5 years of hands-on experience with Databricks platform, as well as expertise in AI/ML space.
- Strong expertise in design, build, and maintain scalable data architectures that support AI/ML initiatives
- Experience in designing and implementing ETL processes, including data transformation and aggregation
- Hands-on experience building ETL pipelines on Databricks to process and analyze large datasets.
- Effective collaboration skills with cross functional teams to integrate data from multiple sources into Databricks for analysis and reporting.
- Experience in integrating machine learning models into data pipelines
- Experience in optimizing data processing workflows on Databricks platform
- Proficiency in Python programming with a strong understanding of data processing frameworks like Apache spark.
- Strong knowledge of SQL and experience in relational and non-relational databases