Who We Are
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to the Customers.
Job Description
Job Title : Senior DataBricks Engineer ( ETL ) with Python
Job Type : C2C/W2/1099
Experience : 8 to 15 years
Location : Boston
, Massachusetts
Responsibilities
- 8 + years of experience in ETL data engineering on Databricks.
- Proficiency in the design and build of data pipelines for sourcing, staging, and publishing data using Databricks in Azure or AWS.
- Strong ETL development skills and experience with data integration tools.
- Knowledge of data modeling, data warehousing, and data transformation techniques.
- Familiarity with data quality and data governance principles.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and teamwork skills, with the ability to collaborate with technical and non-technical stakeholders.
- Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and storage solutions to ensure optimal performance.
- Documentation: Create and maintain comprehensive documentation for data pipelines, architecture, and best practices.
- Collaboration: Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and deliver high-quality data solutions.
- Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions.
Qualification
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.