Seeking a highly skilled and motivated Data Engineer to join a dynamic team. As a key contributor, you will be responsible for integrating into the Common Data Platform (CDP) Program Team to build and migrate data assets to a new AWS technology stack using Immuta, Starburst, Collibra, Databricks, Alteryx, and Tableau.
Required Skills -
- SQL
- Databricks, Collibra, and/or Alteryx.
- Familiarity with cloud-based data platforms, particularly AWS.
Job Duties -Responsibilities
- Integrate into the Common Data Platform (CDP) Program Team to build and migrate data assets to a new AWS technology stack using Immuta, Starburst, Collibra, Databricks, Alteryx, and Tableau.
- Perform data engineering and analytics tasks, including data ingestion, SQL orchestration, and data modeling.
- Troubleshoot and resolve issues during testing and validation activities.
- Design and build data ingestion pipelines.
- Participate in Agile methodology, delivering assigned stories according to engineering standards and guidelines.
- Collaborate in pair programming, code reviews, and documentation of data models.
- Implement automated tests, logging, and alerting for data processes.
- Provide data engineering consulting expertise, especially in Starburst and Immuta.
- Support data migration activities.
Key Deliverables
- Completion of assigned stories, including design, data ingestion pipeline builds, data modeling, coding, analytics solutions, and documentation.
- Jira Stories and Epics for each Agile program increment.
- Deliver high-quality solutions accepted by the CDP Program Team’s product owners, adhering to FRS engineering standards and guidelines.
Job Requirements -
- 5+ years of experience in data engineering.
- Experience with Databricks, Collibra, and/or Alteryx.
- Strong SQL skills and experience in building data ingestion pipelines.
- Familiarity with cloud-based data platforms, particularly AWS.
- Proficiency in Agile methodologies and tools such as Jira.
- Excellent troubleshooting and problem-solving skills.
- Ability to work collaboratively within a team and communicate effectively with stakeholders.
- Experience in Immuta and Starburst preferred.
Desired Skills & Experience -Experience in Immuta and Starburst preferred