Are you passionate about harnessing the power of data to drive meaningful insights? Do you thrive in dynamic environments where you can design and develop scalable ETL pipelines? My client is looking for a talented Senior Data Engineer to join our team and take the lead in building innovative data solutions in an AWS environment with strong SQL skills!
Contract duration: 6 months
What You’ll Do
- Design, develop, and maintain ETL processes that extract valuable insights from large, complex datasets.
- Play a crucial role in developing a semantic layer through ETLs and virtualized views.
- Collaborate with Engineering teams to discover and leverage new data as it becomes available.
- Contribute to the building and support of data warehouses, utilizing Python to handle both structured and unstructured data.
- Support and troubleshoot existing SQL-based ETL processes, ensuring smooth operations.
- Orchestrate data pipelines using Apache Airflow or similar tools (AWS MWAA).
- Create and maintain detailed report specifications and process documentation.
- Act as a liaison between business and technical teams, delivering cross-functional reporting solutions.
- Troubleshoot and resolve data, system, and performance issues to ensure high-quality data solutions.
- Communicate effectively with business partners and technical teams to gather requirements, articulate deliverables, and provide technical designs.
What We’re Looking For:
- Hands-on experience in designing and maintaining ETL processes within an AWS environment.
- Proficiency in Python and SQL, with the ability to troubleshoot and optimize data processes.
- Experience with Apache Airflow or similar tools for pipeline orchestration.
- Strong communication skills to work effectively with cross-functional teams.
- The ability to multitask and prioritize in a fast-paced, evolving environment.
Posted By: Casey Ryan