Data Engineer - 9 Month Contract
We are looking for a Data Engineer to join our team and lead the development of a future-proof data pipeline in AWS, which will integrate with our payroll system, SuccessFactors.
This role involves working with a small team through a critical data migration and building a scalable, configuration-based solution that meets both current and future business needs.
Key Responsibilities
- Design and build a robust data pipeline in AWS to support payroll system integration with SuccessFactors.
- Implement a future-proof, configuration-based approach to manage evolving data requirements.
- Work hands-on with data engineering tasks (50% of the role), primarily using PySpark, AWS S3, Glue, and Airflow for orchestration.
- Drive best practices for data quality, ensuring the accuracy and reliability of data within the medallion architecture and lakehouse engine.
- Collaborate with cross-functional teams to meet business objectives and ensure seamless integration of the data pipeline.
Essential Skills & Experience
- Strong proficiency in PySpark and Python for data processing and transformation.
- Experience with AWS S3, Glue, and Airflow for managed orchestration.
- Solid understanding of the Medallion architecture and lakehouse data engine principles.
- Hands-on experience with data quality management.
- Ability to work collaboratively with a team, drive a migration project, and ensure scalable, future-ready solutions.
If you're passionate about building cutting-edge data pipelines in AWS and leading a high-impact migration project, we'd love to hear from you!