Data Engineer - AWS - £65K Salary: Up to £65K Workplace: Remote My client a fast-growing eCommerce company, where data drives everything they do are seeking a Senior Data Engineer to play a pivotal role in shaping the future of their data platform, with a strong focus on real-time streaming , cloud infrastructure , and machine learning operations (ML Ops)
- If you’re passionate about innovative data architecture and cloud technology this is the role for you! Key Responsibilities: Architect and Implement Data Pipelines : Design, develop, and maintain scalable data pipelines to streamline data ingestion and integration across systems. Streaming Data Platform Development : Lead the creation and maintenance of a real-time data streaming platform using tools like Apache Kafka, Databricks , and Kinesis
- Cloud Infrastructure Management : Utilize AWS services (S3, Redshift, Glue, Kinesis, Lambda) to build and optimize our cloud-based data infrastructure. ML Ops & Advanced Data Engineering : Implement ML Ops practices within the data engineering framework, automating and optimizing machine learning pipelines. Data Quality & Governance : Ensure the accuracy, consistency, and reliability of data, while driving governance initiatives such as data cataloguing and lineage tracking. Tech: 3+ years working within AWS
- Python , with experience in SQL and PostgreSQL
- Knowledge of PySpark would be nice! Familiarity with Databricks and Delta Lakehouse Nice to Have: Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes ). Experience with machine learning pipelines and their integration into data platforms.