We are looking for an experienced and talented
Senior Data Engineer to join our partner's dynamic team. As a Senior Data Engineer, you will play a key role in designing, implementing, and maintaining our data architecture and infrastructure.
Responsibilities
- Design, implement, and maintain scalable and efficient data architectures to support the company's data needs
- Develop and implement data models, ensuring data accuracy, consistency, and reliability
- Create and optimize ETL processes to extract, transform, and load data from various sources into our data warehouse
- Implement and enforce data quality standards, ensuring the accuracy and completeness of the data
- Monitor and optimize the performance of data pipelines and queries
- Create and maintain comprehensive documentation for data engineering processes, data models, and systems
- Work closely with data analysts, data product man
Requirements
- 4+ years of proven professional data engineering experience
- Proficient in SQL and experience with relational and column databases (e.g., PostgreSQL, Redshift respectively)
- Strong programming skills in Python
- Experience with cloud platforms (AWS)
- Experience with data modeling, ETL processes, and data warehousing concepts
- Strong problem-solving and analytical skills
- Excellent communication and collaboration skills
- Ability to work independently and as part of a team in a fast-paced environment
Preferred Qualifications:
- Experience in the use of AWS Lambda, EKS, API Gateway, S3, CDK, Airflow, dbt, Git
- Familiarity with data governance and compliance standards
- Knowledge of machine learning