Position Overview:
We are looking for a highly skilled Data Quality Test Automation Engineer to join our dynamic team. The ideal candidate will have a strong background in data quality testing, a deep understanding of AWS technologies, and hands-on experience with test automation tools and frameworks. This role involves working closely with data engineers, data scientists, and QA teams to ensure the quality and accuracy of data through automated testing processes.
Key Responsibilities:
- Develop, maintain, and execute automated test scripts to ensure data quality and integrity across various data platforms.
- Utilize AWS Lambda, AWS Glue, and Snowflake for data processing, integration, and analysis, ensuring data is accurate and reliable.
- Design, implement, and maintain test automation frameworks for data testing, leveraging tools like Selenium.
- Collaborate with cross-functional teams to define data quality requirements and establish testing standards.
- Perform thorough testing of ETL processes, data pipelines, and data transformations to identify and resolve data quality issues.
- Use test management tools such as qTest and pytest to manage and document test cases, test results, and defects.
- Work with Python, PySpark, SQL, and other data testing technologies to create robust automated tests for data validation.
- Continuously evaluate and improve test automation processes, methodologies, and tools.
- Troubleshoot and debug complex data issues and provide solutions to enhance data quality.
- Develop and maintain documentation for test plans, test cases, and testing procedures.
Required Skills and Qualifications:
- Proven experience as a Data Quality Testing Engineer, with a strong focus on AWS technologies such as AWS Lambda, AWS Glue, and Snowflake.
- Familiarity with test automation tools like Selenium and a solid understanding of test automation frameworks.
- Proficiency in Python, PySpark, SQL, and related data testing technologies.
- Experience with test management tools such as qTest and pytest.
- Excellent problem-solving skills and a keen attention to detail.
- Ability to work independently and as part of a team in a fast-paced, dynamic environment.
- Strong communication and collaboration skills.