QC Data Testing Engineer (Big Data) - Alpharetta
Location: Alpharetta GA (north of Atlanta GA) – local candidates only, will work onsite
Role: Contract, 6 mos+ (Extension possible, Conversation to Perm Possible)
VISA: C2C, GC, USC, H1b
Travel: None, <5%
Mandatory
- 3-7+ years QA/QC Data Testing of Big Data
- 2-4+ years Python & SQL (mid-complex queries & data manipulation); Will learn ECL scripting
- Large Data Warehouse environments (working at the GB, Terabit or PB levels)
- Large pipeline scripting/testing @ daily volume ~ 5-20GB range
- ETL (ingestion, normalize, transform), data cleaning, formatting, manipulation, testing
- Familiar with Data JSON format, working with simple data models
- Understands TDD (test-driven development), code coverage, Scrum/Agile, Git/GitLab/GitHub, Jira
- Embraces testing and process standards - Execute test cases via manual & automated scripts and tools
- Some Java and Korn Shell ideally
- Unix/Linux commands
- Understands business logic
- Self-starter, committed, reliable, has integrity, desire to learn new processes and technologies
- Analytical, smart, excellent problem-solving skills, ability to follow through logic and instructions
- Clear oral & written communications skills
- Degree in BS Engineering/Computer Science or equivalent experience
Optional
- SSIS, Hadoop, Informatica, Scala, Spark, PySpark
- PowerBI, Tableau
- MapReduce, Hive, HBase, NoSQL, Parquet, GLUE, Athena (queries), Kafka, Data Bricks, Snowflake, Tableau, Yarn, API, Java, C/C++, HTML, XML, Windows, UNIX
Job Duties
- Analyze large data within HPCC (high performance cluster computing) environment
- Develop scripts/programs to make “Big Data” management easier via day to day analysis and manipulation activities
- Perform moderate/complex QC testing of large datasets (manual/automated) within HPCC
- Perform research, design, software development assignments.
- Extracting, loading, cleansing, translating, manipulating, analyzing, linking and indexing massive amounts of data utilizing cutting edge technology and techniques.
- Utilize ECL language (Enterprise Control Language) and others. ECL training provided
- Run/manage test execution & results validation; May modify manual or automated testing scripts
- Review portions of detailed specs for development of system components of moderate complexity
- Full testing of new development code and bug fixes, Resolve technical issues as necessary
- Work closely with programming/development team members & Business to understand product requirements, translate them testing procedures
- Operate in various development environments (Agile, Waterfall, etc.)
- Keep abreast of new technology developments
- Make suggestions for code design, changes, be accountable for your testing procedures
- Collaborate w/ Data Engineers, Dev, other QA, Business to understand product requirements & translate into successful data testing to help ensure high quality output
- Keep abreast of new Big Data and Testing technology developments