Date Posted: 09/05/2024
Hiring Organization: Rose International
Position Number: 470469
Job Title: Data Engineer
Job Location: Vancouver, BC, Canada, V5K 0A1
Work Model: Hybrid
Shift: Hybrid - Onsite 3 days a week.
Employment Type: Temporary
Estimated Duration (In months): 16
Min Hourly Rate($): 60.00
Max Hourly Rate($): 65.00
Must Have Skills/Attributes: Agile, AWS, Big Data, Data Engineer, Java
Nice To Have Skills/Attributes: Apache Spark, Databricks, Microservices, Python, Scala, Web Services
Job Description
***Only qualified Data Engineer candidates located near the Vancouver, Canada area to be considered due to the position requiring an onsite presence***
Our client is seeking a Data Engineer who thrives on testing and maintaining large data processing systems, primarily in the Spark framework using Scala. Our ideal candidate will understand the challenges of working with data at scale and have a firm knowledge of algorithms and processing complexity.
Our team is a mix of software engineers and data analysts working to ensure our inputs, algorithms, and publishing artifacts are of the highest quality and efficiency.
Our team is a mix of software engineers and data analysts working to ensure our inputs, algorithms, and publishing artifacts are of the highest quality and efficiency. Our output is critical to the accuracy of our Risk Analysis APIs which power top e-commerce sites. Constant improvement and innovation are designed into our process.
Qualifications:
• Ability to create good acceptance and integration test automation scripts and integrate with Continuous integration (Jenkins/Bamboo) and code coverage tools (Sonar) to ensure 80% or higher code coverage
• A proactive attitude and the knowledge and ability to help influence and shape the QA process to drive the team to deploy quality data
• Experience working with cloud-based server environments (AWS)
• Specific language knowledge: Scala, Java, Python
• Experience with some of the big data technologies like Apache Spark, Airflow and Databricks
• Experience using team collaboration and bug tracking tools (Jira, etc.)
• Self-motivated learner willing to take on challenging problems
• Aptitude to learn new languages and technologies as necessary
• Passion for diving deep in data and insights
• In-depth knowledge of one or more Internet protocols
• Experience with one or more strongly typed programming languages
• Bachelor’s (BS) degree in Computer Science, related degree, or equivalent
TOP Required Skills:
• Develop big data processing systems using Apache Spark, Airflow, Databricks, AWS and related technologies
• Understand Continuous Integration (CI) and Delivery (CD) concepts, and capabilities to support automation, pipelines, virtualization, and containerization
• Fluency in one or more languages like Scala, Java, Python etc.
Desired/nice to have technical skills:
• Knowledge of Microservices and scaling techniques
• Experience using web service APIs
Data Engineer Responsibilities:
• Write and own technical test design and execution as a member of an Agile-based Scrum team with an emphasis on automation, tooling, and scripting skills
• Assist in a technical test role to help drive data quality and to build, implement and execute tests and automation improvements for our core processes and publishing cycle
• Work closely with software engineers on the team in expanding test automation framework and test coverage, and on assigned projects to assist in testing and implementation tasks
• This is a technical position and requires writing, interpreting, and reviewing both test and application code
• Understand the big picture and end-to-end logical architecture of systems and various Graph core processes
• Documents test strategies and test plans; translates complex system requirements and specs into test requirements and testing methods
• Be able and willing to take an innovative approach towards testing and troubleshooting new technologies primarily focused on Big Data
• Be an integral part of the Agile SAFe scrum, sprint planning and backlog grooming sessions
• Communicate, collaborate, and work effectively in a global environment.
• Understand the use of Client technology policies in everyday work
• Demonstrate active learning and sharing of software practices via Guild/Engineering community initiatives
- **Only those lawfully authorized to work in the designated country associated with the position will be considered.**
- **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**
Benefits:
For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.
California Pay Equity:
For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.
Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.
If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.
Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).