a Bit About Wavicle
Wavicle Data Solutions leverages Cloud, Data & Analytics technologies to deliver complex business & digital transformation solutions to our clients. As a Minority Business Enterprise (MBE) with a 40%+ women workforce, Wavicle fosters a diverse & equitable environment where innovative professionals come together as a team and enable our clients to realize their goals in their transformation journey. Our team members collaborate by infusing their creative problem solving skills, agile working & tech know-how to drive value for our clients.
At Wavicle, a
Top Workplace award winner, you’ll find a challenging and rewarding work environment where our 500+ team members based in US, India Canada work from 42 cities in a remote/hybrid, digitally connected way. We offer a competitive benefits package that includes: healthcare, retirement, life insurance, short/long-term disability, unlimited paid time off, short-term incentive plans (annual bonus) and long-term incentive plans.
WHY WAVICLE?
Watch here to learn: https://vimeo.com/654661550
THE OPPORTUNITY
Wavicle is hiring a
Senior Data Engineer to assist our client in building data pipelines.
What You Will Get To Do
- Build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of sources (Hadoop, Spark, AWS Lambda, etc.)
- Design, develop, test, deploy, maintain and improve data integration pipeline.
- Develop pipeline objects using Databricks, Apache Spark / Pyspark / Python and/or Scala.
- Design and develop data pipeline architectures using Hadoop, Spark and related Azure services.
- Load and performance test data pipelines built using the above-mentioned technologies
What You Bring To The Team
- Bachelor or Master degree in Computer Science, Engineering, Information Systems or relevant degree.
- 4+ years of professional work experience designing and implementing data pipelines in a cloud environment is required
- 2+ years of experience migrating/developing data solutions in the Azure cloud is required
- 1+ years of experience building/implementing data pipelines using DataBricks is required.
- Experience designing/implementing solutions using one or more databases (i.e. Oracle Cloud, Azure, MySQL, and PostgreSQL)
- Expert level knowledge of using SQL to write complex, highly-optimized queries across large volumes of data
- Hands-on object-oriented programming experience using Python is required
- Professional work experience building real-time data streams using Spark
- Knowledge or experience in architectural best practices in building data lakes
- Experience in maintaining/creating data models is preferred
EQUAL OPPORTUNITY EMPLOYER
Wavicle is an Equal Opportunity Employer and committed to creating an inclusive environment for all employees. We welcome and encourage diversity in the workplace regardless of race, color, religion, national origin, gender, pregnancy, sexual orientation, gender identity, age, physical or mental disability, genetic information or veteran status.