Location: Remote
Required: Snowflake, SQL, ETL, DBT, ADF
5+ years experience with the following:
- Snowflake (Columnar MPP Cloud data warehouse)
- ETL Concepts, DBT (ETL tool)
- ADF (Azure Data Factory)
- SQL query optimizations, SQL objects (procedures, triggers, views, functions) in SQL Server.
- Experience designing and implementing Data Warehouse
- Azure/AWS cloud technology
- Understanding of T-SQL, indexes, stored procedures, triggers, functions, views, etc.
- Design and development of Azure/AWS Data Factory Pipelines preferred.
- Design and development of data marts in Snowflake preferred
- Working knowledge of Azure/AWS Architecture, Data Lake, Data Factory
- Business analysis experience to analyze data to write code and drive solutions
- Knowledge of: Git, Azure DevOps, Agile, Jira and Confluence
- Working knowledge on Erwin for data modelling
Responsibilities
- Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards
- Build High level technical design both for Streaming and batch processing systems
- Design and build reusable components, frameworks and libraries at scale to support analytics data products
- Perform POCs on new technology, architecture patterns
- Design and implement product features in collaboration with business and Technology stakeholders
- Anticipate, identify, and solve issues concerning data management to improve data quality
- Clean, prepare and optimize data at scale for ingestion and consumption
- Drive the implementation of new data management projects and re-structure of the current data architecture
- Implement complex automated workflows and routines using workflow scheduling tools
- Build continuous integration, test-driven development and production deployment frameworks
- Analyze and profile data for the purpose of designing scalable solutions
- Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues
- Partner closely with product management to understand business requirements, breakdown Epics