Summary
Our client is looking for an experienced and highly qualified Senior Data Engineer to join their growing Data & Analytics team. You'll have the opportunity to shape valuable data the business is looking to tap into to gain insights and guide future strategy. Main responsibilities will include the implementation and management of a data ingestion platform, maintaining the foundational analytics data architecture, and evaluating current technologies and provide recommendations for future use cases. There may also be chances to lead the client into advanced analytics capabilities, leveraging AI and machine learning. Comprehensive benefits package includes: highly competitive base salary plus bonus program, health insurance plan, 401(k), generous PTO policy and hybrid-remote work environment.
Responsibilities
- Become an expert in the client's data and provide support to existing data pipelines built in Databricks.
- Apply data warehousing best practices to combine, cleanse, and enhance data from internal applications and 3rd party partners into analytics-ready data models.
- Fully manage all data infrastructure including data transformation, orchestration, and monitoring.
- Determine the vision for how the client uses data in the future by leading data initiatives – this could potentially include reverse ETL and/or data-driven products.
- Build and configure integrations between platforms through the use of low-code iPaaS.
- Contribute to change management practices across systems/integrations preserving data quality.
Qualifications
- 5+ years' experience in Python, SQL and/or Scala
- 5+ years' experience designing, building, and maintaining advanced data pipelines and ETL architecture.
- 2+ years developing custom data pipelines in Databricks.
- Professional experience in at least 1 cloud data warehouse (Snowflake preferred) and at least 1 cloud platform (GCP preferred).
- Experience with system integrations (prior experience with Workato or similar iPaaS a plus).
- Experience working with business partners and management to promote transition to new platforms and processes.
- Superior project management capabilities.
- Excellent written and verbal communication, interpersonal, and collaborative skills.
- Tags: Python, SQL, databricks, Azure, AWS, Snowflake, Workato, GCP, Scala, Data Engineer, Senior Data Engineer, Lead Data Engineer
Equal Opportunity Employer. No employee or applicant shall be discriminated against on the basis of gender, race, creed, color, sex, age, national origin, marital status, veteran status, citizenship status, disability, gender identity, or sexual orientation.