Senior Data Engineer - Spark, ETL pipelines
Bay Area - SF
High-Growth Startup
$215,000 + $500K equity (4 years vest + refreshers)
Are you a talented Senior Data Engineer passionate about building scalable data infrastructure?
Our client, a high-growth tech startup, is seeking a talented Senior Data Engineer to play a pivotal role in designing, building, and optimizing their data pipelines!
About Our Client
A late-stage startup with data-driven insights and resources. They collaborate with some of the biggest names in the industry and are on an exciting growth trajectory.
The Role
- Design, develop, and manage scalable data pipelines
- Generate derived datasets with enhanced properties
- Automate pipeline runs using scheduling and orchestration tools
- Handle large-scale datasets effectively
- Utilize various external APIs to enrich data
- Employ big data technologies (AWS cloud) to enhance availability and quality.
- Collaborate with team members.
Your Skills & Experience
- Extensive experience working with Spark in a production environment
- Experience working with streaming data in event-driven systems
- Previous work experience in data acquisition from external APIs
- Proven hands-on commercial experience with Python or Scala
- Familiarity with YouTube APIs is a plus
Please submit your resume anonymously through Linkedin.