Join Our Team as a Principal Data Engineer at Nerdery!
About the Role: Are you a technologist with a passion for data in all its forms? Nerdery is seeking an experienced Principal Data Engineer to architect and implement data solutions from scratch, transforming diverse data sources into actionable insights, visualizations, and predictions for our clients. You'll play a key role in supporting our software development teams, data analysts, and data scientists using the latest market-relevant products and services.
What You'll Do:
- Oversee the Technical Lifecycle: Lead the entire technical lifecycle of a cloud data platform, from framework decisions to production readiness.
- Design Robust Data Platforms: Implement secure, scalable data platforms in GCP using best practices and integrated data governance controls.
- Data Governance: Translate data governance strategies into technical requirements, ensuring compliance and fostering a data-driven culture.
- Advanced SQL and Database Work: Utilize complex SQL knowledge to work with relational databases, BigQuery, and various other databases.
- Build Analytics Tools: Develop tools that use the data pipeline to provide insights into key business metrics.
- Design Data Pipelines: Create scalable, reliable data pipelines on GCP.
- Implement CDC Techniques: Manage Delta Live Tables for real-time data integration and analytics, ensuring data consistency.
- Manage Data Lakes: Configure and manage Data Lakes in GCP to support diverse data types and formats.
- API Architecture Design: Design RESTful services and microservices, integrating ML models into production systems.
- Infrastructure Development: Build infrastructure for ETL processes using IaC, SQL, and GCP.
- Migrate Data Pipelines: Transition data pipelines and infrastructure from AWS or Azure to GCP.
- Python Scripting: Write and maintain robust Python scripts for data processing and automation.
- Support Stakeholders: Collaborate with various teams to address data-related technical issues and support data infrastructure needs.
- Ensure Data Security: Implement data security and compliance requirements, keeping client data secure.
- Mentorship and Leadership: Mentor other data engineers, participate in technical reviews, and provide strategic input for the domain.
- Sales Support: Provide technical recommendations and estimates for prospective clients as needed.
What We're Looking For:
- Bachelor’s degree in Computer Science or related field, or equivalent experience
- 8+ years of relevant experience
- In-depth knowledge of GCP data services (BigQuery, Dataflow, Dataproc, Pub/Sub)
- Proven experience in designing and implementing data pipelines, storage, and analytics solutions in GCP
- Experience with data governance and compliance policies
- Proficiency in Python and SQL
- Experience migrating data pipelines to GCP from various infrastructures
- Deep understanding of data modeling, ETL processes, and data warehousing principles
- Familiarity with data pipeline orchestration tools (Pub/Sub, Streaming, Cloud Functions)
- Excellent problem-solving and analytical skills
- Strong communication skills for both technical and non-technical stakeholders
Preferred Qualifications:
- Experience with Git and specified technologies
- History of manipulating, processing, and extracting value from large disconnected datasets
- Experience building and optimizing ‘big data’ pipelines and architectures
- Experience with APIs and additional database management systems (e.g., MS SQL Server, MongoDB, PostgreSQL, NoSQL, Sybase, IBM Db2, Oracle Database)
- Experience with big data tools (Hadoop, Spark, Kafka) is a plus
Why Nerdery? At Nerdery, you'll join a dynamic team dedicated to leveraging data to drive meaningful business outcomes. We offer a collaborative environment where your expertise will be valued, and your contributions will make a significant impact.
Ready to Take the Lead? If you are a data enthusiast ready to elevate your career, we want to hear from you! Apply now to join our team and help shape the future of data-driven decision-making.
Apply Today!
Are We the Right Fit For You?
The best way to get the scoop on whether Nerdery is the right place for you is to chat with current Nerds. We would be delighted to have a conversation with you and share insight into what it’s really like to work at our organization and if it’s a place where you can thrive. Our interview process will provide you ample opportunity to talk with other team members and assess whether the role is a good fit for your next chapter. Take the first step and apply today – our Talent Advocates will then reach out to you to get the ball rolling!
Must be legally authorized to work within the country of employment without sponsorship for employment visa status.
Nerdery is an equal opportunity employer and complies with all applicable federal, state and local fair employment practice laws. Nerdery strictly prohibits and does not tolerate discrimination against employees, applicants or any other covered persons because of race, color, religion, creed, national origin or ancestry, ethnicity, sex, sexual orientation, gender (including gender nonconformity and status as a transgender or transsexual individual), pregnancy, marital status, familial status, age, physical or mental disability, citizenship, past, current or prospective service in the uniformed services, genetic information, membership or activity in a local human rights commission, status with regard to public assistance or any other characteristic protected under applicable federal, state or local law. All employees, other workers and representatives of Nerdery are prohibited from engaging in unlawful discrimination.
Nerdery will ensure that all employment practices are free of such discrimination. Such employment practices include, but are not limited to: hiring, promotion, demotion, transfer, recruitment or recruitment advertising, selection, layoff, disciplinary action, termination, compensation, benefits, selection for training, including apprenticeship and other terms and conditions of employment. Nerdery will also provide reasonable accommodation to applicants and employees with disabilities pursuant to all applicable laws.