Hi,
Hope you are doing Great.
Immediate need----GCP Data Engineer----Chicago,IL(Hybrid)
Job Title: GCP Data Engineer
Location: Chicago,IL(Hybrid)
Exp:-10+ Years
Need only Locals
Position Overview:
We are looking for an experienced GCP Data Engineer to join our growing team. The ideal candidate will possess strong expertise in Google Cloud Platform (GCP) services, with a particular focus on BigQuery. This role involves designing, developing, and managing data pipelines and analytics solutions to support data-driven decision-making across the organization.
Key Responsibilities:
Data Pipeline Development: Design, implement, and manage data pipelines using GCP services such as Dataflow, Cloud Composer, and Pub/Sub. Ensure seamless data integration and processing from various sources.
BigQuery Management: Develop and optimize SQL queries for BigQuery. Create and manage datasets, tables, and views. Ensure efficient and cost-effective data storage, retrieval, and analysis.
Data Integration and ETL: Extract, transform, and load (ETL) data from diverse sources, including on-premises systems, cloud services, and third-party APIs, to support business analytics and reporting needs.
Performance Optimization: Monitor and optimize the performance of data pipelines and BigQuery queries to enhance efficiency and scalability. Implement best practices for query optimization and resource management.
Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their analytical needs.
Data Quality and Governance: Ensure data accuracy, consistency, and integrity through rigorous testing and validation processes. Implement data governance practices and maintain documentation for data processes and standards.
Troubleshooting and Support: Provide technical support and troubleshooting for data-related issues. Act as a point of escalation for complex data problems and ensure timely resolution.
Continuous Improvement: Stay up-to-date with the latest GCP developments and best practices. Continuously seek opportunities to improve data processes and technologies.
Qualifications:
Experience: 10+ years of experience in data engineering or a related field, with a strong focus on Google Cloud Platform (GCP) and BigQuery.
Technical Skills:
Proficiency in SQL, with extensive experience in BigQuery.
Hands-on experience with GCP services such as Dataflow, Cloud Composer, Pub/Sub, Cloud Storage, and Data Studio.
Knowledge of data modeling, ETL processes, and data warehousing concepts