Job Title: Data Engineer
Job Summary: We are seeking a skilled Data Engineer to join our team. The ideal candidate will design, develop, and maintain data pipelines and infrastructure to support data analysis and decision-making. They will work closely with data scientists, analysts, and other stakeholders to ensure data availability, quality, and efficiency.
Responsibilities
- Design, build, and maintain scalable data pipelines and ETL processes to handle large volumes of data.
- Develop and manage data models, schemas, and data integration strategies to support business needs.
- Optimize and tune data storage and retrieval processes for performance and efficiency.
- Collaborate with data scientists and analysts to understand data requirements and provide access to relevant datasets.
- Ensure data quality, integrity, and security through data validation and cleansing processes.
- Monitor and troubleshoot data pipeline performance and resolve data-related issues.
- Implement and maintain data warehousing solutions and data lakes.
- Stay updated with industry trends and best practices in data engineering and emerging technologies.
Qualifications
- Proven experience as a Data Engineer or in a similar data-focused role.
- Strong proficiency in programming languages such as Python, Java, or Scala.
- Experience with data processing frameworks and tools (e.g., Apache Hadoop, Apache Spark).
- Knowledge of SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).
- Familiarity with cloud data platforms and services (e.g., AWS Redshift, Google BigQuery, Azure Data Lake).
- Understanding of data modeling, data warehousing, and ETL concepts.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities for working with cross-functional teams.
- A degree in Computer Science, Engineering, Data Science, or a related field is preferred. Relevant certifications (e.g., Google Professional Data Engineer, AWS Certified Data Analytics) are a plus.