Job Title: Senior Data Engineer
Location: NJ or NY ( All over USA)
Visa:- GC ,USC, H4 EAD, L2S
Job Role:- Only W2 no C2C
Job Summary: We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, developing, and maintaining scalable data architectures. You will work closely with data scientists, analysts, and business stakeholders to deliver data solutions that drive actionable insights.
Key Responsibilities:
- Design, build, and maintain robust data pipelines and ETL processes for large-scale data processing.
- Develop and optimize data models, ensuring data quality, consistency, and accessibility.
- Collaborate with cross-functional teams to gather and define data requirements.
- Implement data governance best practices, including data security and compliance measures.
- Monitor and troubleshoot data pipelines and systems to ensure reliability and performance.
- Conduct performance tuning and optimization of database systems and queries.
- Stay current with emerging technologies and industry trends to recommend improvements.
Required Skills and Qualifications:
- Education: Bachelor’s degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
- Experience: 7+ years of experience in data engineering or a related field.
- Programming Languages: Proficient in Python, Java, or Scala for data processing.
- Databases: Strong experience with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).
- Big Data Technologies: Familiarity with frameworks such as Apache Spark, Hadoop, or Kafka.
- Data Warehousing: Experience with data warehousing solutions (e.g., Snowflake, Amazon Redshift, Google BigQuery).
- Cloud Platforms: Knowledge of cloud services (e.g., AWS, Azure, GCP) and experience with cloud-based data solutions.
- Data Modeling: Strong understanding of data modeling concepts and techniques.
- ETL Tools: Experience with ETL tools (e.g., Apache Nifi, Talend, Informatica) and workflow orchestration tools (e.g., Apache Airflow).
- Version Control: Proficient in Git and collaborative development practices.
- Data Visualization: Familiarity with data visualization tools (e.g., Tableau, Power BI) is a plus.
- Soft Skills: Excellent problem-solving skills, strong communication abilities, and a team-oriented mindset.
Preferred Skills:
- Experience with machine learning frameworks and techniques.
- Knowledge of data privacy regulations (e.g., GDPR, CCPA).