Designation: Data Engineer/ Architect
Location: Raritan, NJ
Duration: Long Term.
Requirement:
Position Overview: As a Data Engineer/Architect, you will play a crucial role in designing, building, and maintaining our data infrastructure and pipelines. This position demands hands-on experience with a variety of data engineering tools and technologies, including Talend, Qlik Replicate, Data Bricks, and Azure Data Factory. A strong understanding of cloud-based data architecture and patterns, particularly Azure Data Lake and Data Lakehouse, is essential. The ideal candidate will have 5 to 7 years of relevant experience in data engineering and a proven track record of delivering robust data solutions.
Key Responsibilities: In this role, you will:
· Develop, maintain, and optimize ETL processes using ETL technologies to ensure efficient data integration and transformation workflows.
· Design, implement, and manage data warehouse and data lakehouse using Snowflake EDW and Azure Data Lake.
· Utilize Databricks for data processing and analytics.
· Implement data replication solutions using Qlik Replicate to ensure data consistency and availability across systems.
· Design and implement scalable and efficient data architecture on cloud platforms, adhering to best practices and patterns, especially with Azure cloud technologies.
· Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate solutions.
· Provide technical guidance and support to team members and other departments as needed.
Qualifications: The ideal candidate will have:
· A bachelor’s degree in computer science, Information Technology, or a related field; a Master’s degree is a plus.
· 5 to 7 years of hands-on experience in data engineering.
· Proficiency in ETL/ELT technologies for data integration and transformation.
· Experience with Snowflake EDW and Azure Data Lake.
· Familiarity with Databricks and Qlik Replicate.
· Strong problem-solving and analytical skills.
· Excellent communication and collaboration abilities.
· The ability to work independently while managing multiple projects simultaneously.