Data Engineer (Full time) Location: Houston, TX (Onsite) USA
Year of Experience: 5 to 7 Years
Duration: 6 Months (Will be extended for 12 months)
No Of Positions: 15-20 (3 positions is needed in a month time.) in one Quarter time.
Responsibilities- High Level
- Connect and Collect data exploration and preparation.
- Transform and Enrich data representation and transformation.
- Publish and Serve Publish data.
- Monitor data pipelines and solutions
Responsibilities- Detail
- Developing, building, maintaining, and managing data pipelines work with large dataset, databases and software used to analyze them. Fluent with Azure data tools and component. Primary focus to ensure that data flows smoothly from its source to its destination efficiently and securely.
- Demonstrate experience in programming scripting (e.g. Python, SQL).
- Demonstrate experience Analytics/data product solution architecture on Azure (Azure data Factory, Data bricks).
- Handson experience in data extract, load and transformation techniques and tools including orchestration of needed azure resources.
- Ensuring the accuracy of data and promoting data quality.
- Building, testing, and maintaining database pipeline Architecture.
- Demonstrated experience in Data and Software Engineering tools and Agile methodologies (e.g. Agile, ADO,Ansible,G/T)
- Demonstrated experience in Analytica Data framework and Azure Analysis Services
Skills:
- Modern Data Warehousing
- Data flow transformations
- Implement and design data engineering and integration patterns: messaging, shared databases, file, service based.
- Data security design - authorization, sharding, allocations, authentication
- Database systems and large-scale processing systems
- Consume and develop data-driven APIs.