Data Integration Specialist / Hybrid / Philadelphia, PA
Become a member of a growing team of Information Technology professionals making an impact and providing solutions throughout Pennsylvania – Join the Domino Tech Team!
The Position:
Client: City of Philadelphia – Office of Innovation and Technology
Location: Hybrid in Philadelphia, PA
Duration: 6+/- Month Project
Philadelphia International Airport (PHL) aims to modernize its data infrastructure by mapping all existing systems and migrating the data to a centralized data lake on Amazon S3 and Redshift. This project will involve a Data Analyst to gather, review, clean, and preprocess data, and a Data Integration Specialist to create and maintain the data pipelines for smooth data migration. We are seeking a skilled and experienced Data Integration Specialist for a temporary assignment to join our dynamic team. This position will be responsible for the migration, integration, and maintenance of data within Amazon S3 and Amazon Redshift environments. This position will also be responsible for ensuring data integrity and security throughout the entire process, from initial migration to continuous data operations. This position requires 3 or more years of experience working as a Data Integration Specialist.
Work activities:
- Design and implement data pipelines to extract, transform and load data (ETL and/or ELT) data into Amazon S3 using Azure Data Factory and other tools
- Set up automated workflows to ensure continuous data migration
- Configure Amazon S3 buckets for data storage
- Set up data schemas and tables in Amazon Redshift
- Migrate cleaned and pre-processed data into Amazon S3 and Redshift
- Ensure data integrity and security during migration
- Monitor data pipelines for performance and reliability
- Perform regular maintenance to address any issues
- Improve data integration processes for increased efficiency and scalability
- Document data integration processes and procedures
The Skills and Experience:
- 3+ years of experience creating, documenting, implementing, and maintaining data pipelines
- Experience with various cloud platforms
- Proficient with Azure Data Factory
- Strong knowledge of Amazon AWS S3, AWS Redshift and AWS Lambda
- Proficient in SQL and ETL tools
- Effective communication and documentation abilities
- Expertise in data security and integrity measures
- Excellent problem-solving and analytical skills
The Company:
The mission of Domino Technologies, Inc. is to provide clients with IT solutions for their individual business processes that lead to strategic market advantages. Since its founding in 1996, the Domino Tech Team has built a solid record of performance working with clients in the Government and Commercial sectors.
The Perks:
- Excellent Market Salary
- Competitive Benefits
- Paid Holidays and Vacation
- Positive Work-Life Balance
The Location:
Domino Technologies is based in the Harrisburg area – the capital city of the Commonwealth of Pennsylvania and the county seat of Dauphin County. Located on the east bank of the Susquehanna River, Harrisburg is the anchor of the Susquehanna Valley metropolitan area.
Contact Us Today!