Computer Enterprises Inc. is currently hiring for a Data Engineer for our client in Cincinnati, OH. Candidates must have experience with python programming, SQL, and Azure or AWS.
Data Engineer
Contract
Hybrid
- Experience designing, building, and deploying scalable cloud-based solution architectures
- Expertise in creating lake houses in Azure and building Realtime Streaming Analytics Platform leveraging Azure Services
- Experience working with public cloud platforms such as AWS, Azure
- Expertise in Python and SQL programming
- Experience building data lakes & data warehouses to support operational intelligence and business intelligence
- Experience working with Serverless Computing & Azure Functions
- Experience with Cosmos DB, Azure Data Explorer, Azure Synapse Analytics, Azure Data Lake, Azure Data Factory, Azure SQL, Azure Databricks, Azure Machine Learning or equivalent tools & technologies
- Experience with Kafka and/or other event streaming mechanisms
- Experience with monitoring/alerting techniques and APM tools
- Experience automating infrastructure provisioning, DevOps, or Continuous Integration/Delivery
- Knowledge of containerization and container orchestration technologies.
- Good understanding and/or experience writing software in one or more languages, such as Java, Go, JavaScript, C++, or similar
- Familiarity with standard IT security practices such as identity and access management, SSO, data protection, encryption, certificate, and key management
- Familiarity and good understanding of infrastructure storage, networking etc.
- Strong analytical problem-solving skills
- Excellent written and verbal communication skills
- Self-starter takes the initiative and works well under pressure
- Business-minded approach to time, costs, and milestones
- Lead the analysis of the technology environment to detect critical deficiencies and recommend solutions for improvement
- Must be very organized, able to balance multiple priorities, and self-motivated
- Familiarity or experience with building AI/ML solutions
Key Responsibilities
- Drive digital innovation by leveraging innovative new technologies and approaches to renovate, extend, and transform the existing core data assets, including SQL-based, NoSQL-based, and Cloud-based data platforms
- Drive the development and communication of enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical uses
- Design, develop, and implement integrations based on user feedback.
- Collaborate with solution architects, cloud services, enterprise data management & product managers to iterate on the design & implementation of Fulfillment Services Data Strategy
- Design Azure-based technical architectures, migration approaches, and application optimizations that enable the Product
- Draft and review architectural diagrams, interface specifications and other design documents such as Architectural Decision Records
- Focus on overall product s data quality and user experience
- Build standards, processes and procedures to deliver best results
- Create data pipelines for various types of streaming use cases
- Be a technical advisor and troubleshoot to resolve technical challenges with data product related infrastructure and application(s)
- Promote the reuse of data assets, including the management of the data catalog for reference
- Mentor team members in data principles, patterns, processes and practices
- Implement automation tools and frameworks (CI/CD pipelines).
- Troubleshoot production issues and coordinate with the development team to streamline code deployment.
- Author and publish data governance models, data lineage and data dictionary for Fulfillment Services data catalog
Python Engineer