Lead Engineer for Azure DevOps & Data Integration is responsible for designing, implementing, and managing end-to-end DevOps pipelines and cloud-based data integration solutions using Azure services. This role combines expertise in continuous integration and continuous deployment (CI/CD) with advanced data processing and integration, leveraging tools like Azure DevOps, Azure Data Factory, Azure Functions, and Azure Service Bus. The Lead Engineer will be critical in optimizing development workflows, automating deployments, and ensuring efficient data processing and movement across systems.

Key Responsibilities:

Design, implement, and maintain CI/CD pipelines using Azure DevOps, ensuring seamless code integration, testing, and deployment processes.
Collaborate with development teams to integrate automated testing, code quality checks, and deployment processes within CI/CD pipelines.
Optimize build and deployment processes to reduce lead times and enhance system reliability.
Develop and manage data pipelines using Azure Data Factory to automate the extraction, transformation, and loading (ETL) of data across various systems.
Design and implement serverless applications using Azure Functions for event-driven data processing tasks.
Manage messaging and event-driven architecture with Azure Service Bus, ensuring reliable communication and data flow between distributed systems.
Monitor and optimize the performance, security, and scalability of DevOps pipelines and data integration processes.
Troubleshoot and resolve issues related to build failures, deployment errors, and data processing anomalies.
Implement monitoring and logging solutions to ensure visibility into system performance and health.
Work closely with cross-functional teams, including developers, data engineers, and IT operations, to align on project goals and technical solutions.
Provide technical leadership, mentoring, and support to the engineering team, fostering a culture of continuous improvement and innovation.
Stay up-to-date with the latest Azure services, tools, and best practices, recommending and implementing improvements as needed.
Maintain comprehensive documentation for CI/CD pipelines, data integration processes, and serverless applications.
Ensure all Azure-based solutions comply with security, regulatory, and operational standards.

Qualifications:

Extensive experience with Azure DevOps and CI/CD pipeline management.
Strong experience in data integration and processing using Azure Data Factory, Azure Functions, and Azure Service Bus.
Proven track record of optimizing cloud-based solutions for performance, security, and scalability.
Proficiency in scripting and automation languages (e.g., PowerShell, Python, YAML).
Deep understanding of version control systems (e.g., Git) and build automation tools.
Strong knowledge of Azure services, including Data Factory, Functions, Service Bus, and related technologies.
Experience with monitoring and logging tools such as Azure Monitor, Application Insights, and Log Analytics.
Excellent problem-solving and analytical skills.
Strong communication and collaboration abilities, with a focus on team success.
Leadership skills with the ability to mentor and guide junior engineers.
Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent work experience).
Relevant certifications in Azure, DevOps, or cloud engineering are a plus.

accel bi corporation jobs

Lead Engineer - Azure DevOps

Lead Test Automation Engineer

Lead Business Intelligence Developer