· Required: Design, develop, and deploy scalable machine learning pipelines and infrastructure.
· Required: Knowledge of Terraform
· Required: Troubleshoot and resolve issues related to machine learning operations and cloud infrastructure.
· Required: Implement Databricks and Spark streaming for real-time data processing and model deployment.
· Required: Ensure best practices in security, compliance, and cost management within Azure Cloud environments.
· Nice-to-have: Monitor and improve ML pipeline performance, ensuring robust CI/CD processes for continuous deployment.
Required Skills & Qualifications:
· Strong experience with Azure Cloud services, including VM, ML, Storage, and Networking.
· Advanced knowledge of Python for scripting, automation, and developing ML pipelines.
· Hands-on experience with Terraform for infrastructure as code (IaC).
· Solid understanding of CI/CD pipelines, version control (Git), and containerization (Docker/Kubernetes).