Job Title : Gen AI Software Engineer
Location : Toronto_Canada/Hybrid
Duration : Long Term
Job Description:
The ideal candidate will play a crucial role in building seamless connectivity between diverse components in our LLM pipelines, optimizing workflows, and contributing to the development of front-end interfaces.
- 5+ years of work experience working on various cloud technologies in ML deployment area with atleast 2+ years of experience working on software engineering efforts for implementation of LLM pipelines.
- Proven Experience working with RAG Frameworks - Langchain, Llamaindex
- Proven Experience to create Knowledge Graph (KG) and integrate same with LLM pipelines. Experience working with Medical data to create KG is good to have
- Design and implement end-to-end orchestration solutions for AI pipelines, ensuring smooth communication and coordination between various components.
- Develop connectors and interfaces to establish connectivity between different AI components, including data processing modules, machine learning models, and external APIs.
- Implement optimization techniques for AI pipelines, including resource allocation, parallel processing, and load balancing.
- Assist in the development of front-end interfaces, such as UIs and API connections, to provide user-friendly access and control over orchestrated processes.
- Collaborate with data scientists, software engineers, database engineers to understand requirements and provide technical solutions.
- Communicate effectively with team members and stakeholders throughout the development lifecycle.
Technical skills:
- Knowledge of LLM’s and integrating various components with LLM’s
- Knowledge of RAG frameworks – Llamaindex, Langchain
- Knowledge of Knowledge Graph (Neo4j) – Medical data
- Knowledge of containerization technologies (Docker, Kubernetes).
- Experience with cloud platforms (e.g., AWS, Azure).
- Excellent problem-solving skills and the ability to work in a collaborative team environment.