As a Backend Engineer, you will be pivotal in designing, building, and maintaining a robust infrastructure that supports our RAG (Retrieval-Augmented Generation) application. This role requires a blend of expertise in CI/CD pipelines, automation, system optimization, and parallelization to ensure scalable, efficient, and secure implementations.
Responsibilities
- Infrastructure Design and Development: Architect and develop scalable and secure infrastructure to meet the RAG application's needs. Collaborate in selecting appropriate cloud services, designing database schemas, and integrating various data sources and APIs.
- Automation and Orchestration: Implement automation tools and frameworks (like Terraform, Ansible, or Kubernetes) to streamline the deployment and management of infrastructure.
- Continuous Integration and Continuous Deployment (CI/CD): Build and maintain CI/CD pipelines to automate the testing and deployment of the RAG application components.
- Performance Tuning and Optimization: Monitor system performance and make adjustments to infrastructure to improve efficiency, reduce latency, and optimize system resources. Implement parallelization strategies to enhance performance.
Qualifications
- Bachelor's degree or equivalent experience in Computer Science or related field
- Development experience with programming languages such as Python and C++
- Experience in Infrastructure as Code (IaC)