Spark and Airflow Administrator - 1 no. (US)
• Strong knowledge of Apache Spark and Apache Airflow architecture
• Experience in Installing, Configuring, tuning, and monitoring Apache Spark and Airflow on Kubernetes
• Experience with performance tuning of Spark jobs and Airflow DAGs
• Understanding of Kubernetes fundamentals and experience deploying and managing software deployments on Kubernetes
• Experience with various Airflow Kubernetes operators (Kubernetes, Celery etc)
• Basic programming experience in Python or Java
Exp : Overall 5-8 years of experience with 3-4 years as Spark/Airflow administrator