- Remote************************
- Senior GKE Engineer************************
Extensive GKE experience (Google Kubernetes Engine)
Key here is candidates need Extensive GKE experience (Google Kubernetes Engine)
This can sit fully remotely and is set initially to be a 12-month contract with strong likelihood of extension for the right candidate.
Looking for a GKE Data Engineer (Google Kubernetes Engine) to lead the initiative in helping them move financial/rebates data off their legacy mainframe database and settling the data within GKE. This person will help influence whether the team uses tools like Data Proc or Spark as well as Composer or Apache Airflow.
He/she will lead Project Transform, transforming their rebate processing system from their legacy platform. The potential candidate will help engineers in rearchitecting, transforming, and designing data pipelines.
Personality: Leader; Inquisitive; Communication (10/10); Share Thoughts/Opinions/Have Influence.
Required Skills
- 5 -- 7 years of Data Engineering experience
- 3+ years of Lead Data Engineering experience
- 3+ years of experience with Apache Airflow or Composer
- 3+ years of experience with Data Proc or Spark
- 5 – 7 years of experience with CI/CD
- Experience with producing architecture solutions with Composer and Spark
- Experience in Large scale batch processing with cloud services.
Desired Skills (don't Need All)
- Apache Spark, Map Reduce, Spark Streaming, PySpark, Hive, HDFS, Kafka, Redis, Sqoop, Oozie, IBM Data sage, Springbatch