Cognizant has an exciting opportunity for a skilled and collaborative Senior /Lead Data Engineers with hands on experience in Pyspark & Scala to join our thriving team. This full-time role is based in Sydney and offers an attractive salary and benefits. You'll be joining a collaborative and inclusive team seeking to be at the forefront of the business unit and deliver outstanding projects.
Roles And Responsibilities
- Independently Design and build/configure Big data pipelines as per the design
- Able to identify and solve big data problems independently.
- Work closely with Big data developer to report any issues in build
- Work on defect fixes during QA & UAT.
- Work through the life cycle of the code from low-level design to production and Postproductions support.
Mandatory Skills
- Strong technical and analytic skills to solve complex big data problems.
- Experienced with Spark software stack, Prior experience in working on Spark using Python or Scala or Java and PySpark based big data implementations.
- Have strong knowledge and hands-on few of HDFS, Map reduce Hive, Impala, Tej, Sqoop, Pig, Oozie, HBase, Cassandra, Mongo DB, Kafka, Spark, Storm, Knox, Ranger, Flume, NiFi, Falcon, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator and Ambari.
- Big Data Stack (Spark, Hive, Hbase, Apache Pheonix, Pig), Python , Scala, Kafka, Spark Streaming, Atlas, Pig, Java ,SQL, Impala, Tej, Sqoop, Pig, Oozie, HBase, Cassandra, Mongo DB,
- Kafka, Spark, Storm, Knox, Ranger, Flume, Nifi, Falcon, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator and Ambari.
- Good Experience in CICD & DevOps concepts
- Good experience working in any cloud environment (Azure / AWS / GCP) using Agile methodology
Salary Range: >$100,000
Date of Posting : 25/09/2024
Next Steps:If you feel this opportunity suits you, or Cognizant is the type of organization you would like to join, we want to have a conversation with you! Please apply directly with us.For a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers.Cognizant is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.
About Cognizant
Cognizant (Nasdaq-100: CTSH) is one of the world's leading professional services companies, transforming clients' business, operating and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build and run more innovative and efficient businesses.Learn how Cognizant helps clients lead with digital at www.cognizant.com or follow us @Cognizant.