Role: Sr Data Engineer/Architect with Python, Spark, Scala & Databricks.

Location: 1775 Tysons Blvd, Tysons, VA.

Duration: Full-time

Job Description:

Satsyil Corp is seeking a Senior Data Architect, who is self-motivated and goal-oriented to work on our Enterprise Data Services project.

Roles and Responsibilities:

Develop Spark applications in AWS Databricks, Python, SQL, and pySpark.

Built ETL pipelines using Apache Spark in Databricks

Develop and deliver codes for the work assigned in accordance with time, quality and cost standards

Work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate data sets

Required qualifications:

8+ years hands on experience in Spark with either Python or Scala

Candidates should have knowledge of Databricks platform.

Strong knowledge of Apache Spark and hands on development experience.

Proficient in at least one programming language (Python, Scala)

Experience in ETL / Data application development and version control systems such as Git.

Ability to write Pyspark code for merging different data sets.

Should have experience working with API for data ingestion.

Databricks delta lake experience with query optimization

Knowledge of application development lifecycles, & continuous integration/deployment practices.

Experience in query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions.

Experience delivering and operating large scale, highly visible distributed systems.

Knowledge of database concepts and SQL is required.

Experience handling large and complex sets of data from various sources and databases.

Solid grasp of database engineering and design principles

A successful history of manipulating, processing and extracting value from large disconnected datasets.

Satsyil, Corp. | SBA Certified 8(a) Small Business, 8(a) STARS III GWAC Holder jobs