Hi,
This is Pankaj Pagare from Ztek Consulting INC (www.ztek-inc.com) .
We do have a position for
AWS + Databricks Developer
Please find the details below and if interested please send me your updated word format resume.
If this position does not match your exact skills, perhaps you know of someone with the required skills and availability, if so, please feel free to forward this e-mail to them
Job Role - AWS + Databricks Developer
Job Location: Columbus, OH(Remote)
Job Type-Fulltime
Job Description
- AWS, DataBricks, Python, Pyspark
- Strong proficiency in Python.
- Experienced in Building S3 file systems via code pipelines.
- Experienced in Creating and using IAM roles.
- Experienced in building and managing Key Management Services.
- Experienced in creating and using AWS transfer Family and Storage Gateway mechanism.
- Experienced in building and using CloudFormation templates.
- Experienced in standing up and maintaining EC2 instances and Lambda services.
- Experienced in standing up Kubernetes clusters and maintenance.
- Previous experience with data visualization tools (Power BI, Tableau).
- Strong experience with GIT, and CI/CD Pipelines.
Databricks
Extensive experience in Databricks technology.
- Extensive experience in data mapping, data architecture, and data modeling on Databricks.
- Extensive experience in Design, implementation, and maintenance of data pipelines using Python, pyspark on Databricks.
- Strong proficiency in Python, and PySpark, able to write and execute complex queries to perform curation and build views required by end users (single and multi-dimensional).
- Extensive experience in Databricks Data engineering (Job Runs, Data Ingestion and Delta Live Tables).
- Strong experience in setting up and maintaining SQL Warehouses, SQL Editor and alerts.
- Strong experience in setting up and maintaining workspaces, catalogs, workflows, and Compute.
- Experienced with All-purpose compute, Job computes, SQL Warehouse, Vector search, Pools, and Policies.
- Experienced in setting up and maintaining the Unity catalog.
- Experienced in creating and maintaining Databricks schema, objects, Notebooks, scheduler, and Job clusters.
- Strong experience in building Notebooks with complex code structures.
- Strong experience in building and maintaining the Autoloader process.
- Strong experience in the usage of Table ACL & Row and Column Level Security With Unity Catalog.
- Strong experience in Data Ingestion, Storage, Harmonization, and curation.
- Proven experience in performance and tuning to ensure jobs are running at optimal levels and no performance bottleneck.
- Experienced in data ingestion using various methods API, Direct database reads, AWS Cross account data copy, third party vendor data using FTP process etc.,
- Proven experience in debugging failed jobs.
Thanks and Regards,
Pankaj Pagare
__________________________________________
Ztek Consulting Inc.,
Phone: 1 678-918-5069
E-mail: Pankaj@ztekinc.com
Visit us at www.ztek-inc.com
______________________________________
ABOUT Ztek
Website: www.ztekinc.com
Ztek Consulting Inc is a minority- and woman-owned business enterprise that leverages a unique blend of human talent, machine learning algorithms, and artificial intelligence to provide customized talent management solutions for clients. Ztek’s diversity-focused hiring models have proven successful, particularly in hiring veterans. The company's veteran-focused hiring and deployment program, Z-V.E.T, matches skilled veterans with clients' needs in various areas.
Disclaimer: Ztek is an Equal Opportunity Employer and prohibits any kind of unlawful discrimination and harassment. Ztek is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment on the basis of race, colour, religion or belief, national origin, citizenship, social or ethnic origin, sex, age, physical or mental disability, veteran status, marital status, domestic partner status, sexual orientation, or any other status protected by the statutes, rules, and regulations in the locations where it operates. If you are an individual with a disability and need a reasonable accommodation to assist with your job search or application for employment, please contact us at hrd@ztekinc.com Please indicate the specifics of the assistance needed. Ztek encourages all interested and qualified candidates to apply for employment opportunities. Ztek does not discriminate against applicants based on citizenship status, immigration status, or national origin, in accordance with 8 U.S.C. 1324b.