About Client:
The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, healthcare, and more. It is one of the largest employers in the IT industry and has a vast and diverse workforce. The company places a strong emphasis on employee training and development. Client is known for its commitment to innovation and invests in research and development to stay at the forefront of technological advancements.
It offers a comprehensive set of services, including:
IT Services: Application development, maintenance, and testing.
Consulting: Business consulting, IT strategy, and digital transformation.
Business Process Outsourcing (BPO): Outsourcing of business processes to improve efficiency.
Enterprise Solutions: Implementation and support of enterprise-level software solutions. Digital Services: Services related to digital technologies, such as analytics, cloud, and IoT.
Salary Range: $100K-$130K/Annum
Job Description:
- Strong proficiency in Python.
- Experienced in Building S3 file systems via code pipelines.
- Experienced in Creating and using IAM roles.
- Experienced in building and managing Key Management Services.
- Experienced in creating and using AWS transfer Family and Storage Gateway mechanism.
- Experienced in building and using CloudFormation templates.
- Experienced in standing up and maintaining EC2 instances and Lambda services.
- Experienced in standing up Kubernetes clusters and maintenance.
- Previous experience with data visualization tools (Power BI, Tableau).
- Strong experience with GIT, and CI/CD Pipelines.
Databricks:
- Extensive experience in Databricks technology.
- Extensive experience in data mapping, data architecture, and data modeling on Databricks.
- Extensive experience in Design, implementation, and maintenance of data pipelines using Python, pyspark on Databricks.
- Strong proficiency in Python, and PySpark, able to write and execute complex queries to perform curation and build views required by end users (single and multi-dimensional).
- Extensive experience in Databricks Data engineering (Job Runs, Data Ingestion and Delta Live Tables).
- Strong experience in setting up and maintaining SQL Warehouses, SQL Editor and alerts.
- Strong experience in setting up and maintaining workspaces, catalogs, workflows, and Compute.
- Experienced with All-purpose compute, Job computes, SQL Warehouse, Vector search, Pools, and Policies.
- Experienced in setting up and maintaining the Unity catalog.
- Experienced in creating and maintaining Databricks schema, objects, Notebooks, scheduler, and Job clusters.
- Strong experience in building Notebooks with complex code structures.
- Strong experience in building and maintaining the Autoloader process.
- Strong experience in the usage of Table ACL & Row and Column Level Security With Unity Catalog.
- Strong experience in Data Ingestion, Storage, Harmonization, and curation.
- Proven experience in performance and tuning to ensure jobs are running at optimal levels and no performance bottleneck.
- Experienced in data ingestion using various methods API, Direct database reads, AWS Cross account data copy, third party vendor data using FTP process etc.,
- Proven experience in debugging failed jobs.
About ApTask:
ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.
Candidate Data Collection Disclaimer:
At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.
If you have any concerns or queries about your personal information, please feel free to contact our compliance team at businessexcellence@aptask.com