Who We Are
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to Customers.
Job Description
Job Title : Databricks Administrator with Cloud Administration Expertise
Job Type : W2 / C2C / 1099
Experience : 8 to 10 years
Location : Santa Clara, CA
Responsibilities
- Overall 6+ years of experience and related 3+ years of experience in Databricks.
- Operations or systems administration experience, particularly on Linux.
- Hands-on administration experience, from setting up the Databricks environment to successfully administering it.
- Experience as the Databricks account owner, managing workspaces, Unity Catalog, audit logs, and high-level usage monitoring
- Experience as Databricks workspace admin, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.
- Experience Databricks administration configuring and installing libraries
- Experience managing storage account access across a large user base
- Experience managing clusters and jobs, policies, templates, and pools configuration options
- Experience with Databricks security and privacy setup
- Experience troubleshooting end-user and platform-level issues
- Experience optimizing usage for performance and cost-preferred
- Experience in strategizing and implementing Disaster recovery for BigData platforms based on Databricks.
- Ability to multitask and reprioritize tasking on the fly according to the needs of a growing platform and its stakeholders
- Strong coding skills in SQL and Python (PySpark) with experience optimizing code
- Assist in N/W, Data security, and IAM initiatives. Work with the n/w team to create PEs, troubleshoot network issues, etc.
- The candidate will work on building, scaling, and monitoring highly complex BigData platforms on Databricks, Snowflake DB, and ElasticSearch cloud.
- The candidate will work on building, scaling, and monitoring Data science and ML hosting platforms based on Databricks.
- The candidate will be responsible for defining and implementing our Data platform and data science workbench with ML hosting technology strategies in the Cloud.
- The candidate will also be involved in designing our architecture and defining our roadmap.
- The candidate will be responsible for implementing monitoring, alerting, and observability solutions using CSP standard monitoring and analytical tools and also 3rd party tools like Zabbix and Datadog SaaS.
- The candidate has to be an expert in Docker and cloud-based containerization technologies.
- The candidate will also be responsible for building and improving our CI/CD pipelines and keeping themselves and their team up-to-date with the latest industry trends and technologies.
- Develop automation scripts in Terraform, YAML, Helm charts, az cli, aws-cli, Powershell, and other cloud APIs.
- Participate in developer interaction calls and help.
- Participate in Management update calls and provide precise, timely updates.
Qualification
- Bachelor's degree or equivalent combination of education and experience.