Job Description
We are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They'd be responsible for running databricks at a workspace and account level.
Responsibilities:
- Hands-on administration experience with setting up the Databricks environment, administering, configuring and installing libraries on the instance.
- Advise on architecture and scaling for Databricks environments.
- Hands-on experience with workspaces, Unity Catalog, audit logs, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.
- Experience managing tenants including workspace creation, user management, cloud resources, and account usage monitoring.
- Experience managing cluster and jobs, policies, templates, pools configuration options.
- Experience as the Databricks account owner, AWS accounts and high-level usage monitoring.
- Experience with Databricks security and privacy setup.
- Experience managing storage accounts access across a large user base.
- Monitor and manage auto-scaling to ensure resources are allocated efficiently.
- Experience optimizing usage for performance, monitor cluster health checks and cost preferred.
- Collaborate with data scientists, analysts, and other stakeholders to understand and deliver data solutions.
- Experience with marketplace plugins and integration with other tools.
- Experience troubleshooting end user and platform-level issues.
- Document and maintain Databricks best practices and standards.
- Experience with Hadoop and EMR administration.
Requirements - 5+ years of experience working as databricks administrator/architect.
- Strong fluency with Python or Java.
- Must have experience with unity catalog migration.
- Advanced understanding of SQL to extract data from the databases.
- Experience with Amazon Web Services(AWS).
Benefits - Daily free breakfasts and lunches
- Health Care Plan (Medical, Dental & Vision)
- Life Insurance (Basic, Voluntary & AD&D)
- Paid Time Off (Vacation, Sick & Public Holidays)
- Training & Development
- Retirement Plan (401k, IRA)
Job Tags
Holiday work,