AI Summary
Manage Azure Databricks workspaces, clusters, and jobs. Configure and optimize cluster performance, security, and cost management. Ensure compliance with data governance and security standards.
Key Highlights
Administer and manage Azure Databricks workspaces, clusters, and jobs
Implement security best practices, including RBAC, data encryption, and network configurations
Monitor system performance and troubleshoot issues related to jobs, clusters, and pipelines
Key Responsibilities
Administer and manage Azure Databricks workspaces, clusters, and jobs
Configure and optimize cluster performance, auto-scaling, and cost management
Implement security best practices, including RBAC, data encryption, and network configurations
Integrate Databricks with Azure services such as Azure Data Lake Storage (ADLS), Azure Data Factory, and Azure Key Vault
Monitor system performance and troubleshoot issues related to jobs, clusters, and pipelines
Manage CI/CD pipelines and deployment automation for Databricks workloads
Handle workspace governance, access control, and auditing
Support data engineers and data scientists with environment setup and optimization
Ensure compliance with data governance and security standards
Technical Skills Required
Benefits & Perks
100% Remote
Long-term Contract
Job Description
Sr. Platform Engineer/ Databricks Admin
Role type: Long-term Contract
Location: 100% Remote
Key Responsibilities:
- Administer and manage Azure Databricks workspaces, clusters, and jobs
- Configure and optimize cluster performance, auto-scaling, and cost management
- Implement security best practices, including RBAC, data encryption, and network configurations
- Integrate Databricks with Azure services such as Azure Data Lake Storage (ADLS), Azure Data Factory, and Azure Key Vault
- Monitor system performance and troubleshoot issues related to jobs, clusters, and pipelines
- Manage CI/CD pipelines and deployment automation for Databricks workloads
- Handle workspace governance, access control, and auditing
- Support data engineers and data scientists with environment setup and optimization
- Ensure compliance with data governance and security standards
- Maintain documentation for architecture, configurations, and processes
Interested in remote work opportunities in Devops? Discover Devops Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
Required Skills & Qualifications:
- 7+ years of IT experience with 2+ years in Databricks administration
- Strong hands-on experience with the Microsoft Azure platform
- Expertise in Azure Databricks, cluster management, and job scheduling
- Experience with Azure Data Lake (ADLS Gen2), Azure Data Factory (ADF)
- Knowledge of Spark (PySpark/Scala) fundamentals
- Strong understanding of networking (VNet, Private Link, NSG)
- Experience with identity and access management (Azure AD, RBAC)
- Familiarity with CI/CD tools (Azure DevOps, GitHub Actions)
- Experience in monitoring tools and logging frameworks
Similar Jobs
Explore other opportunities that match your interests
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
ALOIS Solutions
Canada
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
Cognizant
Canada
Visa Sponsorship
Relocation
Remote
Job Type
Temporary
Experience Level
Mid-Senior level
Prolific
Canada