DevOps Engineer - Databricks Platform (Azure & GCP)
rakuten · Tokyo
Job description
About the role
Rakuten's Data Platform Department (DPD) builds and maintains a data platform used by more than 70 services, covering data lakes, data warehouses and business intelligence. It is looking for a DevOps Engineer to manage the end-to-end operations of its enterprise Databricks platform hosted on Azure and GCP, focusing on platform administration, automation, CI/CD, monitoring, security and incident management.
Key responsibilities
- Manage day-to-day operations of Azure and GCP Databricks environments
- Automate infrastructure provisioning and platform configuration with Terraform
- Build and maintain CI/CD pipelines for Databricks deployments
- Monitor platform health, performance, availability and costs
- Troubleshoot production issues, perform root cause analysis and drive operational improvements
- Manage platform security, access controls, secrets and audit logging
- Work with engineering, cloud, networking and security teams on platform operations
Required profile
- 3+ years of hands-on experience administering Azure Databricks in production
- Experience managing multiple Databricks workspaces across development, test and production
- Strong hands-on experience with Microsoft Azure and working knowledge of GCP
- Experience with cloud networking (VNet/VPC, Private Link, firewall rules, DNS, VPN/peering)
- Experience implementing monitoring, logging and alerting, and production support with incident management and runbooks
- Experience implementing RBAC, Entra ID (Azure AD), IAM, service principals, managed identities and secret management
- Proficiency in Python and Bash (PowerShell is an advantage)
Required skills
- Databricks, Unity Catalog, cluster policies, Jobs & Workflows, secret scopes
- Terraform and infrastructure automation
- CI/CD with Azure DevOps, GitHub Actions, GitLab CI or Jenkins; Git and release management
- Azure Monitor, Log Analytics, GCP Cloud Monitoring or similar
- GitOps, change management and platform reliability engineering
- Nice to have: multi-cloud Databricks, Delta Live Tables, Docker, Kubernetes, Grafana, Prometheus, Splunk, Datadog, FinOps, Azure/GCP/Databricks/Terraform certifications
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Japan.
Salaries by job title
- Manager III, Customer Engineer 17
- Enterprise Account Manager (Manufacturing, Distribution & Services) 12
- Enterprise Account Manager (Public Sales Headquarters) 12
- HPE Networking Sales Executive (Large Enterprise) 11
- Customer Engineer I - Field Service Engineer 10
- Construction Surveillance Technician - Okinawa 10
- Customer Engineer II – Field Service 9
- Customer Engineer I – Field Service 9
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 43 minutes ago
Expires 1 month from now
4 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
rakuten
Tokyo