DevOps Engineer - Databricks Platform (Azure & GCP)
rakuten · Tokyo
Job description
About the role
Rakuten's Data Platform Department (DPD) builds and maintains a data platform used by more than 70 services, covering data lakes, data warehouses and business intelligence. It is looking for a DevOps Engineer to manage the end-to-end operations of its enterprise Databricks platform hosted on Azure and GCP, focusing on platform administration, automation, CI/CD, monitoring, security and incident management.
Key responsibilities
- Manage day-to-day operations of Azure and GCP Databricks environments
- Automate infrastructure provisioning and platform configuration with Terraform
- Build and maintain CI/CD pipelines for Databricks deployments
- Monitor platform health, performance, availability and costs
- Troubleshoot production issues, perform root cause analysis and drive operational improvements
- Manage platform security, access controls, secrets and audit logging
- Work with engineering, cloud, networking and security teams on platform operations
Required profile
- 3+ years of hands-on experience administering Azure Databricks in production
- Experience managing multiple Databricks workspaces across development, test and production
- Strong hands-on experience with Microsoft Azure and working knowledge of GCP
- Experience with cloud networking (VNet/VPC, Private Link, firewall rules, DNS, VPN/peering)
- Experience implementing monitoring, logging and alerting, and production support with incident management and runbooks
- Experience implementing RBAC, Entra ID (Azure AD), IAM, service principals, managed identities and secret management
- Proficiency in Python and Bash (PowerShell is an advantage)
Required skills
- Databricks, Unity Catalog, cluster policies, Jobs & Workflows, secret scopes
- Terraform and infrastructure automation
- CI/CD with Azure DevOps, GitHub Actions, GitLab CI or Jenkins; Git and release management
- Azure Monitor, Log Analytics, GCP Cloud Monitoring or similar
- GitOps, change management and platform reliability engineering
- Nice to have: multi-cloud Databricks, Delta Live Tables, Docker, Kubernetes, Grafana, Prometheus, Splunk, Datadog, FinOps, Azure/GCP/Databricks/Terraform certifications
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in 日本.
Salaries by job title
- Manager III, Customer Engineer 17
- Enterprise Account Manager (Public Sales Headquarters) 12
- Enterprise Account Manager (Manufacturing, Distribution & Services) 12
- HPE Networking Sales Executive (Large Enterprise) 11
- Dry Etch Process Equipment Engineer (Fab 15 HVM) 10
- Customer Engineer I - Field Service Engineer 10
- Construction Surveillance Technician - Okinawa 10
- Telco/SP Account Sales 9
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Une question sur cette offre ?
Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
rakuten
Tokyo