Jobiglo

No results.

DevOps Engineer - Databricks Platform (Azure & GCP)

rakuten · Tokyo

New
Senior 🇬🇧 English
Databricks Unity Catalog Azure Google Cloud Platform Terraform Azure DevOps GitHub Actions GitLab CI Jenkins Python Bash PowerShell Git Azure Monitor Log Analytics Cloud networking RBAC Entra ID

Job description

About the role

Rakuten's Data Platform Department (DPD) builds and maintains a data platform used by more than 70 services, covering data lakes, data warehouses and business intelligence. It is looking for a DevOps Engineer to manage the end-to-end operations of its enterprise Databricks platform hosted on Azure and GCP, focusing on platform administration, automation, CI/CD, monitoring, security and incident management.

Key responsibilities

  • Manage day-to-day operations of Azure and GCP Databricks environments
  • Automate infrastructure provisioning and platform configuration with Terraform
  • Build and maintain CI/CD pipelines for Databricks deployments
  • Monitor platform health, performance, availability and costs
  • Troubleshoot production issues, perform root cause analysis and drive operational improvements
  • Manage platform security, access controls, secrets and audit logging
  • Work with engineering, cloud, networking and security teams on platform operations

Required profile

  • 3+ years of hands-on experience administering Azure Databricks in production
  • Experience managing multiple Databricks workspaces across development, test and production
  • Strong hands-on experience with Microsoft Azure and working knowledge of GCP
  • Experience with cloud networking (VNet/VPC, Private Link, firewall rules, DNS, VPN/peering)
  • Experience implementing monitoring, logging and alerting, and production support with incident management and runbooks
  • Experience implementing RBAC, Entra ID (Azure AD), IAM, service principals, managed identities and secret management
  • Proficiency in Python and Bash (PowerShell is an advantage)

Required skills

  • Databricks, Unity Catalog, cluster policies, Jobs & Workflows, secret scopes
  • Terraform and infrastructure automation
  • CI/CD with Azure DevOps, GitHub Actions, GitLab CI or Jenkins; Git and release management
  • Azure Monitor, Log Analytics, GCP Cloud Monitoring or similar
  • GitOps, change management and platform reliability engineering
  • Nice to have: multi-cloud Databricks, Delta Live Tables, Docker, Kubernetes, Grafana, Prometheus, Splunk, Datadog, FinOps, Azure/GCP/Databricks/Terraform certifications

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec rakuten.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:workday

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

Une question sur cette offre ?

Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.

Published 35分前

Expires 1ヶ月後

3 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

rakuten

Tokyo