Senior DataOps Engineer, Data Platform
rakuten · Tokyo
Job description
About the role
Rakuten's Data Platform Department (DPD) builds and maintains a data platform powering more than 70 services, covering data lakes, data warehouses and business intelligence. As a Senior DataOps Engineer, you will lead the design and delivery of multi-cloud data pipeline infrastructure, working with BU data engineering teams, platform leads and governance stakeholders to set engineering standards, build reusable CI/CD templates and promote self-service data platform adoption.
Key responsibilities
- Design and implement standardised pipeline templates for multi-cloud ingestion, transformation and delivery (GCP BigQuery / Dataflow and Azure Databricks)
- Build and maintain CI/CD standards and tooling (GitHub Actions / Cloud Build) used across BU data engineering teams
- Implement automated testing, validation and rollback frameworks to enforce SLA and quality gates
- Lead BU onboarding to the data platform (target 8-week SLA) and provide runbook documentation
- Promote Open Table Format (OTF / Apache Iceberg) as the group-wide storage standard
- Operate and improve Apache Airflow orchestration environments, including DAG standards, dependencies and alerting
- Work with the Data Governance team to enforce metadata and lineage capture at pipeline runtime
- Mentor junior DataOps Engineers and contribute runbooks, ADRs and onboarding guides
Required profile
- Bachelor's degree in Computer Science, Data Engineering or a related field, or equivalent education and experience (8+ years)
- Proficiency in DataOps or data platform engineering, including CI/CD for data pipelines (5+ years)
- Fluent English
Required skills
- GCP data services: BigQuery, Dataflow, Cloud Composer, Pub/Sub (4+ years)
- Azure data services: Databricks, Azure Data Factory, Azure Data Lake Storage (3+ years)
- Apache Spark, Python, SQL (BigQuery, SparkSQL, ANSI) (4+ years each)
- Apache Airflow, GitHub Actions / Cloud Build or Jenkins, Terraform (3+ years each)
- Desired: Apache Iceberg or Delta Lake, streaming pipelines (Kafka, Dataflow Streaming, Flink), platform engineering or DX experience, data mesh familiarity
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Japan.
Salaries by job title
- Manager III, Customer Engineer 17
- Enterprise Account Manager (Manufacturing, Distribution & Services) 12
- Enterprise Account Manager (Public Sales Headquarters) 12
- HPE Networking Sales Executive (Large Enterprise) 11
- Customer Engineer I - Field Service Engineer 10
- Construction Surveillance Technician - Okinawa 10
- Customer Engineer II – Field Service 9
- Customer Engineer I – Field Service 9
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 43 minutes ago
Expires 1 month from now
4 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
rakuten
Tokyo