Senior DataOps Engineer, Data Platform
rakuten · Tokyo
Job description
About the role
Rakuten's Data Platform Department (DPD) builds and maintains a data platform powering more than 70 services, covering data lakes, data warehouses and business intelligence. As a Senior DataOps Engineer, you will lead the design and delivery of multi-cloud data pipeline infrastructure, working with BU data engineering teams, platform leads and governance stakeholders to set engineering standards, build reusable CI/CD templates and promote self-service data platform adoption.
Key responsibilities
- Design and implement standardised pipeline templates for multi-cloud ingestion, transformation and delivery (GCP BigQuery / Dataflow and Azure Databricks)
- Build and maintain CI/CD standards and tooling (GitHub Actions / Cloud Build) used across BU data engineering teams
- Implement automated testing, validation and rollback frameworks to enforce SLA and quality gates
- Lead BU onboarding to the data platform (target 8-week SLA) and provide runbook documentation
- Promote Open Table Format (OTF / Apache Iceberg) as the group-wide storage standard
- Operate and improve Apache Airflow orchestration environments, including DAG standards, dependencies and alerting
- Work with the Data Governance team to enforce metadata and lineage capture at pipeline runtime
- Mentor junior DataOps Engineers and contribute runbooks, ADRs and onboarding guides
Required profile
- Bachelor's degree in Computer Science, Data Engineering or a related field, or equivalent education and experience (8+ years)
- Proficiency in DataOps or data platform engineering, including CI/CD for data pipelines (5+ years)
- Fluent English
Required skills
- GCP data services: BigQuery, Dataflow, Cloud Composer, Pub/Sub (4+ years)
- Azure data services: Databricks, Azure Data Factory, Azure Data Lake Storage (3+ years)
- Apache Spark, Python, SQL (BigQuery, SparkSQL, ANSI) (4+ years each)
- Apache Airflow, GitHub Actions / Cloud Build or Jenkins, Terraform (3+ years each)
- Desired: Apache Iceberg or Delta Lake, streaming pipelines (Kafka, Dataflow Streaming, Flink), platform engineering or DX experience, data mesh familiarity
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in 日本.
Salaries by job title
- Manager III, Customer Engineer 17
- Enterprise Account Manager (Public Sales Headquarters) 12
- Enterprise Account Manager (Manufacturing, Distribution & Services) 12
- HPE Networking Sales Executive (Large Enterprise) 11
- Dry Etch Process Equipment Engineer (Fab 15 HVM) 10
- Customer Engineer I - Field Service Engineer 10
- Construction Surveillance Technician - Okinawa 10
- Telco/SP Account Sales 9
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Une question sur cette offre ?
Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
rakuten
Tokyo