Jobiglo

No results.

Senior AI Engineer - LLM Adoption Team

rakuten · Tokyo

New
Senior 🇬🇧 English
vLLM LLM Retrieval-augmented generation

Job description

About the role

Rakuten's AI & Data Division builds search, recommendation, data science, advertising, marketing, pricing and inventory solutions powered by AI. Its LLM Adoption team drives adoption of Rakuten AI and open-source LLMs hosted in its own environment, embedding AI engineers inside business units to replace third-party alternatives with in-house large language models. As a Senior AI Engineer you own a business unit engagement end to end, working inside their engineering team.

Key responsibilities

  • Embed in a business unit's engineering team, design the agent (task decomposition, tool and function calling, multi-step orchestration, state, retrieval, guardrails) and write production code in their codebase.
  • Take agents from prototype to production, owning latency, cost, failure modes and monitoring, and deciding early when an agent is the wrong answer.
  • Select the right in-house or open-source model per task, proving it with task-level evaluation and building eval sets and harnesses with the business unit.
  • Migrate from third-party APIs to in-house models, with parity testing, prompt porting and staged cutover, and feed gaps back to model and platform teams.
  • Own prompt and context engineering: structured output, tool schemas, retrieval strategy and caching, versioned and measured against evals.
  • Turn work into cookbooks, recipes and reference implementations, and raise the bar through code review, mentorship and hands-on enablement.

Required profile

  • Over 6 years of professional software engineering experience, with recent hands-on focus on building LLM applications.
  • Proven agentic engineering experience: building, shipping, evaluating and debugging agents in production.
  • Prompt and context engineering as a discipline, with structured outputs and systematic iteration against evals.
  • Able to work embedded in another engineering team, communicate with business stakeholders and handle undefined requirements.
  • Willingness to write documentation, examples and recipes others can use.

Required skills

  • Practical model knowledge: strengths and weaknesses of open-weight and commercial models, and when to fine-tune, prompt or retrieve.
  • Solid production fundamentals: APIs, backend services, testing, observability, and self-hosted or cloud inference (e.g. vLLM).
  • Desired: Japanese, migration from third-party LLM APIs to self-hosted models, retrieval-augmented generation at production scale, exposure to fine-tuning, and experience with distributed teams in Japan or Asia.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec rakuten.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:workday

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

Une question sur cette offre ?

Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.

Published 3時間前

Expires 1ヶ月後

2 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

rakuten

Tokyo