AI Engineer - LLM Adoption Department
rakuten · Tokyo
Job description
About the role
Rakuten's AI & Data Division builds search, recommendation, data science, advertising, marketing, pricing and inventory solutions powered by AI. Its LLMAD team promotes adoption of Rakuten AI and open-source LLMs hosted in its own environment, and is hiring AI Engineers to embed inside business units and drive real adoption of in-house large language models instead of third-party alternatives. You will work alongside a senior engineer who defines the agent architecture and model direction.
Key responsibilities
- Implement agent and tool-use workflows (function calling, multi-step flows, retrieval, guardrails, fallback handling) in the business unit's codebase
- Move features from prototype to production, debug failures, improve latency and cost, and fix issues
- Run task-level evaluations of in-house and open-source models, and maintain eval sets and harnesses with the business unit
- Design and iterate prompts, output schemas and tool definitions, measured against evals, and diagnose quality problems
- Support migration from third-party APIs to in-house models and report gaps to the senior engineer and model/platform teams
- Document reusable recipes, examples and starter templates, and help engineers adopt the tools and APIs
Required profile
- 3 to 6 years of professional software engineering experience, including hands-on LLM application development
- Experience building and debugging agents with tool/function calling or an orchestration framework
- Working knowledge of prompt engineering, including structured outputs, test-case iteration and versioning
- Strong fundamentals in at least one modern language (e.g. Python, Java, Go) and comfort with APIs, backend services and testing
- Curiosity about model behaviour and comfort working embedded in another engineering team
Desired qualifications
- Japanese language ability, a significant plus
- Retrieval-augmented generation experience
- Familiarity with evaluation frameworks or LLM observability tooling
- Exposure to self-hosted inference (e.g. vLLM) or cloud model deployment
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Japan.
Salaries by job title
- Manager III, Customer Engineer 17
- Enterprise Account Manager (Public Sales Headquarters) 12
- Construction Surveillance Technician - Okinawa 10
- Customer Engineer II – Field Service 9
- Customer Engineer I – Field Service 9
- Telco/SP Account Sales 9
- Customer Engineer I - Field Service Engineer 9
- Japan Customs Operation Compliance and Logistics Manager (IC) 6
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 2 hours ago
Expires 1 month from now
1 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
rakuten
Tokyo
Related job offers
-
Supplier Manager for Field Services
amadeus Tokyo -
Systems & Validation Engineer (Vehicle OS)
applied Tokyo -
Technical Project Manager - Automotive Programs
applied Tokyo -
Programmeur·euse compétitif·ve – Benchmarks IA (Remote)
Vettedlance -
Enregistreur de flux de travail pour outils de développement (éditeurs de code, IDE, clients API)
Vettedlance