AI Engineer - LLM Adoption Department
rakuten · Tokyo
Job description
About the role
Rakuten's AI & Data Division builds search, recommendation, data science, advertising, marketing, pricing and inventory solutions powered by AI. Its LLMAD team promotes adoption of Rakuten AI and open-source LLMs hosted in its own environment, and is hiring AI Engineers to embed inside business units and drive real adoption of in-house large language models instead of third-party alternatives. You will work alongside a senior engineer who defines the agent architecture and model direction.
Key responsibilities
- Implement agent and tool-use workflows (function calling, multi-step flows, retrieval, guardrails, fallback handling) in the business unit's codebase
- Move features from prototype to production, debug failures, improve latency and cost, and fix issues
- Run task-level evaluations of in-house and open-source models, and maintain eval sets and harnesses with the business unit
- Design and iterate prompts, output schemas and tool definitions, measured against evals, and diagnose quality problems
- Support migration from third-party APIs to in-house models and report gaps to the senior engineer and model/platform teams
- Document reusable recipes, examples and starter templates, and help engineers adopt the tools and APIs
Required profile
- 3 to 6 years of professional software engineering experience, including hands-on LLM application development
- Experience building and debugging agents with tool/function calling or an orchestration framework
- Working knowledge of prompt engineering, including structured outputs, test-case iteration and versioning
- Strong fundamentals in at least one modern language (e.g. Python, Java, Go) and comfort with APIs, backend services and testing
- Curiosity about model behaviour and comfort working embedded in another engineering team
Desired qualifications
- Japanese language ability, a significant plus
- Retrieval-augmented generation experience
- Familiarity with evaluation frameworks or LLM observability tooling
- Exposure to self-hosted inference (e.g. vLLM) or cloud model deployment
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in 日本.
Salaries by job title
- Manager III, Customer Engineer 17
- Enterprise Account Manager (Public Sales Headquarters) 12
- Construction Surveillance Technician - Okinawa 10
- Customer Engineer II – Field Service 9
- Customer Engineer I – Field Service 9
- Telco/SP Account Sales 9
- Customer Engineer I - Field Service Engineer 9
- Japan Customs Operation Compliance and Logistics Manager (IC) 6
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Une question sur cette offre ?
Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
rakuten
Tokyo
Related job offers
-
Supplier Manager for Field Services
amadeus Tokyo -
Systems & Validation Engineer (Vehicle OS)
applied Tokyo -
Technical Project Manager - Automotive Programs
applied Tokyo -
Programmeur·euse compétitif·ve – Benchmarks IA (Remote)
Vettedlance -
Enregistreur de flux de travail pour outils de développement (éditeurs de code, IDE, clients API)
Vettedlance