(Senior) AI Product Engineer (m/w/d)
Hiring Intelligence & Application Guidance
Direct ATS application. Include measurable achievements and core keywords from the job description.
Initial recruiter screening → Hiring Manager interview → Role-specific practical assessment.
Compensation benchmarked against current US national market averages (USD).
US Employment Authorization verified for direct application.
Role Overview & Responsibilities
What You'll Do
You’ll identify open AI opportunities, build them from start to finish, and bring them to real users. As a Senior AI Product Engineer, you’ll work across our three product squads: You’ll single-handedly turn unaddressed topics into products, hand them off once they’re up and running, and serve as a sparring partner for the squad PMs on all AI-related topics. For us, “senior” refers to your approach to work, not your years of experience. You’ll report directly to Product Leadership.
Your Responsibilities
- Independent AI projects (about half of your time)
- You’ll identify high-impact AI opportunities in our legal workflows - in areas where no specific squad is responsible
- Validation happens quickly: discussions with attorneys, Legal Ops, and insurers; prototypes built in days
- You’ll bring the winning solutions into production yourself: routing, chaining, summarization, and agent-based loops
- You’ll hand off mature features to the squad - complete with documentation, evaluations, and a handover plan
- Feasibility, costs, model selection, risks: You’ll answer these questions before every AI feature is launched
- You support the teams in designing evaluations, golden datasets, and guardrails
- You review concepts before they go into the roadmap - including prompt injection and compliance risks (GDPR, Section 203 of the German Criminal Code)
- You advance AI best practices: prompt engineering standards, LLM observability, and agent-based coding workflows
What you bring
Must-have
- Multiple production-ready AI/LLM systems that you’ve shipped to real users and taken responsibility for - no prototypes
- Demonstrable product ownership: from a vague problem to a finished product
- Strong Python skills and a solid foundation in software engineering (Git, testing, CI/CD, code review)
- In-depth experience with LangGraph, LangChain, or similar - including an understanding of what’s happening under the hood
- Proficiency with LLM provider APIs: function/tool calling, structured outputs, streaming
- Evaluations, golden datasets, and guardrails before deployment
- Solid prompt engineering - you know when to use which technique
- Business-level English; German is a major plus due to our legal domain
- The maturity to work without a squad around you: You set your own priorities and know when to say no
- You can explain a technical trade-off to a lawyer and a legal workflow to an engineer
What we promise
Work Environment & Flexibility
- Office-first: 3 days in the office, 2 days working from home - with flexibility in how you structure your work
- Modern, air-conditioned office with plenty of natural light and a large rooftop terrace overlooking Berlin
- Central location between Gleisdreieck and Potsdamer Platz
- Full coverage of the public-transport ticket
- Company pension plan with a 20% employer contribution
- Corporate benefits platform with discounts from many brands
- Dog-friendly office
- Regular company and team events, after-work fun with Switch, PS5, darts, and foosball
- Free drinks, fresh fruit, and granola
- Agile mindset with open communication - every voice counts
- Feedback is part of our culture - we believe in growing together
- Your application as an AI Product Engineer (Senior) - short and to the point
- Approx. 20-minute introductory conversation with our HR team
- Approx. 60-minute in-person interview with your hiring manager
- Approx. 30-minute discussion with the management team
- A prompt job offer
Find Jobs in Germany on Arbeitnow
Interested in this role at Legalhero?
Apply directly through the verified employer application pipeline.
