- Location
- 2200 Copenhagen
- Company
- Sumary
- Working hours
- Full-time
- Posted
- 20 November 2026
- Application deadline
- 4 January 2027
- Category
- Test engineer
About the job
About the role
Our agents do real accounting work on live client books, so "it looks right" is not good enough. As an AI Test Engineer, you will build the evals that measure whether they get it right: the test cases, the scoring and the systems that run them on every change.
You will work closely with our research team, with our Applied Accounting Researcher, who decides what correct looks like, and with the engineers building the AI CFO and our agents. You will be based in our Copenhagen office.
What you'll do
- Build and grow our eval suites across accounting tasks, from reconciliation to reporting and consolidation
- Turn real cases from accounting firms into test cases with clear, agreed answers
- Design scoring you can trust, using model-graded checks only where they hold up
- Run evals on every model, prompt and tool change, and catch regressions before release
- Track agent quality over time, and make the results easy for the whole team to read
- Help decide when an agent is good enough to take on a new task
What we're looking for
- 5 or more years of experience in software engineering, test engineering or machine learning
- You have built a test harness for LLMs or agents before: the datasets, the runners and the scoring
- A strong software engineer: your test systems are production code, not a folder of scripts
- Rigour: you design tests that are hard to fool
- Clear writing about what results mean, and how sure you are of them
Nice to have
- Statistics, and experience measuring noisy systems
- Experience building CI pipelines
- An interest in accounting or finance
Does the job sound like a fit? Create a free profile and we will help you with the application.
Find more jobs like this
New to Denmark?
Get help with work permits, CPR, tax and job search from Lena, our free AI advisor for foreigners.
Similar jobs
Not quite the right match? Browse other relevant roles before you move on.
- Team Leader - Production Test DevelopmentHAMAMATSU PHOTONICS A/S · Nordsjælland, NordsjællandView and apply
- Production Test Development EngineerHAMAMATSU PHOTONICS A/S · Nordsjælland, NordsjællandView and apply
- Test Engineer (m/f/d)National Oilwell Varco Denmark I/S · Storkøbenhavn, StorkøbenhavnView and apply
- Advanced Test Engineer, Space Systems, LystrupTerma A/S · Østjylland, ØstjyllandView and apply
- Principal QA Platforms ArchitectCoreSearch Vision A/S · Storkøbenhavn, StorkøbenhavnView and apply
- Production Test Design EngineerINVISIO A/S · Storkøbenhavn, StorkøbenhavnView and apply
Latest jobs
New listings from Arbejd.com if you want to compare options.
- Pedagogical assistants for Hjerm Village Scheme (nursery and kindergarten)Struer Kommune · Hjerm, HjermView and apply
- EducatorStruer Kommune · Hjerm, HjermView and apply
- Study Board for Electronics and IT / Institute of Electronic Systems in Copenhagen seeks student study advisorsAalborg Universitet · København SV, København SVView and apply
- Deltidsjob - Container Crew 8-37 timerShipshark · Randers, RandersView and apply
- The Fox's Bar is seeking bartendersPilestræde 50 ApS · København K, København KView and apply
- Esthetician sought for Cosmetic Clinique in AarhusCosmetic clinique · Aarhus C, Aarhus CView and apply
- Preschool teachers wanted for Bårings Best Børnehus.Middelfart Kommune · Asperup, AsperupView and apply
- Danish teacher for the middle grades at Nyager SchoolRødovre Kommune · Rødovre, RødovreView and apply
Use the Arbejd app to move faster from listing to application
Save the job, tailor your CV, generate a targeted application, and practise the interview for this role.
AI application
Create a targeted application for this job
CV optimisation
Tailor your CV to the requirements in the listing
Job interview
Practise with questions tailored to the role
Job match
Find more jobs similar to this listing
Arbejd.com is built to make job searching easier and more effective.
AI Test Engineer
Sumary · 2200 Copenhagen