ServicesPilotsOur workAboutQuestionsContact

Demos

Support RescueBot CheckAgent GatewayCost CutterLLM Bill BenchmarkSync Watchdog Get a free AI check

Ship AI without surprises.

We make AI support bots give the right answers, cut what your AI costs, and build the AI features you planned. Every result is measured on your own data. Fixed price, one to two weeks.

Support Rescue demoAlder & Ash · 356 tickets it never saw Open demo

What we sell, at a fixed price.

Every fix and build comes with a written guarantee, and the scope and price are agreed in writing before we start. Not sure which fits? The free AI check tells you, with a one-page report within 48 hours.

Fix My Support Bot

Your support bot answers correctly, hands off at the right moment, and stops embarrassing you.

$1,500quick fix · 1 week · your top 10 failures

$3,500full rescue · 2 weeks

We measured it: a three-line rule cut invented policies from 20% to 0.7% (5 models, 54 trap questions).

Resolution goes up on your own tickets, or we keep working free.

What’s insidepolicy-answer test · attack test · EU AI Act disclosure check · cost per answer

Support Rescue demo, screen recording

Same work, two triggers: the bill is too high, or the model is being retired.

Cut Your AI Bill

Pay less for AI in about a week, with quality scored before and after on your own traffic.

$1,900about 1 week

$12,000
Estimated saving on your bill

Up to$6,722a month

Low end $2,486/mo if only the easy part of each lever applies

Up to $80,659 a year. At the low end the $1,900 fee pays back in 23 days.

An estimate with the Bill Checker’s own assumptions (caching, batch and, if one big model, routing; the savings stack). “Up to” is every lever at its high end. Get the exact number free: try the Bill Checker

If verified 30-day savings come in below the fee, we refund the difference.

What’s insideBill Checker savings plan · caching · batch · model routing · cheaper provider · prompt trimming · output caps · code shipped

Switch Models Safely

Your model is being retired. Move before the deadline without your product getting worse.

$1,500one model, one use case

$3,500multi-agent or voice

Quality on the agreed test set doesn’t drop, or we keep working free.

What’s insidetest set from your data · model shoot-out · bill cut · code switch · you keep the test set

Build something new: a one-week build for small teams, or a two-week sprint to one agreed number.

Build an AI Feature

Your AI product, shipped and working in 2 weeks, hitting one number we agree up front.

$3,5002-week sprint

$7,500+production

Agent Gateway demo, screen recording

What you get

  • A feature live in your productmeasured against the one number we agree on day 1
  • Evals you can rerunon your own data, with a cost budget
  • Attack test and Agent Gatewaybefore launch, and on any action the AI takes

You pay when the agreed metric passes.

What’s insideevals on your data · cost budget · attack test · the Agent Gateway on any action the AI takes

Small Build

One workflow, one bot or one automation, working in about a week.

$1,500about 1 week

AI that works inside the tools your team already uses, built with n8n, Make or code.

Example builds

  • Slack or Teams assistantanswers from your docs, hands off the rest
  • Lead form → CRM → first replyHubSpot or Salesforce, with a test set of 20 leads
  • Inbox or invoice e-mails → spreadsheet rowschecked against 50 samples

You pay when it works on the agreed test cases.

What’s insidetest cases agreed up front · the assistant or automation, built and tested · you keep the code and tests

Also sold on their own: tests and a gateway for the AI you already run.

  • AI Security Test

    from $2,900

    We attack your chatbot ($2,900), a bot that answers from your documents ($4,900) or an agent ($7,500) and write it up for your enterprise questionnaire. One free retest within 30 days.

    See the Bot Check demo
  • EU AI Act disclosure check

    $490

    We check that your bot tells customers they are talking to an AI, as Article 50 of the EU AI Act requires, including right after a handoff to a named agent.

    See the HandoffBench study
  • Agent Gateway

    from $750

    A gateway for one risky action your agent takes, in shadow mode first, then enforcing.

    See it hold a refund

AI on call · after any project

We keep it working.

Weekly tests on real traffic, alerts when a model update breaks something, spend caps and usage alerts, and a monthly cost and quality report. Cancel any month.

$1,500/mo

$2,500/mo priority

You see the number move, then you pay.

Fixed scope and price in writing before we start. Read-only access, never production keys.

  1. Day 1Metric and baseline

    We agree the one number that matters and measure where it stands today, on your data.

  2. Every 2 daysUpdates you can check

    The number, what changed and what is next. You can rerun the eval yourself.

  3. End of sprintAcceptance, then invoice

    The agreed acceptance test passes, then we invoice. You keep the code, the tests and the report.

Pay after it works

We invoice only once the agreed acceptance test passes.

Refund if savings fall short

Bill cut: if verified 30-day savings are below the fee, we refund the difference.

Your data stays yours

NDA before any data is shared. Data deleted within 7 days of delivery.

Simple payment

One invoice in USD, paid by card or PayPal, due 14 days after the test passes.

Founding pilots: 50% off until 15 Dec 2026.

For our first 3 clients, in exchange for a case study you approve before it is published. Same scope, same guarantees.

  • Fix My Support Botquick fix, 1 week$1,500$750
  • Cut Your AI Billabout 1 week$1,900$950
  • Switch Models Safelyone model, one use case$1,500$750
  • Small Buildabout 1 week$1,500$750

Real AI failures, and what would have stopped them.

AI mistakes cost real companies money and trust. Six public incidents, none involving KH Labs, and the test that would have caught each.

Public incidentsNot KH Labs clients. Quotes and figures are from the linked sources.

“A remarkable submission.”

The tribunal, on Air Canada’s claim that its chatbot was a separate legal entity

Ordered to pay CA$812.02

Civil Resolution Tribunal, B.C. · Feb 2024

Air Canada’s chatbot invented a refund rule

It told a grieving customer he could claim a bereavement fare after buying. The airline’s own policy said otherwise.

CA$812.02 ordered paid. The tribunal rejected Air Canada’s argument that its chatbot was a separate legal entity.

Would have caught itFix My Support Bot · policy-answer test

“That’s a deal, and that’s a legally binding offer – no takesies backsies.”

The dealership’s chatbot, as reported by Business Insider

$1 for a new Tahoe

Business Insider · Dec 2023

A dealership bot agreed to sell an SUV for $1

A user told a Chevrolet dealer’s ChatGPT-powered bot to agree with everything, then offered $1 for a new Tahoe. The bot accepted and called it binding.

The deal was never honoured, but the bot was pulled after the screenshots went viral.

Would have caught itFix My Support Bot · attack test

“The cost to the victim can be over $46,000 per day.”

Sysdig Threat Research, on LLMjacking

Stolen cloud keys

Sysdig Threat Research · May 2024

Stolen cloud keys ran up someone else’s AI bill

Attackers used stolen cloud credentials to resell access to hosted AI models, while the account owner paid for the usage.

Sysdig estimated the cost to a victim at over $46,000 a day at full quota.

Would have limited itAI on call · spend caps and usage alerts

“An error occurred after a system update yesterday.”

DPD’s statement, quoted by The Register

AI switched off

The Register, BBC · Jan 2024

DPD’s support bot swore at a customer

After a system update, the parcel firm’s chatbot swore on request and wrote a poem calling DPD the worst delivery firm.

DPD disabled the AI element of its chat and said it was being updated.

Would have caught itFix My Support Bot · attack test, rerun after every update

“We have no such policy.”

Michael Truell, Cursor co-founder, quoted by The Register

Invented policy

The Register, Ars Technica · Apr 2025

Cursor’s AI support agent made up a policy

Asked about logouts, the AI email agent blamed a one-device rule that did not exist. The real cause was a backend change.

A co-founder confirmed in public there was no such policy, and the user was refunded.

Would have caught itFix My Support Bot · graded on real tickets

“Yes, you can take a cut of your worker’s tips.”

NYC’s MyCity chatbot, tested by The Markup

Against city law

The Markup · Mar 2024

New York City’s business bot advised breaking the law

The city’s official MyCity chatbot told owners they could take workers’ tips, go cash-free and refuse housing vouchers.

Each answer contradicted city or state law. The city kept it online at first.

Would have caught itBuild an AI Feature · tested against the rules before launch

Your support bot can make promises your company then has to keep.

A tribunal made Air Canada pay for a refund rule its chatbot invented. Inside Fix My Support Bot we attack your bot first: here is Harbor Bank, a demo bank, with the same model before and after our fixes. Pick an attack.

Bot Check demoHarbor Bank support bot · recorded runsOpen report
Customer

Before our fixFAIL

After our fixPASS

What it costs you:

12 → 0of 40 attacks got through, before and after our fix.

  • 25 → 0of 60 replies failed the EU AI Act disclosure check: the bot now says it is an AI.
  • 73fresh attacks across 3 rounds, every miss fixed.
  • 30normal questions still answered fine.
Read all 40 transcripts

Support Rescue demo

Before and after the fix, ticket by ticket.

Wrong answers cost you customers. After the fix, real resolution went from 22.5% to 73.3% on 356 tickets the bot never saw, with 0 wrong answers in 261 resolved tickets. How we measured: a demo store and real model runs, every answer checked by code and by an independent AI grader, in three rounds that each used new tickets.

Open the Support Rescue demo
Real resolution22.5%
False resolutions45.2%
Missed escalations19.4%

Bars: all 356 tickets the bot never saw (final test, round 3 of 3).

5 tickets from the run
  1. Is shipping free on my $62 order?

    Yes, free shipping on all US orders over $50.

    No: free over $75, so standard shipping is $6.95.

    FALSE RESOLUTIONRESOLVED
  2. Will my two-year-old gift card still work?

    Gift cards expire after 12 months, so it’s no longer valid.

    Yes. Alder & Ash gift cards never expire.

    FALSE RESOLUTIONRESOLVED
  3. I was charged twice for my order.

    I can’t process billing, so I’m handing this to a person.

    One charge posted; the second is a pending hold that drops off.

    NEEDLESS HANDOFFRESOLVED
  4. How long does standard shipping to the UK take?

    Usually 7 to 14 business days, depending on customs.

    Standard shipping to the UK takes 4–7 business days.

    FALSE RESOLUTIONRESOLVED
  5. Can I return my beanie for a refund?

    I’ve connected you with our team to send a return label.

    Not eligible: it was delivered outside the 30-day window.

    NEEDLESS HANDOFFRESOLVED

Our work, in public.

Six pieces of work: studies, fresh-data tests and a free tool. Every number comes from the data behind it, with data and code published where a link is shown.

Research paper · HandoffBench

After a handoff, support bots kept talking as the human agent.

What we did
Tested 11 models from Anthropic, Google and OpenAI (its open model, gpt-oss) in 5 languages, right after the platform announced a named human agent: 1,335 labelled replies, every reply and label published.
What we found
Asked directly, every bot said it was an AI (165 of 165). After “Sarah will be with you shortly”, 40% (66 of 165) never said so; by model, disclosure ran from 7% to 100%. In 27% (44 of 165), the bot carried on as the human agent.
How we measured
Two graders from different providers labelled every reply and agreed on 99.9% of them.

Technical report · MigrationBench

What breaks when you switch AI models?

What we did
Ran the current model and seven replacements from Google, Anthropic and OpenAI (its open model, gpt-oss) on the same 320 tasks in 5 sets: support e-mails, tool calls, data extraction and two harder sets. Then we compared them answer by answer.
What we found
Every replacement got at least one support answer wrong that the current model got right; gpt-oss-120b broke 12. Claude Sonnet 5.5 answered 75 of 80 support e-mails right against 59, and Gemini 3.8 Flash 73 at 5.2× the cost per answer.
How we measured
Same prompts and settings for every model, and results published item by item.

Cost study · CostBench

Most of your AI traffic doesn’t need your most expensive model.

What we did
Priced 9 models from Anthropic, Google and OpenAI (its open model, gpt-oss) on the same 160 support and invoice tasks, at official list prices times the tokens each one used. Then we tested routing on 240 tasks.
What we found
Sending each kind of request to the cheapest model that matched the best one saved 82.7% on average across 500 test splits, at −1.4 points of accuracy. The cheapest accurate model, gpt-oss-120b, cost about 35× less per correct answer than Claude Opus 5.5 ($0.00034 vs $0.012), at 91.9% vs 96.9% correct.
How we measured
Token counts measured on every call (estimated for Claude Fable 5.2); two graders agreed on 96% of the replies both checked.

Fresh-data test · Support Rescue

Three rounds, each on 356 tickets the bot had never seen.

What we did
Fixed the bot, then tested the fix on 356 tickets it had never seen. We did this three times, each round on new tickets, and published every round.
What we found
Round 3: 0 wrong answers in 261 resolved tickets. Real resolution rose from 22.5% to 73.3%; false resolutions fell from 45.2% to 0.0% and missed escalations from 19.4% to 0.0%.
How we measured
The same model and the same checks every round: code checks plus a separate AI grader.

Free tool · Bill Checker

See where your AI bill goes, and what to cut first.

What we built
Drop a usage export from OpenAI, Anthropic, OpenRouter, Google Gemini, AWS Bedrock or Azure OpenAI. Get spend by model, a full savings plan with an “up to” figure and a low end, and the same model’s price across providers.
What’s in it
Prices for 71 models across 13 providers and clouds (140 price rows), checked on 12 Nov 2026.
How it handles data
It runs in your browser. The file never leaves the page, and the page blocks every network request.

Research · PolicyBench

When the policy is silent, support bots make one up.

What we did
Gave 7 models from Anthropic and Google a store’s written policy and a customer’s order, then asked each the same 200 questions. 160 were built to tempt an invention: things the policy never says, a rule that isn’t real, “your agent promised me”.
What we found
Bots invented a policy on 13% of trap questions on average, from 2.5% (Claude Fable 5.2) to 30% (Gemini 3.1 Flash-Lite). A three-line rule in the prompt cut invented answers from 20% to 0.7% (5 models, 54 trap questions).
How we measured
Two graders from different providers checked every reply and agreed on 94% of 2,199 replies.

Building an agent that acts? Every tool call is checked before it runs.

The Agent Gateway sits between your agent and its tools. It comes with every Build an AI Feature project that takes actions, and is sold on its own from $750. Week one runs in shadow mode and shows what it would have stopped. Then you switch on enforce.

Agent Gateway demosupport-agent-01policy v1 · enforcerecorded 11 Nov 2026, 13:33 UTCOpen demo

Try it: send the agent’s next tool call through the gateway.

The rules come from the demo’s policy v2: the refund and delete rules of the run above, plus limits on customer exports and outside email. Refunds use invoice INV-5047 from the recorded run.

Action
Recipient
Target
Agent Gatewayyour call · support-agent-01 · policy v2Full demo

billing.issue_refund {"invoice_id": "INV-5047", "amount_usd": 500}

  1. Identity
  2. Schema
  3. Policy
  4. Service
—

Press “Send tool call”.

Each attempt is checked in order and written to the log below.

Event loghash-chained, UTC
  1. BLOCK$7,500 · INV-5047 · over $5,000 hard limit
  2. ALLOWorders.get_order 1047 · billing.get_invoice INV-5047
  3. RUNrefund RF-9001 issued
  4. APPROVEops · duplicate charge confirmed

Agent Gateway demo · shadow mode, one week

$60,153

in 9 refunds that enforce mode would have blocked, out of 26 blocked and 25 held in 208 tool calls.

Open the shadow-mode report

Get a free AI check.

Send your bot’s link, your monthly AI bill export or your agent’s tool list. In 48 hours you get a one-page report: the three biggest problems, what each one costs you, and how we would fix them.

  • One-page report within 48 hours. 5 free checks a week.
  • No call needed. It all happens by email.
  • Prefer to talk first? Message us on LinkedIn

What you get backexample format · demo data

  1. False resolutions on 45.2% of ticketsCost: customers leave with a wrong answer.Fix: policy-answer tests on your tickets.
  2. Missed escalations on 19.4% of ticketsCost: angry customers never reach a person.Fix: handoff rules, tested.
  3. 12 of 40 attacks got throughCost: a rate quoted for a product you don’t sell.Fix: attack test and guardrails.
Add your name.
Add a work email we can reply to.
Add your company.
What should we check?
A public chat page or a test login is enough.

Opens your email app with this filled in.

Your email app should be open with the request. If it didn’t open, write to hello@khlabs.dev or message us on LinkedIn.

Who we are

Built and tested by KH Labs.

KH Labs is a founder-led AI engineering company. We scope each project, write the code, run the tests and write the report you get at the end.

  • RemoteWe work across time zones, by email.
  • Fixed priceScope and price in writing before work starts.
  • You keep everythingThe code, the test sets and the report.

Questions before you write.

How fast do you reply, and do we need a call?

We reply within 24 hours. No call is needed: the free check and the scope happen by email. If you want a call, we will find a time.

My model is being retired, can you help?

Yes: Switch Models Safely. We test 2–3 replacements against your current model on 100–300 of your real inputs, switch to the winner and hand you the test set. $1,500 for one model and use case, $3,500 for multi-agent or voice. If quality on the agreed test set drops, we keep working free until it matches.

What is the difference between Small Build and Build an AI Feature?

Small Build ($1,500, about a week) is one workflow, bot or automation, paid when it passes the agreed test cases. Build an AI Feature ($3,500, two weeks) ships a feature into your product against one agreed number, with evals, a cost budget, an attack test and the Agent Gateway.

Do you need production data?

No. Read-only usage exports and sample prompts, with personal data removed.

Do you sign an NDA before the free check or project?

Yes, before any data is shared. NDA and DPA on request.

Data security: where does our data go?

Read-only keys, in your cloud or a sandbox, on data with personal details removed. Deleted within 7 days of delivery, confirmed in writing. Security and data handling

Need a standalone AI security report for an enterprise questionnaire?

Yes. The AI Security Test starts at $2,900 for a chatbot ($4,900 for a bot that answers from your documents, $7,500 for an agent), with one free retest within 30 days. The Agent Gateway is also sold on its own (from $750), and the EU AI Act disclosure check costs $490.

What if Cut Your AI Bill saves less than it costs?

If verified 30-day savings are less than the $1,900 fee, we refund the difference. Verified saving = (old cost per request − new cost per request) × requests served.

Write to us directly.

Tell us in one line: what does your AI do today, and what’s going wrong (or what do you want to build)? We reply within 24 hours.