Your client's AI LQA report is creating unpaid work. Here is how to scope it.
A report can contain hundreds of suggestions and very few useful corrections. Make the hidden review work visible, agree what the client needs, and quote it before your margin disappears.
On this page
- The report arrives in seconds. Reviewing it becomes another job.
- Separate the work before you estimate it
- Make every decision traceable to the supplied report
- Price from observed effort, including the work around the edits
- Deliver a useful decision record, not another unexplained score
- Start with one report and an acceptance checklist
- Questions we hear
The short version
- Separate deciding whether a finding is valid from editing the translation and explaining the decision.
- Use a representative timed pilot to quote review effort. Word count and the number of edits miss important work.
- Keep original AI findings, human decisions and report versions linked so the client can inspect the result.
- Measure missed errors separately. Rejecting many false alarms does not prove that the system finds every real defect.
Separate the work before you estimate it
- Inspect the input
Confirm report version, finding IDs, source and target context, and the governing brief.
- Define the output
Agree which decisions, target edits and explanations the client actually needs.
- Time a mixed sample
Measure adjudication, corrections, explanation and escalation separately.
- Approve scope and cap
Agree price basis, limits, acceptance owner and the trigger for additional work.
- Finding adjudication: decide whether the supplied evidence supports the issue under the agreed requirements.
- Translation correction: change the target where a valid finding requires it.
- Dispute resolution: resolve disagreements about meaning, requirements or severity.
- Evaluation feedback: provide structured explanations or labels for a separately agreed system evaluation.
Ask whether a standard reason code is enough for an unsupported flag. A paragraph defending every acceptable translation adds a different level of effort. Reserve free text for cases that need it, and agree the rule with the client before review starts.
Also ask how the feedback will be used. A response can support an evaluation or a prompt change without becoming model training data. Establish the intended use and permissions rather than assuming that every correction automatically trains a model.
Make every decision traceable to the supplied report
Require a stable finding ID, segment ID, report version, source and target text, proposed category and severity, and the cited requirement. Include the relevant glossary or style-guide version. When the evidence is missing, record a blocked decision and request context.
Use a compact outcome set: valid; real issue with corrected category or severity; unsupported; duplicate; outside scope; blocked. Preserve the original AI entry alongside the human conclusion. The reviewer should not have to overwrite the original claim to correct it.
- Only accepted target edits remain visible.
- Rejected flags and their reasons disappear.
- A regenerated report cannot be reconciled reliably.
- Each finding retains its original content and human outcome.
- Reason codes explain routine decisions; complex cases retain notes.
- Corrections and unresolved dependencies remain linked to the report version.
Keep decisions attached to the file version they evaluated. If a client regenerates a report against a revised target, identify which entries genuinely match. A similar sentence or row position is not enough to carry approval forward.
Price from observed effort, including the work around the edits
Run a paid pilot on a mixed sample of categories, severities, explanation lengths and contextual difficulty. Avoid choosing only the first rows or only obvious false alarms. Track setup, reading, decisions, target edits, explanations and client questions separately.
Let reviewers correct timing records and exclude interruptions. An open page or a timer left running does not establish approved billable effort. The purpose is a usable estimate, not a ranking of linguists by clicks.
Use a range when reports vary. An hourly pilot with an agreed cap may fit uncertain input. A fixed fee becomes more defensible when report format, finding mix and required explanations are stable. Define how duplicates, blocked cases and regenerated reports affect that fee.
Include an approval checkpoint when the report differs materially from the sample. If the client wants a different output or supplies a new version, the PM should be able to pause and agree the change before the linguist absorbs it.
Deliver a useful decision record, not another unexplained score
- Review the evidence
Inspect source, target and the cited requirement before changing the text.
- Record the outcome
Keep the original finding, reason code, reviewer and file version together.
- Escalate unresolved cases
Give an accountable person the missing context or disputed decision.
- Export and reconcile
Return agreed edits and decisions, check totals, and close only resolved work.
The MQM Council's scoring guidance ties evaluation to project specifications, error types, severities and scoring parameters. Agree those inputs before a quality score becomes a commercial dispute. Preserve the configuration used for the evaluation.
Report valid findings, unsupported flags, duplicate entries and blocked cases separately. Define which outcomes enter any precision calculation. Do not turn the rejected-flag share into a claim about all errors in the translation.
Recall requires evidence about missed issues too. Inspect content outside the flagged list and have qualified reviewers establish the actual errors. A tool that reports nothing can look quiet while missing important defects. Compare quality and effort together.
For ways to improve the automated findings themselves, read AI translation quality assurance: fewer false flags. This article addresses the commercial and operational work that remains after a report arrives.
Start with one report and an acceptance checklist
- Identify the report and source/target versions.
- Agree the brief, glossary and scoring policy.
- Separate adjudication, edits, disputes and evaluation feedback.
- Choose standard outcomes and explanation requirements.
- Run a representative timed sample and agree a cap.
- Define how a revised report changes scope.
- Reconcile the decision export with supplied finding IDs.
- Keep unresolved cases visible until an accountable owner decides.
A spreadsheet may handle the pilot. Build a dedicated intake or review interface only when repeated imports, version conflicts or missing decision history cause measurable rework. Require a new interface to preserve the same decisions and export a usable result.
For a focused discovery call, bring an anonymized report format and the output your client requires. We can discuss where the handling work occurs and whether configuration, a small integration or a dedicated review step is justified. The first decision is what to improve and how you will measure it.
Questions we hear
Should an LSP charge for reviewing an AI LQA report?
Agree payment and scope before the work starts. Adjudicating findings, editing the target and supplying detailed model feedback create different workloads. A representative timed pilot helps establish a price basis. Whether review is already included depends on the actual client agreement.
Can we charge only for the words that change?
Changed words leave out reading, terminology checks, unsupported findings and explanations. A per-word price can still work when a pilot supports it and the scope is stable. Keep the underlying effort visible so a different report or source version triggers a review of the quote.
What proves that the new workflow is better?
Compare handling time, decision traceability, unresolved cases and quality on similar inputs. Review unflagged content to look for missed defects. Fewer alerts or a faster export alone does not establish that important errors survive or that the final translation meets the brief.