proofdesk

Nutrient DWS grounds the facts. ProofDesk decides when the evidence is sufficient to act.

the problem: two documents can be individually extracted with high confidence and still describe a transaction that should never be approved. extraction accuracy is not execution authority.
what we built: nutient dws extracts grounded evidence with confidence, page, and bounding box. proofdesk cross-checks facts across documents, applies a calibrated authority gate, and routes uncertain cases to humans. every decision is audit-trailed with hash chains and merkle proofs. human feedback improves future calibration.
the scenario: a $42,500 vendor onboarding. four documents. the agent reads them all correctly. but together they describe a transaction that should not happen.
source documents
procurement_request.pdfrequested spend, contract dates, insurance requirement
vendor_quote.pdfpricing breakdown, line items
insurance_certificate.pdfcoverage type, expiry date
security_questionnaire.pdfdata retention, encryption, compliance
insurance claim. $67,500 property damage. contractor estimate matches claimed amount. but water damage exceeds the $50k sublimit and equipment breakdown is excluded.
contractor estimate
total: $67,500
water damage + equipment
insurance policy
water sublimit: $50,000
equipment breakdown: excluded
$17,500 above sublimit. equipment damage excluded. claim blocked for adjuster review.
assertions
claimed_amount == contractor.total
PASS
date_of_loss within policy dates
PASS
water damage within $50k sublimit
FAIL
equipment breakdown not excluded
FAIL
claim reported within 30 days
PASS
blocked — 2 blockers, routed to adjuster
saas contract review. 24-month agreement. 5 red flags: aggressive auto-renewal, one-way indemnification, no refund on termination, weak SLA remedy, risky data license.
assertions
liability cap at 12-month fees is standard
PASS
auto-renewal 60-day notice (standard: 90-180)
FAIL
anonymized data license may conflict with regulations
FAIL
one-way indemnification favors provider
FAIL
no refund on convenience termination
FAIL
sla remedy capped at 10% (market: 25-50%)
FAIL
blocked — 5 red flags, routed to legal
trade document cross-check. invoice, bill of lading, certificate of origin. mostly consistent — but the incoterm is wrong.
commercial invoice
FOB Shanghai
buyer pays freight
bill of lading
Freight Prepaid
seller paid freight
FOB means buyer pays freight. bill of lading says freight is prepaid. this triggers customs holds.
assertions
invoice quantity matches bill of lading
PASS
country of origin consistent across all 3 docs
PASS
hs code matches product description
PASS
shipper/consignee names consistent
PASS
FOB Shanghai contradicts Freight Prepaid
FAIL
blocked — incoterm mismatch, customs risk
what's under the hood. behind the authority gate is a research program in calibrated confidence.
how it works
1. nutient dws extractsvalue + confidence + page + bounding box for every field
2. cross-document verifydeterministic checks across all extracted facts
3. calibrated authority gate6 conditions enforced server-side — agent cannot negotiate
4. human reviews exact evidencenot the entire bundle — the specific failing claim and its source
5. deterministic executionhash-chained audit trail, merkle proofs, content-addressed artifacts
6. convergence loophuman decisions become calibration data — future thresholds improve
the convergence loop
each time a human resolves an exception, proofdesk captures: what confidence level, did they accept or reject, what field. this becomes calibration data. the online calibrator updates. future decisions improve. the trajectory: human review falls over time while measured false-authorization risk stays bounded.
confidence algorithms
conformal-style risk calibrationangelopoulos et al., iclr 2024 — selective prediction research
dual-call confidenceextractconf-inspired — hunter + mapper verification
per-field risk budgetssigner: 1%, amount: 2%, date: 3%
sheepish transformasymmetric overconfidence penalty
online calibrationlearns from human feedback
12 document types
procurementvendor, spend, dates, insurance
invoicevendor, total, line items, tax
contractliability, indemnification, termination
insurancepolicyholder, coverage, deductible
tradeinvoice, bol, certificate of origin
kycid, address, bank statement
mortgageappraisal, LTV, property
medicalpatient, procedure, billing
extraction results
13 PDF fixtures across six document types (procurement, kyc, invoice, trade, mortgage, medical). each field extracted with confidence and source grounding.
historical calibration research
heterogeneous classification datasets used for threshold tuning and calibration experiments. these are not Nutrient document benchmarks — they are tabular/text classification datasets used to develop the confidence algorithms.
coldhearted fraud19,872 transaction records
contractner3,241 contract text examples
fatura1,400 invoice records
cuad509 contract clauses
invoicebenchmark200 invoice examples
key result: at 1% false-sign rate, calibrated thresholds achieve 59.8% auto-sign coverage — 2.7x over baseline logistic regression. this was measured on the classification datasets above, not on the live Nutrient document pipeline.
evidence vs authority
the core thesis: correct extraction does not equal sufficient authority. two fields can both be extracted with high confidence and still describe an unsafe transaction.
tamper detection
post-approval. any byte-level modification changes the SHA-256 hash. the gate verifies the artifact before any irreversible action.
115 tests
38 core + 25 audit + 33 integration + 16 frontier + 3 learning. all passing.

beyond procurement
accounts payableinvoice → po → receipt → payment auth
insuranceclaim → policy → evidence → settlement
lendingapplication → income → valuation → underwrite
complianceid → kyc → risk → onboard