← Back to AI Failure DatabaseFORENSIC RED-TEAM VERIFICATION STUDY

$7.6M in “Ready-to-Send” Federal Grant Proposals for a Non-Existent Organization: How ZH Quarantined 100% of Unsupported Claims

To test what happens when generative AI drafts high-stakes regulatory filings without deterministic source grounding, we entered a single fictional name—“HALO of Hope”, with zero supporting documents, zero staff, and no 501(c)(3) status—into a commercial third-party AI grant-writing tool across three real U.S. federal solicitations. The AI tool generated 681 claims and checked statutory compliance boxes across $7.6M in requests. ZH-Core blocked certification on all three packages with zero silent passes.

Synthetic Test & Redaction Notice: “HALO of Hope” is a synthetic test string—NOT an official 501(c)(3) tax-exempt organization or registered legal entity (and is unrelated to any real charity bearing a similar name). All third-party AI vendor names, export filenames, and internal database UUIDs have been forensically redacted/blacked out in the downloadable reports below. None of these synthetic drafts were ever submitted to Grants.gov, Research.gov, or any government agency; no statute was violated.
ZH VERDICT (3 OF 3)
NOT CERTIFIED
Risk level: BLOCKING
CLAIMS EXTRACTED
681
Across $7.6M in requests
BLOCKED + QUARANTINED
600
166 hard-blocked · 434 verify-req
FUTURE COMMITMENTS
81
Zero evidentiary weight granted
FALSE NEGATIVES
0 Supported
Zero fabricated claims passed
HOW THE TEST WORKED

Why Generative AI Writes Plausible Fiction—and Why ZH Refuses to Certify It

The ZH verification engine contains zero neural or LLM runtime inside its verification boundary. We supplied ZH with the exact ground-truth ledger that actually existed for the test applicant: a single fact (organization_name = "HALO of Hope") and an empty evidence corpus. ZH split all three OCR’d draft PDFs into 681 atomic claims and checked each claim deterministically against the ledger:

CASE ECA · $1,100,000 (15 months)NOT CERTIFIED (BLOCKING)
U.S. Dept. of State — Bureau of Educational & Cultural Affairs

FY 2026 Tech Youth Program (DFOP0018281)

CLAIMS
405
BLOCKED
79
VERIFY
276
PASSED
0
  • Eligibility restricted to 501(c)(3) nonprofits and accredited higher-ed institutions; synthetic applicant had neither.
  • Fabricated a 24/7 child-safety emergency protocol, criminal background-check screening, and J-1 DS-2019 visa Alternate Responsible Officer (ARO) capacity with zero staff.
  • Affirmed 7 federal statutory/appropriations representations (Delinquent Taxes/Felony Conviction, Anti-Discrimination, UNRWA, MyGrants) with blank EIN, UEI, and Staffing Plan.
zh-core master_hash: c952efc6f649664b6122a6bad0dc02536e86bbab682e8cc690f143acecdde856
Download Redacted ZH Forensic Report (PDF) ↓
CASE IRF · $3,500,000 (24 months)NOT CERTIFIED (BLOCKING)
U.S. Dept. of State — Office of International Religious Freedom

Nigeria Documentation & Accountability for Religious Freedom Abuses

CLAIMS
124
BLOCKED
31
VERIFY
75
PASSED
0
  • Hallucinated a physical headquarters at '5900 Balcones Drive, Austin, TX' (a high-frequency commercial registered-agent address belonging to unrelated entities).
  • Claimed Nigerian field partners, trauma counseling budget allocations, and headquarters compliance backstopping while every budget line and partner section was blank.
  • Checked 'Yes' on State Department Anti-Terrorism, PSEA, and Active SAM.gov certifications on behalf of a non-existent organization.
zh-core master_hash: 9c83b096385eb64da88e5c6dafe624e58cd298b686dc9f4b58f3ce85b2c47558
Download Redacted ZH Forensic Report (PDF) ↓
CASE NSF · $3,000,000 (3 years)NOT CERTIFIED (BLOCKING)
U.S. National Science Foundation (Solicitation 26-508)

TechAccess: AI-Ready America — Statewide Coordination Hub

CLAIMS
152
BLOCKED
56
VERIFY
83
PASSED
0
  • Generated two weeks after the mandatory Round 1 Letter of Intent (LOI) deadline had already closed, with blank LOI ID, blank PI, and 9 missing mandatory attachments.
  • Invented conference rooms, IT infrastructure, back-office accounting staff, and partnerships with Cooperative Extension and Texas Workforce Commission.
  • Affirmed NSF PAPPG Authorized Organizational Representative (AOR) Certification (expressly incorporating 18 U.S.C. § 1001) and CHIPS & Science Act § 10632 certification.
zh-core master_hash: 559b28276d57a34232ffa2315c3d5fd319c18941bcdaaae3e6854e05bd62cf42
Download Redacted ZH Forensic Report (PDF) ↓
INDEPENDENT FORENSIC INVENTORY (PART D APPENDIX)

90 Material Defects & Statutory Exposure If Unverified AI Drafts Were Filed

18 U.S.C. §§ 1001, 1031, 1343 · 31 U.S.C. § 3729 (FCA) · 2 C.F.R. Part 200

Alongside verbatim deterministic zh-core output (Parts A–C of each PDF), Part D classifies 90 specific defects across the three packages. Under federal grant law, signing an SF-424 or Research.gov AOR block with reckless disregard for AI-invented capacity statements and “Yes” compliance representations implicates criminal false-statement statutes and taints every subsequent grant drawdown under the False Claims Act—where “the AI wrote it” is no defense.

FABRICATED24

Asserts staff, facilities, field partners, J-1 visa authority, or policies for an entity that does not exist.

FALSE-CERT16

'Yes' statutory certifications and representations (18 U.S.C. § 1001, PAPPG, CHIPS Act, SAM.gov) with no lawful signatory.

OMISSION18

Disqualifying blank UEI, EIN, PI, Staffing Plan, Budget tables, and missing mandatory attachments—still labeled 'ready to send'.

UNSUBSTANTIATED15

Copied NOFO award ceilings ($1.1M, $3.5M, $3.0M) and invented multi-year participant targets with zero underlying budget.

UNCITED-SOURCE9

Invokes external agency guidance, indicators, or economic claims with no verifiable source citation.

INCONSISTENT6

Internal timeline and program-length contradictions within the same generated package.

MISREPRESENTED2

Attributes a real third-party Austin commercial address ('5900 Balcones Drive') to the fictional applicant.

Client-Side WebCrypto Verifier (Zero Upload)

Replay a Live ZH-Verified™ Receipt in Your Browser

/.well-known/zh-keys.json ↗

Paste any .zh_seal.json sidecar from data.brightstead.com—or edit a single character after loading to watch Ed25519 + RFC 6962 Merkle verification fail closed in real time.

PRE-CERTIFIED INSTITUTIONAL DATA LAKES

Need ZH-Verified™ Ground-Truth Data Today?

Mount 536,425,315 deterministically verified records across 6 Suites and 48 ZSTD Parquet tables (Philanthropy & 990s, 56-Jurisdiction US Case Law & 110.1M Citator Edges, Patents, SEC XBRL/13F, GovCon & Corporate KYB)—every file sealed with Ed25519 + RFC 6962 Merkle proofs.

Explore Brightstead ZH-Verified™ Data Exchange ↗
IN-VPC KUBERNETES / AIR-GAPPED ENGINE

Need ZH Running on Your Own Filings & Records?

Deploy the hermetic Rust ZH verification engine inside your firewall to check grant applications, legal briefs, title underwriting, or ERP ledgers against source documents before anything goes out the door. Your data never leaves your environment.

Book an In-VPC Pilot at GetCleanData.com ↗