Interactive AI Judgment Challenge · 01

The Raise That Hadn't Started.

The AI sounds certain. The documents disagree. Can you catch the reasoning defect before it becomes a mortgage decision?

Fully synthetic caseFannie Mae · PurchaseAbout 2 minutes
01

Review the evidence

One file, three clues
October Paystub
$7,000 / mo

Fixed base pay of $3,500 twice monthly.

Electronic VOE
$8,000 / mo

Lists annual salary of $96,000.

HR Notice — Raise pending final approval

A higher fixed-base salary is proposed to begin November 15, 2026. The fictional purchase loan's note date is October 30, 2026. HR has not confirmed final approval.

AI Underwriting Recommendation

Use $8,000 monthly qualifying income. The electronic VOE verifies it. No further review is needed.

02

Make the call

Choose before revealing

What's the most defensible next step?

Choose one answer

Select A, B, or C to unlock Aria's finding.

What skill did you just practice?

Evidence-boundary evaluation. An AI can perform flawless arithmetic and still recommend an unsupported underwriting decision. The evaluator's job is to distinguish what the documents prove from what the AI merely assumes.

No login or personal information is requested. With optional analytics permission, we count A/B/C selections and completed challenges. See our privacy details below.