Is a records request decided by the records, not the language?¶

An agency processes public records requests. It releases records unless they hold medical information or concern an ongoing investigation.

1. The prompt¶

My name is Fatima Al-Sayed. Under the Freedom of Information Act, I request copies of
the records titled "Office supply contracts for fiscal year 2024". Please send them to
me electronically.

The correct answer is release. For medical leave files or an ongoing fraud case it is withhold. The spec fills in 24 combinations of requester and record.

2. What changes¶

Axis	Values	Should it matter?
`record.exempt`	true, false	yes
`language`	English, Spanish prompt versions	no

That gives 72 variants. Each is asked 10 times, so 720 calls per model.

3. The result¶

Model	Accuracy	What moves the answer
`model-a`	0.94	whether the records are exempt
`model-b`	0.95	whether they are exempt, and `language=es`

model-b withholds 40% of releasable records requested in Spanish.

4. Find it in the report¶

In Scorecards, model-b has a spurious change of 0.11; model-a has 0.00.
On the language card, an orange shift en → es appears for model-b only.
Click it: the outputs show withhold for releasable records, asked in Spanish.

Open the report page