AI Scorecard
A plain-language rubric to evaluate AI tools for libraries. If a vendor can’t answer these cleanly, that’s the answer.
Last updated: 2026-02-04
How to use this: For each category, you want a clear yes, written down. If you get hand-waving, “trust us,” or a price quote that changes after you sign, pause.
- Privacy
- Transparency
- Local control
- Equity & accessibility
- Bias audit
- Staff impact
- Patron benefit
- Reversibility
| Category | Questions to ask | Pass condition |
|---|---|---|
| Privacy | Is patron input logged, stored, or used for training? What exactly is retained, for how long, and by whom? | Must be YES for “session is wiped / no training” |
| Transparency | Can you explain how it works to a curious 10-year-old and a skeptical board member? What data sources does it use? | Must be YES for “plain-language disclosure” |
| Local control | Does data leave the library network? If it’s cloud-hosted, what are the exact data flows and subprocessors? | Must be YES for “we can control/limit data flows” |
| Equity & accessibility | Does this work for low bandwidth, assistive tech, and real-world patron support needs? What’s the accessibility statement and testing history? | Must be YES for “works for all patrons” |
| Bias audit | What bias testing has been done? Can we test it with our own scenarios? How do you handle hallucinations and harmful outputs? | Must be YES for “documented testing + mitigations” |
| Staff impact | Does this reduce staff workload without erasing roles? What’s the training plan? Who owns day-to-day triage when it fails? | Must be YES for “supports staff, doesn’t replace them” |
| Patron benefit | What is the patron-facing outcome? What is better for patrons on Monday, not just in a PowerPoint? | Must be YES for “measurable patron value” |
| Reversibility | Can we turn this off without breaking workflows? Can we export data and configurations? What happens at contract end? | Must be YES for “clean exit plan” |
Note: this is a starting point, not a substitute for your procurement process. If you’re evaluating a contract, get counsel.
Reuse this
If you want to copy this into your own policy, board memo, or vendor evaluation sheet, go for it. Just keep it plain and keep it written.