AI tool comparison checklist

Clear training / retention policy in writing Default off for private code?

Region / VPC / zero-retention option available Needed for regulated data

SOC2 / ISO (or equivalent) docs reviewed Security sign-off path

Works in our primary IDE / editor No forced IDE migration

Repo / multi-file context is usable Test on a real monorepo task

Diff / accept UX is safe No silent overwrites

Model can be pinned or selected Avoid surprise routing

Feature task completed with net time saved Score review burden too

Bugfix in unfamiliar code — useful Not just confident wrong

Multi-file refactor did not invent APIs Red-flag check

Follows house style / AI_RULES.md Add rules file if missing

Pricing shape understood (seat vs usage) Include agent / CI usage

Monthly spend alert configured Owner named

Offboarding / key revoke path documented SSO if required