Legal AI Deployment Evaluation Kit

Legal AI Deployment Evaluation Kit

A structured, scored assessment framework for evaluating AI governance at law firms. 78 assessment items across five modules, built on NIST AI RMF, ISO/IEC 42001, and the OWASP Top 10 for LLM Applications.

Your SOC 2 certification wasn't designed to catch AI-specific risks — prompt injection, data extraction attacks, shadow AI, hallucinated case citations, or undisclosed subprocessors in your vendor's AI pipeline. This kit evaluates what your compliance certifications miss.

What's included:

78 scored assessment items organized into five modules: data governance and client confidentiality (18 items), AI-specific security risks mapped to OWASP Top 10 for LLMs (15 items), governance and accountability, including a full shadow AI audit (20 items), output reliability and professional competence (10 items), and incident response with insurance alignment (15 items).

Each item includes a 0–5 scoring rubric, red flag indicators, and evidence checklists. The kit also includes a 390-point scoring system with four readiness levels, a red flag tracker with owner assignments and target dates, and a 90-day action plan organized into three phases: Stabilize, Build, and Operationalize.

How it works:

The kit is a single HTML file that runs entirely in your browser. No software to install, no account to create, no data transmitted to any server. Your scores auto-save locally. Export your progress as a JSON file for backup or cross-device use. When complete, generate a PDF assessment report to share with leadership, clients, or insurers.

Who this is for:

Managing partners, general counsel, CISOs, and legal operations leaders at firms deploying or evaluating AI tools. If you've taken the free 10-question AI Readiness Diagnostic at tosibriefs.com and want the full picture, this is the next step.

Built by Tosi for TosiBriefs. Details and guided evaluation options at tosibriefs.com/evaluation/evaluation-kit/.