11.13 Recommended rollout

  1. Pilot group. Create a group (for example AI Pilot) and turn the AI module on only there (section 11.7.1). Publish.
  2. Teach. Create a few clearly distinct types. Upload 20+ varied examples per type, in every language used. Train.
  3. Check the figures. type right ≥ 90 %, unrelated documents recognized ≥ 95 %, precision at 70 % high. Fix weak types before going further.
  4. Test documents. Run a handful of real, unseen files of each type — and a few that look similar but are not — through Test a document. Add misses as examples and false matches as counter-examples; retrain.
  5. Test mode. Create the rules from the AI page (they start in test mode at 70 %), deliver them to the pilot group, publish.
  6. Observe for one to two weeks. Review AI rule in test mode matched in the Audit Log and the AI Classification report. Upload wrong matches as counter-examples; retrain (expect a re-evaluation each time).
  7. Recommend. Turn test mode off with action Recommend. Watch kept / changed in the report — many changed suggestions mean the type or its label is wrong.
  8. Widen. Turn the module on for more groups.
  9. Warn or Enforce only for types whose precision at the chosen threshold is ≥ 95 % in the editor and confirmed in recommend mode. Consider a higher threshold (80–90 %) for enforcement.