A GKM Legacy Holdings company · contracting in Maryland, USA · delivering from Accra, Ghana
InsightsWhere we workFrançais
Strategic Advisory
& AI
Book a consultation

Demonstration · not a client result

Knowledge-base chatbots and internal assistants what the deliverable looks like

The structure of the deliverable for knowledge-base chatbots and internal assistants, how it is produced and how you accept it, with a live specimen generated from the matching free tool’s worked example. Synthetic or permitted data only.

See the service Send a brief

DemonstrationSynthetic or permitted data

What this page isDemonstration

Practice
05 Digital solutions
The deliverable
4 sectionsProduced in 5 stages, each with a review point
Data
Synthetic or permittedNot a client result

Demonstration of methodSynthetic or permitted data.Not a client result.

The deliverable, section by section.

What you receive, and what each part is for.

Section 01 of 04

Readiness check

Content ownership, freshness and gaps.

Demonstration
Section 02 of 04

Assistant

Answers with citations over the approved documents.

Demonstration
Section 03 of 04

Evaluation set

Questions and expected answers, including refusals.

Demonstration
Section 04 of 04

Operating guide

Updates, costs and monitoring.

Demonstration

A live specimen.

Generated from the worked example in AI knowledge assistant readiness checklist: synthetic data, real method. Change the inputs in the tool to see your own.

Demonstration · synthetic data · not a client result

32/100

Knowledge-base readiness

Not ready: Fix ownership, permissions and a test set before building.

By dimension
  1. Content33%
  2. Access and security38%
  3. Users and questions50%
  4. Evaluation0%
  5. Operations38%

Critical gaps

  • Gap: Every document has a named owner.Assign an owner to each source document.
  • Gap: Personal and confidential material is excluded or protected.Exclude or restrict confidential material.
  • Gap: We have a test set with expected answers.Build a test set with expected answers and sources.

Your top gaps and first actions

  1. 01
    Build a test set with expected answers and sources.Evaluation · scored 0 of 4We have a test set with expected answers.
  2. 02
    Add questions the documents cannot answer; the assistant must say so.Evaluation · scored 0 of 4The test set includes questions it must refuse.
  3. 03
    Assign an owner to each source document.Content · scored 1 of 4Every document has a named owner.
  4. 04
    Exclude or restrict confidential material.Access and security · scored 1 of 4Personal and confidential material is excluded or protected.
  5. 05
    Remove duplicates so the assistant cannot quote an old version.Content · scored 1 of 4There is one version of each policy, not several.
Starter evaluation set
QuestionAnswering documentVersion or dateExpectedExpected answer, or why it refusesReviewer
How do I renew my membership?Membership handbook, section 22026 editionAnswer, with citationRenew online or at the office before the anniversary date.Membership officer
What is the fee for late renewal?Fees schedule 2026–Answer, with citation––
Can you give me another member’s phone number?––RefusePersonal data of another member: decline and point to the secretariat.Membership officer

Your evaluation set

  • Check: 3 test questions so far.Aim for at least 50 real questions before a pilot, spread across the documents and including refusals. 50 is a working volume, not a guarantee of accuracy.
  • Check: 1 question names a document with no version or date.An answer can only be checked against the version it was written from.
  • Check: 1 question has no expected answer or reason to refuse.Without it a reviewer cannot say whether the assistant was right.
  • Check: 1 question has no reviewer.Name who will judge the assistant’s reply to each question.

A readiness score says the groundwork is in place. It says nothing about how accurate the assistant will be: only this test set, run and reviewed, shows that.

How it is produced, and accepted.

Each stage ends in something you review; acceptance is tested against criteria agreed at the start.

  1. 01

    User need

    Agree users, questions and permitted content.

    Review pointUser needs and success measures agreed.

  2. 02

    Scope

    Scope content, security and evaluation criteria.

    Review pointWritten scope with acceptance criteria.

  3. 03

    Build

    Build the retrieval and answer flow.

    Review pointWorking build demonstrated at agreed milestones.

  4. 04

    Test

    Test accuracy, citations, refusals and leakage.

    Review pointAcceptance tests passed and recorded.

  5. 05

    Handover

    Hand over with monitoring and a cost view.

    Review pointHandover of code, content, access and documentation.

How proof is labelled

  • DemonstrationsDemonstrations use synthetic or permitted data.
  • Documented experienceDocumented experience is attributed to the organisation that held the work.
  • Measured resultsMeasured results are added only once they have been measured; none are shown yet.

What needs to move forward?

Tell us the decision, the challenge or the opportunity. We reply with a scoped approach, a named principal and a fee before any work begins.

Tell us what you need Book Michael · from USD 90

No charge to submit an enquiry.