Simply AskingDocs

Using Analytics to Improve Knowledge Quality

Read your RAG quality metrics, identify weak areas in your knowledge base, and take targeted action to improve search and answer quality.

This guide is for admins and owners who want to understand their knowledge base health through data. You will learn how to read quality metrics, spot weak areas, and take targeted action to improve search and answer quality.

What you will accomplish: Read your RAG quality metrics, identify weak areas in your knowledge base, and take targeted action to improve search and answer quality.

1

Open the Analytics Dashboard

Analytics is your central hub for understanding how well your knowledge base is performing across retrieval, answers, and query trends.

Navigate to Analytics from the Intelligence menu in the header.

1

Understand Retrieval and Answer Quality

RAG quality metrics tell you how effectively your system finds relevant documents and synthesizes accurate answers.

Check retrieval quality: are the right documents being found when users search or ask questions?

Check answer quality: are synthesized answers accurate and complete?

Check the grounding rate: what percentage of answers cite their sources? Higher grounding means more trustworthy answers.

1

Spot Where Your KB Needs Work

Use the metrics to pinpoint specific areas that need attention.

Look for low coverage scores in specific topics. These indicate missing content.

Check for declining freshness in certain departments. Outdated content leads to inaccurate answers.

Identify high search failure rates for specific query types and entity clusters with few connections.

For each weak area you identified, choose the right resolution.

Low coverageUpload more content on the underserved topic.
Stale contentReview and update outdated documents.
Poor extractionRe-process documents or improve document quality (use text-based formats).
Fragmented graphMerge duplicate entities or add connecting documents that bridge topics.
1

Measure Your Progress

Analytics are most valuable when tracked consistently over time. Make it a habit.

Check analytics weekly. Compare current metrics to previous periods to spot trends.

After taking action on a weak area, revisit the metrics the following week to verify improvement.

Celebrate progress. Even small improvements compound over time into significantly better knowledge quality.

Pro Tip: Don't try to fix everything at once. Pick the one metric that matters most this week and focus on it. Next week, pick the next one. Consistent small improvements beat sporadic big pushes.

Now that you understand your analytics, the next step is to set up private departments to organize your knowledge base by team and control access at a granular level.

Was this helpful?