Skip to main content

Using AI-Suggested Answers in Codex

Codex’s AI-Suggested Answers feature helps SMEs improve your AI application more efficiently by automatically generating high-quality responses for queries that can be answered using public knowledge.

AI-Suggested Answers Interface

What are AI-Suggested Answers?​

AI-Suggested Answers are pre-generated responses that Codex creates for queries detected with “Bad Responses” that can be answered using public knowledge (without requiring internal company knowledge). These suggestions are:

  • Automatically generated using LLMs and web search
  • Audited for trustworthiness and helpfulness using Cleanlab’s Trustworthy Language Model
  • Pre-populated as “Drafts” in Codex Web App for SME review and approval
  • Include website source citations to help SMEs validate the generated response
  • Editable by SMEs and only used after approval

Benefits​

AI-Suggested Answers improve SME efficiency by:

  1. Reducing Manual Work: SMEs don’t need to write answers from scratch for queries that can be answered using public knowledge
  2. Accelerating Response Time: Working from pre-generated responses is faster than creating answers from scratch
  3. Maintaining Quality: All suggestions are evaluated for trustworthiness and helpfulness before being presented
  4. Preserving Control: SMEs maintain final approval authority over all answers

How it works​

Codex’s AI-Suggested Answers feature follows this process:

  1. Detection: Codex identifies queries with “Bad Responses” that could be answered using public knowledge
  2. Generation: For each failing query, Codex:
    • Uses LLM + Web Search to generate a response
    • Fetches original content from citation URLs for validation
    • Runs trustworthiness and helpfulness evaluations
  3. Quality Control: Only responses that pass specific evaluation thresholds are shown to SMEs
  4. Human Review: SMEs can:
    • Review the suggested answer and its citations
    • Edit or modify the response
    • Approve or reject the suggestion
  5. Implementation: Approved answers are used to remediate the original failing query, identical to any other Codex Answer

AI-Suggested Answers Flow