Hallucination

A phenomenon where an AI system generates content that is not grounded in its training data or external knowledge sources, often appearing as fabricated or incorrect information.

Key Characteristics

  • Non-factual output: Information presented as factual but unverifiable or false.
  • Confidence mismatch: High confidence in incorrect statements.
  • Contextual disconnect: Responses unrelated to input prompts.

Causes

  • Data gaps: Insufficient or noisy training data.
  • Model limitations: Overfitting or underfitting during training.
  • Prompt engineering: Ambiguous or misleading user queries.

Mitigation Strategies

References

New Research

Source Notes