Hallucination

Hallucination refers to instances where the model produces outputs that are factually incorrect or not grounded in reality, despite sounding plausible.

  • Published on: August 17, 2024
  • Updated on: August 17, 2024

Meaning

When an LLM generates factually incorrect or fabricated information despite sounding plausible.

Definition

Hallucination in LLMs refers to the generation of outputs that, while often sounding plausible, are factually incorrect or entirely fabricated.

This phenomenon occurs because the model, while powerful, lacks true understanding and sometimes fills in gaps with misinformation or errors, leading to potentially misleading results.

Example

An LLM might confidently assert a false historical fact, such as stating that a famous figure was born in the wrong year, despite having no basis in reality.

Related Items

Discover more related items.

What is Parameter?

Parameters are the weights and biases in a neural network that the model adjusts during training to minimize error in predictions.

Learn More

What is Chain-of-Thought (CoT) Prompting?

This technique prompts the model to articulate its thought process step-by-step, leading to more accurate and transparent outputs.

Learn More

What is Prompt Engineering?

Prompt engineering involves designing the input queries to guide the model's output effectively, often enhancing the relevance and accuracy of responses.

Learn More