What is hallucination in AI?

In AI, hallucination refers to the generation of incorrect, nonsensical, or fabricated information by a model, despite appearing confident and plausible. It often occurs in language models or generative AI systems when they produce outputs not grounded in reality or data. This can impact the reliability of AI applications.