"hallucinations" CAN'T fade away. They are the one and only thing LLMs can do. If you remove that your output would be absolutely nothing. It is intrinsic to how they work. Anyone claiming they can eliminating has a bridge to sell you.