Totally agree, I tried to prototype this but the datasets to train ML summarizations from are pretty much all from news articles. Trying to take that model and summaries chats resulted in gibberish for me. The salient take-aways from Chats and other non-factual / loosely structured text seems so dependent on what you care about, summarisation is difficult.