News for hackers. Stuff that matters.
Re:MIT researchers use large language models to flag problem... by glutamate on Thursday August 15, 2024 @04:57AM (#41254198)
Colour me old-fashioned, but i am really sceptical about a zero-shot general-purpose LLM-based anomaly detector being able to outperform a trivial, not-obviously-wrong ML/statistical model calibrated on a small subset of the data that makes training extremely fast, in entirely new domains. And in anomaly detection, false negatives (and even false positives) can be very expensive.

The most promising role for LLMs in timeseries prediction is in extracting covariates from unstructured data, in the wind example, weather reports and geographically proximal social media posts.

Re:MIT researchers use large language models to flag problem... by thomashop on Thursday August 15, 2024 @05:02AM (#41254208)
You are skeptical about something that is explained quite thoroughly in the article. Did you read the article?

Edit: I meant they never claim to outperform SOTA domain-specific approaches. So, I don't know whose claim you are refuting.

Re:MIT researchers use large language models to flag problem... by glutamate on Thursday August 15, 2024 @05:06AM (#41254225)
> While LLMs could not beat state-of-the-art deep learning models at anomaly detection, they did perform as well as some other AI approaches.

I think one should also be sceptical about the current hype train