Re:Hacker News Activity Analysis with GPT-4 Agent
by zurfer on Wednesday December 20, 2023 @04:18PM
(#38713776)
We will probably enable the Hackernews data as demo data in the future. Today we only have some e commerce demo data when you sign up.
Although you could connect the public Big query dataset and do it yourself.
Your 2nd question would require some preprocessing per message that should probably be done as part of data preparation and not at query time.
Re:Hacker News Activity Analysis with GPT-4 Agent
by codingdave on Wednesday December 20, 2023 @04:49PM
(#38714089)
OK, I'm a bit confused then - if this needs prep work to ask questions, what is AI bringing to the table?
Re:Hacker News Activity Analysis with GPT-4 Agent
by merryje on Wednesday December 20, 2023 @06:22PM
(#38714976)
After looking at the HN demo, it seems like AI is for streamlining the sql query -> chart building process.
A service to preprocess the data with custom prompts would be neat.
Re:Hacker News Activity Analysis with GPT-4 Agent
by kordlessagain on Wednesday December 20, 2023 @07:07PM
(#38715405)
> A service to preprocess the data with custom prompts would be neat.
It is pretty cool to mess about with it. I posted it last week, but didn't get any nibbles: https://github.com/MittaAI/mitta-community/tree/main/cookboo...
Re:Hacker News Activity Analysis with GPT-4 Agent
by zurfer on Thursday December 21, 2023 @03:04AM
(#38718104)
That's exactly what Dot is about.
Preprocessing goes into data transformation territory and given the millions of comments on HN it's also getting expensive quite fast.
From BigQuery and Snowflake I know they have remote/external function that you can use to just plug in the OpenAI API.
FWIW, I'd ask:
- 1) Who are the top posters and commenters by average score on posts and comments?
- 2) Which users instigate the most positive discussions in reply to their comments. (Not longest or more... but highest quality, without arguments, flamewars, etc.)
It is that 2nd question I'm really interested in because it really might need analysis of the substance of content, not just stats.