News for hackers. Stuff that matters.

A comment on Another Hit Piece on Open-Source AI [video].

Re:Another Hit Piece on Open-Source AI [video] by Palmik on Saturday December 23, 2023 @03:57PM (#38748167)
Tangential, but why didn't the OpenAssistant team (lead by the author of the video) release the OpenAssistant dataset? As far as I know, the project was shut down, and only some initial highly filtered version of the data got released. This dataset could be very valuable for the community that created it.
[ Parent | on HN ]
Re:Another Hit Piece on Open-Source AI [video] by nmfisher on Saturday December 23, 2023 @08:44PM (#38750266)
It was fully released, no? https://huggingface.co/datasets/OpenAssistant/oasst1
[ Parent | on HN ]
Re:Another Hit Piece on Open-Source AI [video] by Palmik on Saturday December 23, 2023 @10:28PM (#38750820)
The effort started at the ~beginning of February and ended at the ~end of October [1]. The dataset you link is from April and had "unsafe" content filtered.

[1] https://m.youtube.com/watch?v=gqtmUHhaplo&feature=youtu.be

[ Parent | on HN ]
Re:Another Hit Piece on Open-Source AI [video] by nmfisher on Monday December 25, 2023 @12:30AM (#38760099)
My mistake - I guess I assumed that when the dataset was released back in April, that was the end of it, I didn't know collection was ongoing.

Looks like the "final" version was released yesterday:

https://huggingface.co/datasets/OpenAssistant/oasst2

As far as filtered/unfiltered goes, I have no idea.

[ Parent | on HN ]
Re:Another Hit Piece on Open-Source AI [video] by artninja1988 on Sunday December 24, 2023 @10:28AM (#38754080)
They released the latest dump today :) https://huggingface.co/datasets/OpenAssistant/oasst2
[ Parent | on HN ]