halfeatenscone
Re:Large language models possibly vulnerable to diagonalization attacks
on Friday April 14, 2023 @12:41PM (#35571555)
It only takes a basic understanding of neural nets to recognize this as crankery. Giving an LLM a tricky question does not force it to do any more computation than a simple prompt. There is no conceivable way an especially difficult prompt would make the model crash.
Re:Run LLaMA and Alpaca on your computer
on Wednesday April 05, 2023 @03:33PM (#35459287)
I don't think this follows. Calling it a derivative work already feels like a stretch, but even granting that framing, the use is clearly transformative and therefore likely to be considered fair use in the US.
I actually wrote a Wikipedia article on the intersection of copyright law and deep learning models the other day (https://en.wikipedia.org/wiki/Artificial_intelligence_and_co...). I was hoping to include a section on the copyrightability of model weights, but was sadly able to find 0 coverage in reliable sources.
Re:Google trained Bard on ChatGPT chats from ShareGPT
on Thursday March 30, 2023 @11:36AM (#35374398)
Such logs would not be used for training the base model, but rather for fine-tuning the model for instruction following. Instruction tuning requires far less data than is needed for pre-training the foundation model. Stanford Alpaca showed surprisingly strong results from fine-tuning Meta's LLaMA model on just 52k ChatGPT-esque interactions (https://crfm.stanford.edu/2023/03/13/alpaca.html).
Re:ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks
on Tuesday March 28, 2023 @11:43AM (#35342896)
"Classify the following strings according to whether they represent Python programs which terminate..."
Re:Show HN: Visualize song lyrics using self-similarity matrices
on Wednesday March 15, 2017 @02:10PM (#13878366)
I'm not sure how easy it is to grok these by playing with them. If you're confused, the "About" section has some explanation of how the matrices are constructed and how to interpret them: https://colinmorris.github.io/SongSim/#/about
Also, in case it's not clear, you can press the "+" button next to the song dropdown to open a textarea where you can paste arbitrary lyrics.
Show HN: Visualize song lyrics using self-similarity matrices
Show HN: Visualize word-by-word probabilities given by a neural language model
Re:Show HN: Neural network trained to generate GitHub repository names
on Tuesday August 02, 2016 @12:33PM (#12211121)
It's guaranteed to not exist in the training set (i.e. to not be a real GitHub repo that existed before 2015). But the model can certainly repeat itself.