XGen-7B, a new 7B foundational model trained on up to 8K length for 1.5T tokens

Re:XGen-7B, a new 7B foundational model trained on up to 8K ... by sacnoradhq on Wednesday June 28, 2023 @10:50PM (#36515753)

The number of parameters seems meaningless when the training sets are dogshit and hardened old gum chipped from the shoes of Gregslist and FleaBay.

OTOH, there ought to be a construction in the form of an web app that can pinch out nonrepetitive, coherent ~100 page trashy romance novels in the style of any author given name with open source or specific text(s) or transcripts with enough original input volume: Churchill, The Unabomber, psycho happy kindergarten child development IEP manual writer, The Dude, Walter (agro gun nut), Bob Ross, Grace Hopper, Ayn Rand, LBJ, The Dalai LaMa%, Hitler, Kanye (Ye), Bhad Bhabie, and the King James Bible. Ethical and generational safety features be damned; it'd be generating fucking^2 art for hilarious entertainment purposes. How does one stretch training input to something that might involve human/computer output validation to discard sticking on repetitive nonsense?

% He never saw that one coming Ow^(3 + i).

[ Parent | on HN ]

Re:XGen-7B, a new 7B foundational model trained on up to 8K ... by scubbo on Wednesday June 28, 2023 @11:07PM (#36515868)

Do you have any recommendations for cryptocoins?

[ Parent | on HN ]

Re:XGen-7B, a new 7B foundational model trained on up to 8K ... by sacnoradhq on Friday June 30, 2023 @01:13AM (#36530758)

Do you always ask flippant and rude questions that add no value to HN?

[ Parent | on HN ]