News for hackers. Stuff that matters.

emikulic

It's over for decels.
Three epochs means it sees each token three times. The dataset is ~1T like you said.
Re:Cyberpunk in the Nineties on Thursday August 24, 2023 @11:43PM (#37257773)
I want flying cars and moving sidewalks like I was promised by The Jetsons. :(
Re:Meta's new AI is being used to create sex chatbots on Wednesday June 28, 2023 @03:07AM (#36503308)
Try https://huggingface.co/ehartford/WizardLM-7B-Uncensored and related models. They're not even trained on smut, just the neutered responses were removed before the RLHF stage (IIUC)
I used to be bad at math but then I did a 360° on that.
Re:Stability AI Launches Stable Diffusion XL 0.9 on Friday June 23, 2023 @04:41AM (#36444327)
Emad said SD cost $600,000 to train. I wonder if Midjourney also had to pay that to train from scratch.
Re:Stability AI Launches Stable Diffusion XL 0.9 on Friday June 23, 2023 @04:39AM (#36444310)
What benefits does the Huggingface diffusers(?) implementation have over A1111?
Re:Stability AI Launches Stable Diffusion XL 0.9 on Friday June 23, 2023 @04:37AM (#36444302)
I like to run A1111 in --api mode and write my own script to drive it over HTTP.
Re:Reddit Doubles Down on Tuesday June 13, 2023 @09:13PM (#36320004)
Wow, Reddit is going to lose a lot of pagerank.
Re:CIA 2010 covert communication websites on Monday June 12, 2023 @12:28AM (#36288455)
You're thinking of archive.is
Re:WhatsApp Down on Tuesday June 06, 2023 @01:41AM (#36208596)
You mean the one that defeated two superpowers?
Re:QLoRA: Efficient Finetuning of Quantized LLMs on Friday May 26, 2023 @11:40PM (#36091887)
Last time I looked into this, the answer was "because huggingface transformers and torch.load are written to do it this way"

You could absolutely do something streaming, or mmap the weights instead of loading them into system RAM. Just the default interfaces don't.

Re:A brief history of LLaMA models on Sunday April 30, 2023 @04:08AM (#35760561)
This used to be the case but nowadays you can just pip install e.g. https://libraries.io/pypi/nvidia-cuda-runtime-cu11
I hope you will run your own locally instead of letting Midjourney block and/or mess with your prompts.
Re:TSMC approaching 1 nm with 2D materials breakthrough on Sunday November 06, 2022 @12:04AM (#33488832)
If edge devices includes my gamer PC then yes. For apps I'd recommend https://github.com/AUTOMATIC1111/stable-diffusion-webui
Re:Stable Diffusion 1.5 on Friday October 21, 2022 @04:47AM (#33285977)
If that's what paywall means now then sorry for the noise. :)
Re:Stable Diffusion 1.5 on Friday October 21, 2022 @04:41AM (#33285923)
I thought Emad said it cost $600k in GPU time.
Re:Stable Diffusion 1.5 on Friday October 21, 2022 @04:29AM (#33285853)
You have to create an account and agree to some stuff and be logged in but you're correct that you don't have to pay.
The absolute state of the free and open web in 2022.
Re:You don’t want to be on Cloudflare’s naughty list on Wednesday September 21, 2022 @12:33AM (#32920830)
Same. I've found the biggest problem was SNAT rewriting the (source) port number. netfilter, by default, doesn't do this. pf does but you can configure it not to.
You can generate things the author doesn't like. And since you're doing it on your video card at home, nobody can stop you.
Re:What have we lost? – Demo of exotic OSes (2021) [video] on Saturday August 27, 2022 @11:01PM (#32625382)
Sorry to hear it, man. :( I hope you get better.
Craiyon certainly doesn't.
You can run craiyon / dalle-mini on a card with 8GB of VRAM if you decrease batch size to 1 and skip the CLIP step. Takes about 7 sec to generate an image on a 3070.

I started with https://github.com/borisdayma/dalle-mini/blob/main/tools/inf... and pared it down.

Re:‘Cryptocurrency Should “Die in a Fire” on Tuesday May 17, 2022 @05:07AM (#31407763)
How long a network outage are you allowed to have before you lose your stake?
IIUC if the CPU changes even once, your program jumps to (is context switched into) a recovery sequence.
Or CNBC.
Re:A Safer San Francisco on Tuesday December 14, 2021 @09:54PM (#29561496)
Great episode. I rewatched it recently and it was just a bit too real.
I wish Australia had spent a fraction of that money building quarantine facilities instead. :)
Vouch takes the comment out of dead status. I then see other dead comments by the same user so I don't think it takes the user out of dead status.

Older »