News for hackers. Stuff that matters.

leach

Re:GPT-OSS-120B runs on just 8GB VRAM & 64GB+ system RAM on Monday August 11, 2025 @05:17PM (#44869570)
Ah I see interesting, I'll have to play around with this more. I switched from Nvidia to AMD and have found AMD support to still be rolling out for these new cards. I could only get LM studio working so far but I'd like to try out more front ends.

Not a major setback because for long context I'd just use GPT or claude, but it would be cool to have 128k context locally on my machine. When I get a new CPU I'll upgrade RAM to 64, my GPU is more than capable of what I need for a while and a 5090 or 4090 is the next step up in VRAM but I don't want to shell out 2k for a card.

Re:GPT-OSS-120B runs on just 8GB VRAM & 64GB+ system RAM on Monday August 11, 2025 @01:41PM (#44867075)
I'm a little confused how these models run/fit onto VRAM. I have 32gb system RAM and 16gb VRAM. I can fit the 20b model all within vram, but then I can't increase the context window size past 8k tokens or so. Trying to max the context size leads to running out of VRAM. Can't it use my system ram as backup though?

Yet I see other people with less resources like 10GB of vram and 32gb system ram fitting the 120b model onto their hardware.

Perhaps its because ROCm isn't really supported by ollama for RDN4 architecture yet? I believe I'm using vulkan to currently run and it seems to use my CPU more than my GPU at the moment. Maybe I should just ask it all this.

I'm not complaining too much because it's still amazing I can run these models. I just like pushing the hardware to its limit.

Re:The Dating App Paradox on Wednesday February 14, 2024 @06:27PM (#39377045)
Basically this, the bookstore was a stand in for any type of place that you may frequent and see others frequent.

People react differently to being approached, just like anyone would. If they are just into you it works. If not some are polite and see it as a compliment and just say no. Others will be offended and scoff. Either way no one gets hurt and you just move on.

Eventually you just get lucky with someone who is interested in you back. This is kinda how it was for most of history, so I find it odd people are so against it now. We are social creatures! go out and meet people, if they happen to be mean oh well, that reflects entirely on them.

Re:The Dating App Paradox on Wednesday February 14, 2024 @06:23PM (#39377005)
If you don't date at work you still make friends at work and grow your social circle. Leverage that to meet new people through work people.

It can be risky dating at work but some find the trade off worth it. I suppose it depends on how comfortable you are at your job too. I've definitely seen relationships blossom in my workplace more than once. When you spend so much time with people it's only natural.

Re:The Dating App Paradox on Wednesday February 14, 2024 @06:21PM (#39376989)
This is very true, I've never used a dating app as the opposite sex so I'm not sure what their experience is like. This definitely sounds about right though.

Makes sense that attention is what they want from you, and how the experience compares to that of an average dude on it.

I suppose I'm forgetting other experiences too, I guess I follow the two "rules" of dating apps because as a dude I get a decent amount of matches. Still I don't like the dating apps, maybe I just yearn for something more real I'm not sure.

Re:The Dating App Paradox on Tuesday February 13, 2024 @01:03PM (#39360646)
Dating apps by and far are quite useless. If you ever want to know how insidious they are, just download one, finish your profile, and swipe for 10 minutes a week.

Since you are not an "active user" they will give you the most attractive people to swipe on. Every couple of days they will give you a "limited time" discount on gold or platinum or whatever. The push notifications are my favorite part, "you could be missing out on the love of your life!!!".

Not to mention the interactions with the UI are littered with casino like visuals. The whole purpose of the app is to get you addicted and spending time and money on it.

It's much easier to naturally meet people in real life through work/school. If you can't there, go hang out at coffee shops or bookstores or something and just hang. Strike up conversation with people, just live. You'll get rejected and some people will be rude but it's all real. You could also always pick up hobbies and meet people there. Just be social, don't spend time and money on these machines of misery.

This looks very interesting
Re:The Fear of AI Just Killed a Useful Tool on Wednesday August 09, 2023 @02:19PM (#37066578)
I agree, people get angry at something for a day and then the timeline tells them to be angry at the next thing.

Always feel bad for people who cave to the mob, usually if the mob is yelling at you you’re on the right track

These people would rather stunt humanities growth than come up with alternative energy solutions.

Notice how they always complain but never actually suggest solutions, like setting up more modern nuclear power plants or funding fusion R&D.

No, they are just looking to sell doom and clicks so to them solving the problem would actually put them out of work.

Re:IRC Is the Only Viable Chat Protocol on Saturday July 29, 2023 @05:10PM (#36924646)
I’d love to use open source solutions but my friends would never switch over to that because they are lazy and don’t care.

I assume there are many such cases

Re:Solar Energy Solves Global Warming on Tuesday July 11, 2023 @11:29AM (#36682381)
Isn’t nuclear more stable and efficient than solar?

Why is it not regarded as a solution

Re:Build Personal ChatGPT Using Your Data on Saturday July 08, 2023 @06:44PM (#36649524)
I’m curious about the response times though, i imagine they will be quite slow on an intel Mac
Re:Build Personal ChatGPT Using Your Data on Saturday July 08, 2023 @06:02PM (#36649229)
How does this run on an Intel Mac? I have a 6 core i9. Haven't been able to get an M series yet so Im wondering if it would be more worth it to run it in a cloud computing environment with a GPU.
Bluesky is currently better than threads, technically.

The content on Bluesky is lacking, i know it’s because of the invite only system, and that has its advantages and disadvantages but Bluesky is going to run into a problem soon.

They obviously need content and users to stay alive, and the content is lacking. Currently it’s a very niche group of users who have a very distinct culture. They don’t leave much room for differing ideas.

It will be interesting watching this play out. They are positioned in a way that can beat threads, but they need to drop the invite ASAP and manage their onboarding of new users.

That means the culture will inevitably change, I’m not sure I see a way of it staying the same as normal people and more fringe people sign up.

IMO they should prioritize content creators. Engaging content on the platform that’s rich will be a huge leg up when they open up.

Helps too that currently i can’t even post a picture on threads without it crashing. Blue sky is definitely the more delightful sop to use.

I feel like shadow always had way more latency, and paper space was much more consistent
Re:Why Platinum Photography Was Lost on Wednesday June 21, 2023 @02:20PM (#36422239)
I didn’t even know this was a thing but would love to try this process out.

I was lucky enough to learn film development in high school, though now a days I don’t have access to a darkroom.

Which is unfortunate because many of my family members are photographers and used to have darkrooms in their homes.

Taxi and Uber drivers watching all their income for the night evaporate to the tolls
Translation:

Hi my company is racing toward AGI, let’s make sure no other companies can even try.

Re:Discord’s username change is causing discord on Saturday May 06, 2023 @11:24PM (#35847615)
Is there any viable self hosted discord alternatives? Discord is setting itself up to basically have all user data on everyone and be able to track it. The 38% stake Tencent owns eventually has to reap benefits for the CCP. Looking to distance myself from the application in general.
Re:Inflection AI First Release – Pi on Wednesday May 03, 2023 @03:21PM (#35806543)
Has anyone read the privacy policy? Seems like a nightmare
Re:AirPods Causing Tinnitus? on Saturday March 04, 2023 @03:49PM (#35024364)
I got tinnitus after COVID, had it for about a year or so now, it seems to get better or worse on its own and doesn't really have any pattern to it.

I will say that when using ANC it bothers me much more if nothing is playing.

Have you ever read snow crash? Makes me immediately think of when Hiro goes into gargoyle mode.

I think it would be quite fun to have a HUD like that for daily life.

Re:Everything You Can’t Have on Saturday February 04, 2023 @03:55PM (#34658177)
I think people need to seek what is fulfilling for them, not what just necessarily makes them happy .
Re:As unions decline, inequality rises on Saturday December 17, 2022 @12:05PM (#34029693)
It's quite annoying when people just assume that a union would be the best thing for you. They clearly have no idea and just read on the internet that a union would be good for workers so obviously they have to align with that view.

The last thing I want is for freeloaders to essentially never get fired and for some parasitic entity to collect dues for "bargaining" that usually isn't even worth it by the time they finish negotiations. Especially in todays climate.

Sure the threat of a union may mobilize a company to be more competitive and pay more, but the actual unions themselves just seem to never work out. Expecting an entity that doesn't do much to get you all these benefits is almost insane. When has any union actually got everything they promised? Never, at least not in America.

I think I read that poem once thought it was cringe and just skip it to get wings at the end of minecraft now.

Minecraft is a simple game where you build the experience alone or with friends, the only reason the poem is meaningful for people is because of those experiences. Dude let his ego get out of check.

Re:My full statement regarding DOOM Eternal on Wednesday November 09, 2022 @12:12PM (#33534641)
Damn I won't give ID any more money. What pieces of shit. Complete incompetence by marty
Re:2000-Watt Society on Wednesday September 21, 2022 @11:04AM (#32926170)
Why not just use energy that actually is pretty clean? No reason we can’t use nuclear for the majority of energy, and it’s waste is far more manageable than C02 in the air.
Re:What will you do with the stories entrusted to you? on Saturday September 17, 2022 @10:37PM (#32883891)
Hmmm I like the message but I partly disagree with some of what they are saying in regards to narrative tap out. I’ve found some things no one can truly understand some things that people go through unless they went through it themselves.

I’ve encountered it both ways, and theres just some things that people seem to only be able to understand on their own through experiences.

Opening up to other people is exhausting, they frequently either don’t know what to do or they try and act sympathetic or empathetic but eventually usually aren’t.

I think often about Frodo in lord of the rings. The burden he had to carry alone and how it changed him. I think many people have that one ring they carry around. You have to look at it from a Birds Eye view, the way our lives all run and are interconnected. It’s said that either someone you know directly is going through something rough or that person knows someone who’s got it rough. Thinking of that helps me be nicer and more patient with people.

But i think it’s foolish to expect them to be. I’ve been burned many times putting faith in people I shouldn’t. The only people who usually truly get you understand you because they went through it themselves. Of course this is just my experience, but I’ve found it keeps on ringing true as i get older and older.

I don't even care when people are toxic, they are so easy to bait into raging when they are. I suck at league and say I do though so at least I'm honest.
We’re all living on borrowed time. And the past is immutable, the future is ever changing with too many variables to calculate. There’s nothing productive from regretting enjoying your youth. I’m around your age and got into programming as a junior in high school. I would program on the side and play video games with friends make movies et cetera. I loved all of it, i still enjoy playing games with friends though it’s not as frequent now.

You’re in college, enjoy it use it to learn computer science. People switch careers up later in life, you’ve got time and can do whatever you want

Older »