manjunaths
It runs at around 26 tokens/sec and FP16, FP8 is not supported by the Radeon 7900 GRE.
I just love it.
For coding QwQ 32b is still king. But with a 16GB VRAM card it gives me ~3 tokens/sec, which is unusable.
I tried to make Gemma 3 write a powershell script with Terminal gui interface and it ran into dead-ends and finally gave up. QwQ 32B performed a lot better.
But for most general purposes it is great. My kid's been using it to feed his school textbooks and ask it questions. It is better than anything else currently.
Somehow it is more "uptight" than llama or the chinese models like Qwen. Can't put my finger on it, the Chinese models seem nicer and more talkative.
I have also run Hunyuan3d-2 and generated 3d models. You would've to separate out the model generation and texture generation phase, but it works.
I run ComfyUI and bootleg gguf models. This is all on windows. Now even WSL2 works, so I am using Ubuntu-24.04 on Windows 11 to run Hunyuan3D-2.
For LLMs, llama.cpp native binaries are available. Everything just works out of the box.
I am impressed, it runs very fast. Far faster than the non-turbo version. But the primary time is being spent on the texture generation and not on the model generation. As far as I can understand this speeds up the model generation and not the texture generation. But impressive nonetheless.
I also took a head shot of my kid and ran it through https://www.adobe.com/express/feature/ai/image/remove-backgr... and cropped the image and resized it to 1024x1024 and it spit out a 3d model with texture of my kid. There are still some small artifacts, but I am impressed. It works very well with the assets/example_images. Very usable.
Good work Hunyuan!
What?!
How do you "push the breath in the brain"?
It would have been nice if this step had been expanded with explicit instructions.
This is the NeurIPS workshop that the article is talking about.
Don't be. Finding gems like this is why some of us read the comments.
I found that my only requirement for a smart phone is the Uber and Lyft apps. If I can get somehow free of them I can switch to a Nokia 1100 and be happy.
I am curious to understand why you need to do this step? Is it possible to have a more hands off approach?
Give them a task and a deadline and then let them come back with the work. If they have a problem, then they can come to you, but if they have not done their home work, then they need to solve it themselves. Is it possible this is too much of involvement in their work?
> So at that point I'll open up the library documentation and read it with them. But they will never on their own initiative open the docs.
How about telling them that they need to look it up (either in front of you or after they need to return to their station)? Would that work for you?
> I'm struggling a bit to collaborate with them because I have a strong bias towards reading (docs or books) to understand and they seem to have the exact opposite. They seem almost sad when I send them a link to raw information.
Maybe they associate this and what follows with a negative experience? Is it possible to take a more hands-off approach? Sometimes it helps to appear dumb to the person we are mentoring. Let them figure out the steps that are figure-out-able like reading API docs etc., Only help in steps that really need your expertise and experience, but not effort.
I think this is because this is how the current generation thinks. I am mentoring some interns and my own kid thinks looking up YouTube for the solution is the right thing to do. They in fact search on the YouTube app on their phone and then go to Google.
https://www.psychologistworld.com/memory/zeigarnik-effect-in...
One of the biggest reasons for use of HPL is that many sizing considerations can be based off of the theoretical calculations.
But anyway this is very interesting. I definitely need to check this out.