Ask HN: What's the best LLM model that on a 24 GB VRAM GPU?
What’s the best model right now that outperforms Qwopus3.6-27B-v2-MTP-GGUF 8-bit on a 24 GB VRAM GPU? Looking for real reviews. I found 4 bit not usable in production.
What’s the best model right now that outperforms Qwopus3.6-27B-v2-MTP-GGUF 8-bit on a 24 GB VRAM GPU? Looking for real reviews. I found 4 bit not usable in production.
I built an app that preserves, encrypts, searches, reuses, and hands off the full work traces people create with Claude, Codex, Cursor, OpenClaw, and other AI agents.
It turns Claude, Codex, Cursor, OpenClaw, and other agent sessions into private data assets for your future AI employees.
Some technical details:
- AES-256-GCM encrypted local vault for transcripts, attachments, and state - No DataMoat cloud vault or server-side transcript storage - Vault keys and transcript data stay on the user’s machine - Supported sources today include Claude CLI, Codex CLI/app local sessions, Claude Desktop local-agent sessions on macOS, OpenClaw, and Cursor agent transcripts - Captures locally written thinking/reasoning blocks when the source tool stores them on disk - Stores both raw source records and normalized searchable records - Supports encrypted attachment blobs for supported images, PDFs, documents, and other files - Password-based unlock with an scrypt verifier - Optional TOTP authenticator support - 24-word BIP39 recovery phrase and one-time recovery codes - Secure Enclave-backed unlock path on supported Macs, with Touch ID in the packaged macOS app - Packaged macOS app is signed and notarized; Linux source install is available; Windows ZIP builds are available but still unsigned
We believe every person and company should have the fundamental right to own their AI data and build their own data moat.
Source: https://github.com/max-ng/datamoat
If you want to support the project, please consider starring the repo. Thank you!
Personal Blog: Have most control, but not sure if people can search it without seo. Twitter:I find many good original words on Twitter, but now sure if people can search the contents outside its ecosystem. Medium: I like it a lot but it seems favor longer articles only. Other: ?
Just replaced my cards(becoz out of warranty) with 3090s and they are very expensive... Any profitable project you can suggest?(No Mining) My skills: Building custom machine learning models Rebuilding paper's modelsThe projects I can think of: 1/ renting out the gpus (as far as I know, there are no service to rent out only the gpus but the vms) 2/ providing a deep learning api.
Same as Title.
I am the developer of Realll. I was a data scientist and I learned app development by myself because I cannot find anyone to help building our ambition. Our ambition is to build a real and trustful web system by everyone for everyone. The web is full of fake information and reviews by big companies in order to control our purchase behaviors.
In Realll app, you can rate, review, save and search any product/link provided by you or others. If you click the title on the item page, it redirects to the link immediately. Every rating not from your chain is blocked.
Really excited to hear feedback from you all. If you cannot find any rating, you can follow my account: Max
Is there a search engine/web page showing the recent fast growing paid software? Or is there a way to filter/find out the fast growing software?
I follow the general idea of converting multiple sift features into a single fisher vector for matching of million of images. But the distance score matching of fisher vector fails completely. I cannot find a successful example with code. The only working example I knew is Google lens.