News for hackers. Stuff that matters.

avgbusinessuser

I used unsloth, I was only using a single GPU for testing - looking forward to follow up posts.
great series of posts, i went down a similar path recently for a slightly different use case - i did not use axolotl though, i was worried about missing out on understanding some details due to potential abstractions. it's great to see documentation on how others tackle similar problems, i documented the process i went through here - https://atredis.com/blog/2024/6/3/how-to-train-your-large-la...

Show HN: AiDAPal – An IDA Pro plugin and fine-tuned LLM for reverse engineering

https://github.com/atredispartners/aidapal

Howdy HN! aiDAPal started out as a project to understand the process of executing a fine-tune of a locally running LLM and to better understand if it was possible to produce results that were competitive with hosted services locally on a fairly small model (mistral7b). Alongside the plugin and fine-tuned model, I have also included the training dataset/scripts and an in-depth blog covering the...

( Read More... | no comments | on HN )