How to think about creating a dataset for LLM fine-tuning evaluation

Re:How to think about creating a dataset for LLM fine-tuning... by strickvl on Thursday June 27, 2024 @09:39AM (#40810382)

There's a ton of abstraction in axolotl, for sure, but so far I haven't found that it gets in the way. The main competitor in that space seems to be Unsloth, but that only works with a single GPU machine, so didn't fit my purposes. I'll dive into your blogpost. Thanks for posting!

[ Parent | on HN ]

Re:How to think about creating a dataset for LLM fine-tuning... by avgbusinessuser on Thursday June 27, 2024 @02:39PM (#40813591)

I used unsloth, I was only using a single GPU for testing - looking forward to follow up posts.

[ Parent | on HN ]