How to think about creating a dataset for LLM fine-tuning evaluation

Re:How to think about creating a dataset for LLM fine-tuning... by avgbusinessuser on Thursday June 27, 2024 @09:16AM (#40810149)

great series of posts, i went down a similar path recently for a slightly different use case - i did not use axolotl though, i was worried about missing out on understanding some details due to potential abstractions. it's great to see documentation on how others tackle similar problems, i documented the process i went through here - https://atredis.com/blog/2024/6/3/how-to-train-your-large-la...

[ Parent | on HN ]

Re:How to think about creating a dataset for LLM fine-tuning... by strickvl on Thursday June 27, 2024 @09:39AM (#40810382)

There's a ton of abstraction in axolotl, for sure, but so far I haven't found that it gets in the way. The main competitor in that space seems to be Unsloth, but that only works with a single GPU machine, so didn't fit my purposes. I'll dive into your blogpost. Thanks for posting!

[ Parent | on HN ]

Re:How to think about creating a dataset for LLM fine-tuning... by avgbusinessuser on Thursday June 27, 2024 @02:39PM (#40813591)

I used unsloth, I was only using a single GPU for testing - looking forward to follow up posts.

[ Parent | on HN ]