Ask HN: Is it feasible to train my own LLM?

Re:Ask HN: Is it feasible to train my own LLM? by fsckboy on Thursday January 04, 2024 @01:06PM (#38870241)

>The thing about bleeding edge research on LLMs is that nobody really knows what will happen unless you actually try it out.

so that's the perfect reason to do it. You made predictions about the differences, then said "don't know how this will come out", and that's the scientific method right there.

Another interesting thing to find out in this experiment is not only "what would be the differences between a reddit education vs a wikipedia education" but what would be the similarities? How would it answer ethics questions? How would it answer history questions, etc.

OP it sounds like an interesting project! but I'm not in a position to judge its feasibility to get useful results.

[ Parent | on HN ]

Re:Ask HN: Is it feasible to train my own LLM? by hnfong on Thursday January 04, 2024 @02:18PM (#38871065)

There are a lot of things we don't know (eg. how does steak dry-aged in honey taste like? https://www.youtube.com/watch?v=WOqK60u1zco ), but it doesn't mean they're all worth doing.

That's why I said do it if you really want to do it. Otherwise, there's always a doubt as you acknowledged about the feasibility (to get useful results). Which isn't a problem if this is just a hobby project, but it's for schoolwork, so other considerations may apply.

[ Parent | on HN ]