I looked for a forum like this a few months ago during my own model research, and didn't find one. So, here's the "catalog of clankers," a task-structured review site for LLMs. The idea is that if you're looking for an LLM to use for a specific task, there's a whole spectrum of models out there now, and benchmark data can be somewhat hard to apply to your own particular task.
For context, at the time I was looking for models that were good at generating novel DSL snippets (i.e. a language not in LLM training data) and then general SVG generation (not just pelicans).
Once there's something to publish, there will be a regular cadence of database dumps so that the actual content on the site (reviews, ratings, etc) is publicly available and not locked up by the site itself.
For context, at the time I was looking for models that were good at generating novel DSL snippets (i.e. a language not in LLM training data) and then general SVG generation (not just pelicans).
Once there's something to publish, there will be a regular cadence of database dumps so that the actual content on the site (reviews, ratings, etc) is publicly available and not locked up by the site itself.
PTAL!