Re:AI and the Problem of Knowledge Collapse
by elicksaur on Monday April 08, 2024 @07:42PM
(#39974840)
> You also can't expect any of these models to do as well with Haskell as they do with Python or Java which they will have seen massively more of during training.
This is exactly the person’s point.
Did you try this Haskell problem with a paid version and can provide an example that actually disputes the described experience? Why would someone pay for the premium version of a product when they don’t perceive the free version as working?
If you are just using the free version of Phind, then it uses some MUCH smaller and less capable model of their own. Even if you use Phind Pro, or Phind Plus, it says their own most capable model is Phind 70B (tiny compared to GPT-4 class models).
You can't just use Phind and take that as indicative of what state-of-the-art models can do, without knowing what model you are actually using. You also can't expect any of these models to do as well with Haskell as they do with Python or Java which they will have seen massively more of during training.