Recent AI model progress feels mostly like bullshit

Re:Recent AI model progress feels mostly like bullshit by jcims on Sunday April 06, 2025 @08:11PM (#43606176)

I just had Cursor Pro + Sonnet 3.7 Max one shot a python script to send this question to every model available through groq.

>Found 24 models: llama3-70b-8192, llama-3.2-3b-preview, meta-llama/llama-4-scout-17b-16e-instruct, allam-2-7b, llama-guard-3-8b, qwen-qwq-32b, llama-3.2-1b-preview, playai-tts-arabic, deepseek-r1-distill-llama-70b, llama-3.1-8b-instant, llama3-8b-8192, qwen-2.5-coder-32b, distil-whisper-large-v3-en, qwen-2.5-32b, llama-3.2-90b-vision-preview, deepseek-r1-distill-qwen-32b, whisper-large-v3, llama-3.3-70b-specdec, llama-3.3-70b-versatile, playai-tts, whisper-large-v3-turbo, llama-3.2-11b-vision-preview, mistral-saba-24b, gemma2-9b-it

Excluding the ones that do not support chat completions, all but one (qwen-qwq-32b) answered in the affirmative. The answer from qwen-qwq-32b said:

    Paul Newman, the renowned actor and humanitarian, did not have a widely publicized 
    struggle with alcohol addiction throughout most of his life, but there were 
    specific instances that indicated challenges.

Using lack of progress in a specialized field as a barometer for overall progress is kind of silly. I just spent the last few days 'vibe coding' an application and I have to say that it's pretty remarkable how capable it is now relative to my experience last year.

It took three minutes for me to do the above from the time I created my API key to when I had an answer.

[ Parent | on HN ]

Re:Recent AI model progress feels mostly like bullshit by mnky9800n on Sunday April 06, 2025 @08:28PM (#43606252)

I find that everyone who replies with examples like this is an expert using expert skills to get the LLM to perform. Which makes me think why is this a skill that is useful to general public as opposed to another useful skill for technical knowledge workers to add to their tool belt?

[ Parent | on HN ]

Re:Recent AI model progress feels mostly like bullshit by jcims on Sunday April 06, 2025 @09:27PM (#43606582)

I agree. But I will say that at least in my social circles I'm finding that a lot of people outside of tech are using these tools, and almost all of them seem to have a healthy skepticism about the information they get back. The ones that don't will learn one way or the other.

[ Parent | on HN ]