Claude 3 model family

Re:Claude 3 model family by rthnbgrredf on Monday March 04, 2024 @01:50PM (#39594322)

Could anyone recommend an open-source tool capable of simultaneously sending the same prompt to various language models like GPT-4, Gemini, and Claude, and displaying their responses side by side for comparison? I tried chathub in the past, but they decided to not release any more source as of now.

[ Parent | on HN ]

Re:Claude 3 model family by josh-sematic on Monday March 04, 2024 @01:54PM (#39594390)

Not open-source, but https://airtrain.ai lets you do this. Disclaimer: I’m an engineer there.

Edit: aiming to have Claude 3 support by tomorrow.

[ Parent | on HN ]

Re:Claude 3 model family by r_hendricks on Monday March 04, 2024 @02:15PM (#39594663)

If you're willing to use the CLI, Simon Willison's llm library[0] should do the trick.

[0] https://github.com/simonw/llm

[ Parent | on HN ]

Re:Claude 3 model family by rthnbgrredf on Monday March 04, 2024 @03:01PM (#39595244)

I already have a cli client, but how to talk to multiple different LLMs at the same time? I guess I can script something with tmux.

[ Parent | on HN ]

Re:Claude 3 model family by r_hendricks on Monday March 04, 2024 @10:22PM (#39599093)

Yes, I had in mind that you’d need a simple script for this

[ Parent | on HN ]

Re:Claude 3 model family by hnenjoyer_93 on Monday March 04, 2024 @02:11PM (#39594606)

https://chat.lmsys.org/

Choose Arena (side-by-side), it has Claude 3 Opus, Sonnet and GPT-4

[ Parent | on HN ]

Re:Claude 3 model family by barfingclouds on Monday March 04, 2024 @09:25PM (#39598747)

Poe. Poe has Claude 3 right now as well as Gemini pro (not ultra), gpt 4 and 3.5, mistral large, llama, others

[ Parent | on HN ]

Re:Claude 3 model family by azebazenestor on Tuesday March 05, 2024 @07:00PM (#39610645)

https://github.com/nat/openplayground but seems it has not be updated from 6 months.

[ Parent | on HN ]