Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by pyrophane on Sunday August 13, 2023 @08:10PM (#37115975)

> While I haven't tested it extensively, 70B model is supposed to rival Chat GPT 3.5 in most areas, and there are now some new fine-tuned versions that excel at specific tasks

That has been my experience. Having experimented with both (informally), Llama 2 is similar to GPT-3.5 for a lot of general comprehension questions.

GPT-4 is still the best amongst the closed-source, cutting edge models in terms of general conversation/reasoning, although 2 things:

1. The guardrails that OpenAI has placed on ChatGPT are too aggressive! They clamped down on it quite hard to the extent that it gets in the way of a reasonable query far too often.

2. I've gotten pretty good results with smaller models trained on specific datasets. GPT-4 is still on top in terms of general purpose conversation, but for specific tasks, you don't necessarily need it. I'd also add that for a lot of use cases, context size matters more.

[ Parent | on HN ]

Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by scarface_74 on Sunday August 13, 2023 @10:05PM (#37116656)

To your first point, I was trying use ChatGPT to generate some examples of negative interactions with customer service to show sentiment analysis in action for a project I was working on.

I had to do all types of workarounds for it to generate something useful without running into the guardrails.

[ Parent | on HN ]

Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by pseudosavant on Sunday August 13, 2023 @10:23PM (#37116775)

I’ll second the context window too. I’ve been really impressed with Claude 2 because it can address such a larger context than I could feed into GPT4.

[ Parent | on HN ]

Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by jmorgan on Sunday August 13, 2023 @11:48PM (#37117258)

RE 2 - neat! What are some tasks you've been using smaller models (with perhaps larger context sizes) for?

[ Parent | on HN ]

Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by ramraj07 on Monday August 14, 2023 @12:38AM (#37117513)

Could you give examples of smaller models trained on specific datasets?

[ Parent | on HN ]

Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by antupis on Monday August 14, 2023 @01:16AM (#37117692)

it can be almost anything like your HN comments or some corporate wiki, then get colab pro 10$ month or some juicy gaming machine and fine-tune that using eg this tutorial https://www.philschmid.de/instruction-tune-llama-2 but https://www.reddit.com/r/LocalLLaMA/ is full of different fine tuned models.

[ Parent | on HN ]

Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by CodeCompost on Monday August 14, 2023 @02:33AM (#37118127)

Can it handle other languages besides English?

[ Parent | on HN ]

Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by e12e on Monday August 14, 2023 @06:00AM (#37119226)

Not anywhere near as well as ChatGPT 4 (for chat anyway - maybe the model is better)?

Prompt:

> Hvad tycks om at fika nu?

ChatGPT 4

> Det låter som en trevlig idé! Fika är ju alltid gott. Vad skulle du vilja ha till din fika? (Oj, ursäkta för emojis! )

https://chat.openai.com/share/8e89a16f-f182-4f62-b9fa-f93cd5...

Llama2:

> I apologize, but I don't understand what you mean by "fika nu." Could you please provide more context or clarify your question so I can better assist you?

https://hf.co/chat/r/kOF2qst

[ Parent | on HN ]