News for hackers. Stuff that matters.

dpf

Re:BigCode Project Releases StarCoder: A 15B Code LLM on Friday May 05, 2023 @06:52AM (#35827595)
code-davinci-002 is a base LM, and the other 3.5 models (text-davinci-{002,003}, gpt-3.5-turbo, and ChatGPT) use instruction tuning and/or RLHF. Source: https://platform.openai.com/docs/model-index-for-researchers
These environments are often used as a testbed for reinforcement learning, e.g. https://arxiv.org/abs/1502.05477