T0* – Series of encoder-decoder models trained on a large set of different tasks

Re:T0* – Series of encoder-decoder models trained on a large... by GPUboy on Monday October 18, 2021 @12:48PM (#28907621)

Thank you for this! Could you or anyone available please explain how to get it to generate javascript like with GPT-3? For example, with gpt-3 you can just ask it to "generate a javascript code that collects all the links on the page," but that does not work with the demo prompt on hugging face.

Does it allow training prompts or is that done through more fine tuning in this model?

[ Parent | on HN ]

Re:T0* – Series of encoder-decoder models trained on a large... by tibbar on Monday October 18, 2021 @01:09PM (#28907847)

Code generation is not supported due to the tokenization strategy.

[ Parent | on HN ]