DALL-E 2 has a secret language

Re:DALL-E 2 has a secret language by karmasimida on Wednesday June 01, 2022 @12:48AM (#31578206)

If they use BPE dropout, then the split can be different and not unique.

And for the record, they use BPE dropout for DALLE-1, see https://arxiv.org/pdf/2102.12092.pdf

[ Parent | on HN ]

Re:DALL-E 2 has a secret language by DalasNoin on Wednesday June 01, 2022 @01:00AM (#31578288)

I believe they only apply it during training.

[ Parent | on HN ]

Re:DALL-E 2 has a secret language by karmasimida on Wednesday June 01, 2022 @01:27AM (#31578454)

right, that is my point. It is hard to know which combination triggers the current tokenization to be interpreted as bird.

[ Parent | on HN ]