News for hackers. Stuff that matters.
Re:Show HN: This Word Does Not Exist by mycall on Wednesday May 13, 2020 @04:56PM (#23171743)
If someone could make a billion word dictionary of these words, you could get excellent sentence compression rates out of standard English.
Re:Show HN: This Word Does Not Exist by minimaxir on Wednesday May 13, 2020 @04:57PM (#23171751)
GPT-2 itself works off of excellent sentence compression (byte-pair encoding for the input and output)
Re:Show HN: This Word Does Not Exist by mycall on Saturday May 16, 2020 @11:24PM (#23209311)
so for example, a byte-pair input could be "potato salad in rum" and the output might be "potadum"?