Re:Lossless compression of English messages using GPT-2
by fla on Tuesday June 23, 2020 @03:48PM
(#23619303)
Try swapping a few characters in the compressed string before decompressing and get a totally unrelated, but somewhat plausible, sentence.
[ Parent
| on HN ]
Re:Lossless compression of English messages using GPT-2
by VMG on Tuesday June 23, 2020 @05:04PM
(#23620250)
Try swapping a few characters in the compressed string before decompressing and get a totally unrelated, but somewhat plausible, sentence. -->
䔹䧹焫놉勏㦿顱㦽膑裚躈葊
Swapping last two: 䔹䧹焫놉勏㦿顱㦽膑裚葊躈 -->
Try swapping a few characters in the compressed string before decompressing and get a totally unrelated, but somewhat applied tlh
Swapping first two: 䧹䔹焫놉勏㦿顱㦽膑裚躈葊 -->
Sexy Shania Twain acting as a sprite for sexy Hogan's Alley demo dude
my site
my favorite animal's name is camelid 2 my favorite artist is david maile my favorite movie's are
Pretty wild!
Re:Lossless compression of English messages using GPT-2
by jkhdigital on Tuesday June 23, 2020 @05:20PM
(#23620451)
It's just adaptive arithmetic coding, with the distribution provided by GPT-2 instead of some other statistical analysis of the source. He uses CJK simply to make the output printable, but it's really just random bits. I mean, it's a neat idea, but certainly not novel.
Re:Lossless compression of English messages using GPT-2
by VMG on Tuesday June 23, 2020 @05:07PM
(#23620290)
After some more tweaking it looks like the most-significant bits come first
Re:Lossless compression of English messages using GPT-2
by Erwin on Wednesday June 24, 2020 @11:51AM
(#23629386)
I run this code in Python:
for i in range(20): print ''.join(unichr(random.randrange(20000, 25000)) for x in range(4))
to generate some random text; one string like 劓惂儶宓 turns up this bizarre output:
> Honeybees ( Apis mellifera ) are splendidly beautiful little creatures. They have shapely abdomens, amphistales and pedipalps, round chests, and square backs … all of them beautifully highly marketable. Exactly what has caused the popularity of bees I do not quite know; just what they do is a mystery to me. I beg to differ. The
Re:Lossless compression of English messages using GPT-2
by jmiller099 on Tuesday June 23, 2020 @04:54PM
(#23620126)
Tried similar.
Typed in 你好吗 and decompressed it. The decompression was an entertaining read.