Re:A Markov text generator that learns from the Twitter stre...
by NathanKP on Sunday May 23, 2010 @01:36PM
(#1372632)
Wow, I built a Markov text generator years ago, and made a PHP bot to crawl web pages to gather text for it, but that was before Twitter even existed. One suggestion might be to add a dictionary of english words and acronyms so that you can weed out nonsense words and other languages. It would probably have a big effect on the accuracy.
I wonder if the code is available anywhere? I'd love to experiment with it myself and see if I can improve on it some.
Re:A Markov text generator that learns from the Twitter stre...
by mootothemax on Sunday May 23, 2010 @03:24PM
(#1372803)
This is a rather fun idea, I like it a lot :) So far I'm using a mix of PHP, C, and more PHP and have just set the bugger live here: https://twitter.com/markov_chains
Re:A Markov text generator that learns from the Twitter stre...
by cmelbye on Sunday May 23, 2010 @04:31PM
(#1372937)
Wow, yours looks like the quality is much better (especially so considering it just started learning a few hours ago). The OP's is a bunch of meaningless gibberish.
Re:A Markov text generator that learns from the Twitter stre...
by moss on Sunday May 23, 2010 @02:12PM
(#1372683)
This is delightful. What I'd really like to see now is one that could learn from people's reactions to it: pay attention to which of its tweets were retweeted or favorited and try to generate more like those.
Re:A Markov text generator that learns from the Twitter stre...
by Mongoose on Sunday May 23, 2010 @03:51PM
(#1372849)
I built something like this for Sunlight Labs' Apps For America contest last summer. It feeds US patent application abstracts to a Markov processor to generate random invention descriptions. http://eurekaapp.com/
It's pretty slow (tail call optimization in Ruby would be nice), but what it spits out tends to be pretty funny.
Re:A Markov text generator that learns from the Twitter stre...
by spolsky on Sunday May 23, 2010 @07:03PM
(#1373286)
hmm. I can't tell the difference between that and any other twitter feed. Mindless gibberish brain-hand-grenades that take 45 minutes to decipher and turn out to be about a television series I've never seen.
http://www.in-vacua.com/markov_text.html
With some code:
http://uswaretech.com/blog/2009/06/pseudo-random-text-markov...
I wonder if the code is available anywhere? I'd love to experiment with it myself and see if I can improve on it some.
Edit: I found the code: http://github.com/OEP/markov
I pointed out a bot that I run there: http://twitter.com/twatterhose
Here's the code: http://github.com/avar/bot-twatterhose
And the Markov engine powering it: http://hailo.github.com/
http://twitter.com/x11r5
...on Identica, seeded with Identica messages it sees:
http://identi.ca/x11r5
...and on the web, seeded by content from an IRC channel:
http://www.x11r5.com/
As the about page says, "X11R5 is an insane geek on Identica, X11R5 is an insane 12-year-old on Twitter."
http://www.x11r5.com/wtf?
It's pretty slow (tail call optimization in Ruby would be nice), but what it spits out tends to be pretty funny.
Bonus tie-ins to HN topics:
Rob Pike was one of the perpetrators (an author of the Go language)
It was featured in Martin Gardner's Mathematical Games column in Scientific American
(yeah, I wrote one too, after reading the article. I think it's catnip to hackers, like the Game of Life)
Are we just playing around in how to program Markov text generation? Because who cares; they figured that out ages ago.