Indeed. The first sentence it generated for me was not a Markovian nonsense phrase, but rather a phrase that appears on a very large number of web pages: "The following content has been identified by the YouTube community as being potentially offensive or inappropriate." This gives some insight into their seed data.