News for hackers. Stuff that matters.
Re:Heavy Metal and Natural Language Processing by SwellJoe on Sunday July 03, 2016 @03:04AM (#12025085)
The "least metal words" almost seems like a challenge. I now feel strangely compelled to write metal songs with those words, and I haven't written a metal song in 20 years. I may not be particularly metal, anymore.
Re:Heavy Metal and Natural Language Processing by jonathankoren on Sunday July 03, 2016 @06:25AM (#12025512)
It surprisingly holds together.

[The] academic chairman noted [the] secretary['s] considerable measurements. /

University employee[']s attorney indicated [the] administrative committee. /

Literary agencies particularly fiscal. /

Re:Heavy Metal and Natural Language Processing by insin on Monday July 04, 2016 @12:45AM (#12028925)
Which Bad Religion album is this off?
Re:Heavy Metal and Natural Language Processing by nothis on Sunday July 03, 2016 @09:29AM (#12025953)
It almost seems like something happened and it was some kind of text about administrative work that accidentally slipped in.
Re:Heavy Metal and Natural Language Processing by omegaham on Sunday July 03, 2016 @08:44AM (#12025838)
I could see this as an introductory voiceover, with a faint guitar riff in the background.

drums come in

rhythm guitar and bass come in

main riff begins

begin song

Re:Heavy Metal and Natural Language Processing by foobarbecue on Sunday July 03, 2016 @10:43AM (#12026172)
Good use of "particularily" right there -- #1 on the nonmetal chart.
Re:Heavy Metal and Natural Language Processing by AdmiralAsshat on Sunday July 03, 2016 @12:37PM (#12026598)
Motorhead managed to fit the word "parallelogram" into their title song, so I'd say nothing is impossible.
Re:Heavy Metal and Natural Language Processing by ams6110 on Sunday July 03, 2016 @03:34PM (#12027304)
I always thought of Motorhead more in the spectrum of "thrash punk" than metal.
Re:Heavy Metal and Natural Language Processing by sampo on Sunday July 03, 2016 @11:44PM (#12028795)
Not that "parallelogram" is a particularly punk word, either.
Re:Heavy Metal and Natural Language Processing by ensiferum on Monday July 04, 2016 @05:45AM (#12029685)
Nothing's impossible, re: Death Metal Pizza https://www.youtube.com/watch?v=G3gTBpLHzLY
Re:Heavy Metal and Natural Language Processing by fnord123 on Monday July 04, 2016 @10:12AM (#12030867)
Turbonegro did it in 1998: https://www.youtube.com/watch?v=YtCvz6-7D7g

Carnivore (Pete Steele's band before Type O Negative) also did it in 1987 (although it's probably not going to be classified as a metal song unless your name is Marcel Duchamp or Tracy Enim): https://www.youtube.com/watch?v=eGDTrWw_APM

Re:Heavy Metal and Natural Language Processing by pavel_lishin on Monday July 04, 2016 @10:03AM (#12030822)
Do you folks like coffee?
Re:Heavy Metal and Natural Language Processing by maxerickson on Sunday July 03, 2016 @09:54AM (#12026055)
You could try to sell the songs to System of a Down.

(which may not be particularly metal, but they have an interesting contrast between their sound and their lyrics)

Re:Heavy Metal and Natural Language Processing by anonbanker on Monday July 04, 2016 @04:29AM (#12029455)
According to this list, "I Ejaculate Fire" by Deathklok is not a very metal song.
Re:Heavy Metal and Natural Language Processing by sklivvz1971 on Sunday July 03, 2016 @09:11AM (#12025897)
As long as you growl them, they could totally be Death lyrics
Re:Heavy Metal and Natural Language Processing by SwellJoe on Sunday July 03, 2016 @01:37PM (#12026856)
The lyrics for the first couple of Carcass albums were pulled from medical texts, so I think lyrical content is pretty flexible. But, the nonmetal words almost sound like a very boring BBC program about people in an office in the 19th century; like Eastenders with stuffy accountants. It'd be an interesting challenge.
Re:Heavy Metal and Natural Language Processing by jonah on Sunday July 03, 2016 @03:27PM (#12027273)
There's also Die Eier Von Satan by Tool:

https://www.youtube.com/watch?v=VPST2nE0KIo

The lyrics are a german recipe on how to make cookies without eggs....

Re:Heavy Metal and Natural Language Processing by anonbanker on Monday July 04, 2016 @04:30AM (#12029456)
hashish-laced donut holes, but your point still stands.
Re:Heavy Metal and Natural Language Processing by amelius on Sunday July 03, 2016 @06:05AM (#12025458)
> In the face of this complexity, it is not surprising that understanding natural language, in the same way humans do, with computers is still a unsolved problem.

I have the feeling it is not just an unsolved problem, but also an undefined problem.

Re:Heavy Metal and Natural Language Processing by Bahamut on Sunday July 03, 2016 @02:28AM (#12025026)
I noticed there was song data errors in places - for example, in this chart (http://www.degeneratestate.org/static/metal_lyrics/clusters....), in the most representative songs for Tiamat, it lists White Pearl, Black Oceans. That is a song by Sonata Arctica. It also lists 3 versions of the same song for Nightwish in most representative songs (Elan). Similar mistakes are made for various bands in that chart (Symphony X, Hammerfall, Therion, Sabaton, Stratovarius, Helloween, Within Temptation, etc.).

This was interesting to read in general though, especially as someone who listens to metal quite frequently (mostly of the power metal variety).

Re:Heavy Metal and Natural Language Processing by simonbw on Sunday July 03, 2016 @02:35AM (#12025038)
He mentioned that in the article: > What's interesting is that while the most representative songs for each band are mostly their own songs, occasionally other bands songs creep in. For example, "Wrathchild", is an Iron Maiden song, not a Diamondhead song.

I don't think it's a problem with the song data. When the algorithm picks a song it considers most lyrically representative of a band, it chooses from all the songs in the dataset, and it doesn't always pick a song by that band.

Re:Heavy Metal and Natural Language Processing by vonnik on Sunday July 03, 2016 @02:03AM (#12024983)
People interested in ML and heavy metal may appreciate:

LSTMetallica: Generation drum tracks by learning the drum tracks of 60 Metallica songs https://keunwoochoi.wordpress.com/2016/02/23/lstmetallica/

Keunwoo is also the translator of Deeplearning4j's Korean site: http://deeplearning4j.org/kr-index

Re:Heavy Metal and Natural Language Processing by abecedarius on Sunday July 03, 2016 @02:50AM (#12025064)
That list of most and least metal words, if I didn't know where they were from, I'd have guessed was the 19th-C. Romantic reaction to the Enlightenment (except for a few anachronisms like 'gonna'). How metal was Edgar Allan Poe?
Re:Heavy Metal and Natural Language Processing by bigger_cheese on Sunday July 03, 2016 @04:34AM (#12025250)
Pretty Metal I know at least 3 bands who have set his words to music: Arcturus, Green Carnation (Both did 'Alone') Carpathian Forest ('The Raven').
Re:Heavy Metal and Natural Language Processing by tragic on Sunday July 03, 2016 @06:00AM (#12025440)
There's also Ahab, who based a fantastic album on the narrative of Arthur Gordon Pym[0]. It's sort of halfway between funeral doom and your Isis/Neurosis style stuff.

[0] https://en.m.wikipedia.org/wiki/The_Giant_(Ahab_album)

Re:Heavy Metal and Natural Language Processing by Drup on Sunday July 03, 2016 @08:04AM (#12025752)
Regarding the non-metalness of long words, it's just that you are not trying hard enough: http://www.invisibleoranges.com/death-metal-english/
Re:Heavy Metal and Natural Language Processing by mkozakov on Sunday July 03, 2016 @08:09AM (#12025760)
There is something to be said about song structure. Most songs will have a chorus, which is repeated throughout the song. Choruses will generally have higher 'readability' because they are meant to be more memorable. If you don't pre-process your corpus by removing repeating paragraphs, then your comparisons to the brown corpus are not as valid, since brown doesn't use repetition.
Re:Heavy Metal and Natural Language Processing by jessemoeller on Sunday July 03, 2016 @11:28AM (#12026311)
I believe that the convention on darklyrics is to either elide or replace with "[chorus]" all repetitions of the chorus after the first. A few spot checks seem to confirm this, but I can't find an official policy on it.
Re:Heavy Metal and Natural Language Processing by lucb1e on Sunday July 03, 2016 @11:49AM (#12026393)
This made me wonder how "metal" a given text is. Wrote a small toy here: https://lucb1e.com/rp/crapware/metalness.htm

Given a text it will split each word, add up the metalness score and divide it by the number of words.

Re:Heavy Metal and Natural Language Processing by qbrass on Monday July 04, 2016 @03:46AM (#12029353)
You need to strip |,.?!| from the text because it won't recognize words with a punctuation mark at the end.
Re:Heavy Metal and Natural Language Processing by xefer on Sunday July 03, 2016 @11:28AM (#12026314)
My favorite example of "least metal words" is Iron Maiden's use of the word "cuddle" in their song "Drifter"
Re:Heavy Metal and Natural Language Processing by 4e1a on Sunday July 03, 2016 @01:52AM (#12024967)
This is really cool! Is this on github or anything? I'm having my friends and myself search for lyrics of different genres to compare this to.
Re:Heavy Metal and Natural Language Processing by zo1 on Sunday July 03, 2016 @05:07AM (#12025337)
The author specifically mentions that he is not releasing the lyrics dataset.
Re:Heavy Metal and Natural Language Processing by 1ris on Sunday July 03, 2016 @02:27PM (#12027066)
I'm suprised no difference between american and european metal was found. I feel like they are quite different, but it seems this is not supported by this data.

I found it amusing that Venom and Running Wild are grouped together in the first step. But well, by the lyrics it fits. The rest matches my expectations surprisingly well.

Re:Heavy Metal and Natural Language Processing by NautilusWave on Sunday July 03, 2016 @06:25PM (#12027914)
I originally assumed this was about how heavy metal contamination affects natural language processing.
Re:Heavy Metal and Natural Language Processing by hrnnnnnn on Monday July 04, 2016 @05:00AM (#12029551)
In a roundabout way it is :)
Re:Heavy Metal and Natural Language Processing by ryuuchin on Sunday July 03, 2016 @04:51PM (#12027564)
Reminds me of of the Power Metal Lyric Generator[1]. Although obviously that was done more as a joke instead of actual analysis on metal lyrics.

[1] https://youtu.be/wpe8eNdpAiM?t=307

Re:Heavy Metal and Natural Language Processing by kgc on Sunday July 03, 2016 @03:28AM (#12025123)
Lol. "Least Metal Words"
Re:Heavy Metal and Natural Language Processing by sevenless on Sunday July 03, 2016 @03:59AM (#12025178)
Reminds me of Dethklok's song about tax receipts... https://www.youtube.com/watch?v=2zMQtXP7F5k
Re:Heavy Metal and Natural Language Processing by bionsuba on Sunday July 03, 2016 @01:51AM (#12024965)
Fantastic article.

I wonder if the clustering method can be used/is used by apps like Spotify to create a list of "related bands", as the graph at the end was fairly accurate.

Re:Heavy Metal and Natural Language Processing by 4e1a on Sunday July 03, 2016 @01:59AM (#12024976)
I thought the same thing, but this method seems like it actually works. Could this be expanded to not just analyse words but frequency makeup also?
Re:Heavy Metal and Natural Language Processing by foobarbecue on Sunday July 03, 2016 @10:44AM (#12026177)
Enjoying the article so far, but the graphs are unreadable. You should either embed dynamic ones or use bigger fonts.