The OP, who is himself the frontman for the Decembrists applied his best effort to instill that with a melody, performance style, and sonic character of his band. He could take material from a 5-year-old or a Markov chain and dress it up to sound like a fair Decembrists song.
If you took the same ChatGPT output to another musician, expert or otherwise, you might not have the same experience you’re having now.
Stringing together some cliches and googling "what are some common chord progressions?" was never the barrier to humans becoming singer-songwriters, though credit where it's due, the LLM is reasonably good at picking lines that rhyme.
[0] https://www.youtube.com/watch?v=ss9ygQqqL2Q
[1] https://arxiv.org/pdf/2301.02111.pdf
[2] https://aka.ms/valle (demos from one)
[3] https://www.youtube.com/watch?v=WtFNOSTTPYg
[4] https://github.com/NVIDIA/tacotron2 (used to create audio for 3)
Wow, buried lede there. That should be in the title!
Merely producing "normal-looking" text (great and accurate phrase!) is an unclosed feedback loop. The songwriter here has to stop himself from driving that loop forward because he's so used to working through multiple drafts as he makes things work for his internal simulation of his audience. And generally, once an artist has something that works internally, they'll then start running it by actual other people to get their reactions. Up to and including testing material on full audiences.
Because LLMs lack internal simulations of audience response, they'll always be limited to producing "normal-looking" work.
This recent paper suggests that recent LLMs may be acquiring theory of mind (or something analogous to it): https://arxiv.org/abs/2302.02083v1
Some excerpts:
> We administer classic false-belief tasks, widely used to test ToM in humans, to several language models, without any examples or pre-training. Our results show that models published before 2022 show virtually no ability to solve ToM tasks. Yet, the January 2022 version of GPT- 3 (davinci-002) solved 70% of ToM tasks, a performance comparable with that of seven-year-old children. Moreover, its November 2022 version (davinci-003), solved 93% of ToM tasks, a performance comparable with that of nine-year-old children.
> Large language models are likely candidates to spontaneously develop ToM. Human language is replete with descriptions of mental states and protagonists holding divergent beliefs, thoughts, and desires. Thus, a model trained to generate and interpret human-like language would greatly benefit from possessing ToM.
> While such results should be interpreted with caution, they suggest that the recently published language models possess the ability to impute unobservable mental states to others, or ToM. Moreover, models’ performance clearly grows with their complexity and publication date, and there is no reason to assume that their it should plateau anytime soon. Finally, there is neither an indication that ToM-like ability was deliberately engineered into these models, nor research demonstrating that scientists know how to achieve that. Thus, we hypothesize that ToM-like ability emerged spontaneously and autonomously, as a byproduct of models’ increasing language ability.
Entering the realm of Just My Opinion, I wouldn't be surprised at all if internal theory of mind is simply an emergent property of increasing next-token prediction capability. At a certain point, you hit a phase change, where intelligence loops back on itself to include its own operation as part of its predictions, and there you go- (some form) of self-awareness.
> Imagine a woman – let’s call her Sue. One day Sue gets a stroke that destroys large areas of brain tissue within her left hemisphere. As a result, she develops a condition known as global aphasia, meaning she can no longer produce or understand phrases and sentences. The question is: to what extent are Sue’s thinking abilities preserved?
> Many writers and philosophers have drawn a strong connection between language and thought. Oscar Wilde called language “the parent, and not the child, of thought.” Ludwig Wittgenstein claimed that “the limits of my language mean the limits of my world.” And Bertrand Russell stated that the role of language is “to make possible thoughts which could not exist without it.” Given this view, Sue should have irreparable damage to her cognitive abilities when she loses access to language. Do neuroscientists agree? Not quite.
The Language of Thought Hypothesis - https://plato.stanford.edu/entries/language-thought/ (which has a long history going back to Augustine)
---
If 23 year old me were here now and considering future life paths, I'd be sorely tempted to be looking at declaring/finishing a dual CS/philos major and going to grad school.
There is!
https://arxiv.org/abs/2301.06627
From the paper:
> Based on this evidence, we argue that (1) contemporary LLMs should be taken seriously as models of formal linguistic skills; (2) models that master real-life language use would need to incorporate or develop not only a core language module, but also multiple non-language-specific cognitive capacities required for modeling thought.There was also a larger discussion from a few days ago: https://news.ycombinator.com/item?id=34730365
https://arxiv.org/abs/2302.02083
'Theory of mind (ToM), or the ability to impute unobservable mental states to others, is central to human social interactions, communication, empathy, self-consciousness, and morality. We administer classic false-belief tasks, widely used to test ToM in humans, to several language models, without any examples or pre-training. Our results show that models published before 2022 show virtually no ability to solve ToM tasks. Yet, the January 2022 version of GPT-3 (davinci-002) solved 70% of ToM tasks, a performance comparable with that of seven-year-old children. Moreover, its November 2022 version (davinci-003), solved 93% of ToM tasks, a performance comparable with that of nine-year-old children. These findings suggest that ToM-like ability (thus far considered to be uniquely human) may have spontaneously emerged as a byproduct of language models' improving language skills.'
Nothing stops anyone from writing a mediocre song. Hell, it's one of the easiest things in creation to do. Hum a melody, make some words fit. Write it down, make up your own notation for the melody if you want; you don't even have to perform it. Congratulations! You're in the same field as Colin Meloy.
ChatGPT isn't even doing this much. It's read all the tabs and lyrics of every song within its reach until 2021, and then spits out an average response based on average similar requests. It's a songwriter in the same way a 7-year-old telling you a story about an alligator who ate a city is an author.
I think you’re doing seven year olds and GPT a disservice. Lots of iconic media is made by adults who have managed to hold on to their seven year old storytelling brain.
Its also relentlessly positive in a way that Decemberist songs rarely are. Both acoustically and lyrically, which having played with ChatGPT a bit, seems to be a major part of its training. It avoids negativity in big ways. The Decemberists dont necessarily, and so it feels very gushy and bright in a way that it shouldnt.
We have to be clear on why Colin Meloy finds the song "mediocre" (lit. middle of the road, not bad but not special). I don't know Colin personally, so of course I can't really make a definitive statement, but my attitude of the same is informed by the song’s literalness. And this probably doesn't mean much to someone who has not tried to write a song or a book before, so I wanted to comment on it.
People always have these excited memories about their childhood favorites, their favorite songs, their favorite books, the things they really connected with. But the craft in design for these works is usually that, the thing you connected with, is not literally in the artwork. Instead the artwork sits around it, the artwork gestures at it. You have an idea of this character as this lonely solitary brute who 15-year-old-you really identified with because you had just come out of hitting puberty early or whatever, but if you really look at the character descriptions, it turns out that most of your impression is formed by other people in the narrative wanting the character to say something and they just don't.
This creates a really plastic space which people mold into their own viewpoint, they take it and make it relatable to them. Eco calls a novel a “lazy machine,” to make it really special I need to trust that laziness, I need to trust my reader to fill in the gaps that I do not. For instance, the hulking brute above—did you understand that to be a guy or a girl?
When Dave Matthews charted it was with “Take these chances / Place them in a box until a / Quieter time, lights down, you up and die.” What chances? What box? What quieter time? We get vignettes or a humdrum existence, of dreams of how it was simpler, and it resonated because it tapped into a nostalgic yearning for a simpler life, a fatalistic concern about the finitude of life... But the character is only seen in dotted-outline silhouette, a blank slate that we paint with our own stories.
Same when Colin sings “And nobody nobody knows / Let the yoke fall from our shoulders / Don't carry it all, don't carry it all / We are all our hands and holders / Beneath this bold and brilliant sun / And this I swear to all.” What yoke? What sun? Who is “we”? The song sketches its theme, a theme of goodbyes, of picking up where others left off, of being assured that they will pick up what you leave off, of community and family and transition. But again, the details are just gestured at, you are invited to set yourself into the narrative, personalize and connect.
ChatGPT’s chorus is “Of sailors brave, and adventures untold / Of a life on the waves, and a heart grown old / Of a world of discovery, waiting to be sought / In a song that will live, when he is not.” What sailors? Well, the companions of the Mariner who shall not be named, he apparently had splendid friends. What adventure? Again, the adventure of the Mariner, who apparently had a splendid time. The only hope for the song is that the “song that will live” is going to be presented in this work: that we are going to see a key change and the Old Man’s Song will turn out to be the climax of the piece, we will dramatically insert ourselves and become the Old Man, dramatically ending with some crescendo, “these splinters I will cling to / the battered sail fills up with might / these are the fallen friends I drink to: / I go out alone, but I'm not dying tonight!” and for just one hair-on-end minute we feel that Odyssean determination to set out on one last ambitious venture before we die. But of course we never get that because ChatGPT is trying to create something cohesive where we want something emotional.
Given that GPT represents a distillation of the sum of human output on the internet, is it truly unsurprising that 99% of the generated stories lyrics etc. are rather mediocre?
Possibly touch things they don’t know much or even anything about? That with factual errors is not really a recipe for good. What is good is what makes us think and that is certainly possible with LLMs and AI. Think interactive fiction, think collaborations of sorts with humans and so on. The current trend of generate a remix of a rehash is, all I hope, just a temporary muscle flexing of what’s possible and not what we’ll get once the hype dies down a bit.
Same goes for other domains: philosophy, coding, writing, ...
It's telling me that this AI can generate content in many domains way better than an untrained human would with minimal efforts, while not (yet?) reaching the level of experts in the domain.
It empowers all the non-experts in these many domains to touch things they never could have before. This is an amazing tool.