I hope we'll have some kind of good paradigm to do lora style learning or maybe an output subagent or something so we can better calibrate the output style in a fuzzy way. In context learning (instructions, memories) doesn't currently seem that effective.
> But I suspect it goes deeper. Why does it seem to begin sentences with "Additionally" a bit too much? My guess is that it's because humans would tend to base their writing much more on, I don't know, maybe an underlying narrative structure of sorts, such that the relevance of things and the connections between them can more often be implied.
> Meanwhile AI has little or none of this kind of context, so it needs to use a lot more explicit connectors, and it's forced to risk being mildly patronizing for lack of a nuanced reader persona to write for. It doesn't encapsulate opinion in the subtext and details of factual statements, there is nothing to be found between the lines, and no arcane divination is needed to see what the angle is.
Scattered throughout the section before that (by which I mean that the next quotes weren't contiguous) is some tracing around the core problem that I later realized is a lack of qualia. Is it that the bot has no capacity for qualia? I mean, I would think so. I'm not sure if that's strictly compatible with the concept of qualia, since I'm under the impression that they're supposed to be ineffable anyway, so how would we really know? But either way, it obviously lacks direct knowledge of the qualia of a lot of things it pretends to have experienced. This also shows in its attempts at metaphor and analogy (but bear in mind this is all from early 2025).
> You might also find some detached or glossed-over metaphors. Is this "[I'm just a normal person, not some] superhero with a secret morning routine" really a particularly meaningful concept to you? It feels empty to me. Who has a "secret morning routine"? Who would have been thinking of such a thing before it was forced into the frame by the writer? There will often be a lot of this kind of disingenuous pretending at human experience.
> The scenario . . . where someone is having fully articulated, coherent, and civil self-talk about their alarm while it is still going off, seems unrealistic to me.
> Oh, you sat wrapped in a hoodie with the morning's hot drink to watch the sunrise? Were you also cradling the mug in both hands? It's a good thing you included such a relatable and human detail by dropping in a reference to "that soft morning light". . . . Thanks!
> "It felt kinda magical in a chill way." Seriously?
> "It's like my brain worked better without all the usual distractions." If you pause again and contemplate this bit, as well as the one from earlier about the "texts" and "chaos" that used to make his mornings so hectic, is it not empty? . . . It's alluding to things without actually talking about them. It is using many words to say nothing. It's essential to be able to notice this. --