But that definition is ... well bullshit. Bullshitting is a deliberate deceptive act. Children aren't being deliberately deceptive when they come up with nonsense answers to questions they don't understand.
I also think distinguishing bullshit from lying depends heavily on internal mental thoughts, goals, and intentions. Isn't talking about Dall-E this way personification and ascribing some level of consciousness?
However, I do think that Dall-E is able to learn complex high-order statistical associations, i.e. beyond just juxtaposing and visually blending objects. For a recent example, this post with a prompt "ring side photo of battlebots vs conor mcgregor":
https://twitter.com/weirddalle/status/1554534469129871365
What is amazing here is the excessive blood and gore. That feature can't be found in any individual battlebot or MMA match, but it is exactly what you would expect from robots fighting a person. Pretty amazing, and I wonder at what point we could consider this analytical reasoning.
I disagree. To the extent that the training data are images of actual objects, recreating images of actual objects is the only thing DALL-E cares about.
If we define "caring" about something as changing behavior to cause that to happen, then a neural network doesn't "care" about inference at all, because inference never changes the network's behavior.
It also doesn't know or care about your approval. It only cares about minimizing the loss function.
(But now that you bring this up, I think it would be really interesting to create a network that, after training initially on training data, began interacting with people and continued training to maximize approval.)
In any case, it does at least care about the appearance of the actual objects. So I think it would be fair to say that there are aspects of the actual objects that the network doesn't care about, but there are also aspects that it cares very much about. Thus it's not "wholly unconcerned with the actual objects".
https://en.wikipedia.org/wiki/Chinese_room
Dalle is very concerned with the 2d shapes of things we call objects, and has correctly inferred some rules about those shapes, but it neither knows nor cares about the things we call objects and how the shapes it has learned are representations of them. It doesn't do reasoning about the round peg fitting in the round hole. It just glues a few pegs and holes together in a way that's mostly consistent with our expectations and says "is this what you wanted"?
Its a student that cares about passing the test, not learning the material.
I care that my car is quiet and has comfortable seats, I don't care (or know) what material the muffler is made of, but somewhere there is an engineer who cared about that.
A road designer cares what the tires are made of and how much it weighs, but doesn't care what color the paint is.
An AI recreating an image of my car would care what color the paint is, but not how comfortable the seats are.
I think I see what you're describing - the AI has a very limited scope and doesn't know or care about most of the things we do - but I think that's just a limitation of our current small models and limited training data, not an inherent limitation of neural networks.
DallE doesn't really have a system of the semantics of objects. It doesn't know why it would be useless for a building to have all the doors on the 2nd level. Its not even clear that DallE makes use of discrete "objects" in its limited understanding.
Here's an example from budget DallE
It understood the shape of "stick figure" and "boobs", but had no understanding of what a stick figure is meant to represent and thus where it should place the boobs. The results are hilarious. I'm not sure which I like more, the guy with a boob casually walking down his arm, or the lady with a boob head that's shrugging with uncertainty.
Notably, this precisely describes humans too. We don't know the "true" properties of anything we interact with. We just have models - some more sophisticated than others - but only to the extent that we care for reasoning about the objects. From "This stone is too heavy to lift." to "Oh yeah Becky is always late."
- Your visual system only has access to the 2D geometrical properties projected on your retina. The properties are correlated across images, inexplicably. (I certainly cannot explain how chairs are, in a fashion that includes all chairs I've encountered and excludes anything I've encountered that is not a chair)
- Any other interaction is also a correlation.
- Humans don't have access to the laws of physics, just reasonable approximations in certain contexts.
For starters you just don't look at things, you're embedded in the world. You have sensory input far beyond visual information, you also have something akin to cybernetic feedback in response to your mechanical actions in the world, and DALL-E has not.
In fact DALL-E doesn't even have access to visual information in the same sense you have, which is to a large extent biochemical and analog, not digital.
We have accurate causal models of our own bodies, and are directly causally active in the world so we can create experiments which enable us to discover its properties.
We do not live in a schizophrenic nightmare, forever trapped just to correlate pixel patterns. The claim that we do must, imo, now strongly be labelled as pseudoscience.
This is the new homeopathy; and AI/ML based on it is a scientific fraud.
I think there's one significant distinction between a normal human bullshitter that Frankfurt originally envisioned, and the AI practicing Artificial Bullshit. The bullshitter knows there is truth and intentionally disregards it; whereas the AI is blind to the concept. I guess this is "mens rea" in a sense, the human is conscious of their guilt (even if they're apathetic towards it), whereas DALL-E is just a tool that does what it is programmed to do.
I do like this application of "bullshit" though, and will keep it in mind going forward.
1. What are the implications of intentionally disregarding the existence of truth vs being blind to the concept? How does this distinction you made manifest?
2. Are you sure all humans actually believe in the concept of truth, or could it be the case that some people genuinely function on a principle "there is no truth, only power". Is it possible to think "truth" and "current dominant narrative" are one in the same?
I've certainly had a ton of luck with Bullshit in Diplomacy. As Russia, I offered a plan that involved France helping me take Munich and I would repay by supporting him against the English invasion. Did I intend to actually follow through, or was this a cunning lie? Neither. It was bullshit that got me into Munich. I myself didn't know because (in game) I don't believe in the concept of truth. Everything I say is true and none of it is true. Its all true in the sense that it might happen and I put some weight on it, none of it is true in the sense that there is no branch of the future game tree privileged as "the truth". Some truths have more weight than others, but there is no underlying absolute truth value that must exist yet I choose to ignore. Eventually the order box forces me to pick a truth out of the many I have told. But prior to being forced, it didn't exist.
Is it possible to think in this way all the time about everything? Maybe.
This hits it for me:
Consciousness is kinda "being aware of the fact that you have choices for available actions, and what the impact of these actions/non-actions will have on either yourself, your environment, the object of your action, or impact on others.
Intelligence is being aware of the inputs and knowing the (non)available list of actions to take.
Intelligence acts on stimuli/input/data?
Consciousness is awareness of one's own actions from intelligence, others acts from their standpoint of intelligence or consciousness...
A yin/yang, subjective/objective sort of duality that Humans make. (thought v emotion)
Dogs are both intelligent and conscious. They know guilt when they are shamed or happiness when praised for intelligent actions..
If the bullshit is turning out to be true, what's the issue with more of it? If it's not true but still believed and so causing problems, what's the practical difference between it and an undetected lie that makes it more insidious?
A system can learn to do all kinds of interesting things by trying to optimize getting rewards.
Dall-E and GPT-3 are not being used as agents, they are just tool AIs. They have a narrow task - generating images and text. Agents on the other hand need to learn how to act in the environment, while learning to understand the world at the same time.
Per gp, bullshit is cynically self-interested pontificating. It's performance. Maybe you could say that the bullshit produced is imaginative, sometimes. But it has nothing to do with "imagination" as a simulation-like capability used for planning and learning.
In other words, the claim you've set up is basically unfalsifiable, given that thre's no way to form strong counterevidence from its outputs. (I would argue that if there was, we'd already have it in the vast majority of outputs that aren't images people want.)
If I were to refine what you're saying, is that DALL-E is constrained to generating images that make sense to the human visual system in a coherent way. This constraint is a far cry from what you need to be able to lift it up to claim it is "bullshitting" though, since this constraint is at a very low level in terms of constraining outputs.
In other words, the takeaway here may not be that GPT-3 spews bullshit. It may be that most of the time, human "thinking" is a less-nuanced, biological version of GPT-3.
I of course mean "bullshit" in the highly technical sense defined by Frankfurt [1]. The defining feature that separates a bullshitter from a liar is that a liar knows and understands the truth and intentionally misrepresents the matters of fact to further their aims, whereas a bullshitter is wholly unconcerned with the truth of the matters they are discussing and is only interested in the social game aspect of the conversation. Bullshit is far more insidious than a lie, for bullshit can (and often does) turn out to be coincident with the truth. When that happens the bullshitter goes undetected and is free to infect our understanding with more bullshit made up on the spot.
DallE generates the images it thinks you want to see. It is wholly unconcerned with the actual objects rendered that are the ostensible focus of the prompt. In other words, its bullshitting you. It was only trained on how to get your approval, not to understand the mechanics of the world it is drawing. In other words, we've trained a machine to have daddy issues.
A profoundly interesting question (to me) is if there's a way to rig a system of "social game reasoning" into ordinary logical reasoning. Can we construct a Turing Tarpit out of a reasoning system with no true/false semantics, a system only designed to model people liking/disliking what you say? If the answer is yes, then maybe a system like Dalle will unexpectedly gain real understanding of what it is drawing. If not, systems like Dalle will always be Artificial Bullshit.
[1] http://www2.csudh.edu/ccauthen/576f12/frankfurt__harry_-_on_...