News for hackers. Stuff that matters.
Re:Science fiction hasn’t prepared us to imagine machine lea... by cstross on Sunday February 07, 2021 @10:42AM (#26055725)
One problem in written science fiction is the requirement for it to be at least vaguely commercially viable, which necessitates dramatic plotting and/or readability. ML is, to most non-technical people, intensely boring. How do you dramatize it?

I've published two novels that go there: 2011's "Rule 34", and -- coming out this September -- "Invisible Sun", and in both books ML is very much a subaltern aspect of the narrative. That is, neither book would have a plot without the presence of ML, but it's not really possible in my opinion to write a novel about ML in the same way that the earlier brain-in-a-box model of AI could form the key conceit of books like "2001: A Space Odyssey", "The Adolescence of P-1", or "Colossus" (examples from the 1960s and 1970s when it was still a fresh, new trope rather than being pounded into the dirt).

So it probably shouldn't surprise anyone much that SF hasn't said much about the field so far, any more than it had much to say about personal computers before 1980 or about the internet before 1990 -- what examples there are were notable exceptions, recognized after the event.

Re:Science fiction hasn’t prepared us to imagine machine lea... by EGreg on Sunday February 07, 2021 @11:44AM (#26056152)
Literally every movie or book that depicts AI in 100-200 years would be super boring.

Imagine star trek where instead of Data being one android, you just had a ton of machines that could do everything better than humans. No point for the humans to explore space or do anything. The end.

Imagine in Minority Report where Tom Cruise is instantly caught because his whereabouts can easily be tracked and triangulated, by his gait, infrared heart signature, smell, and a number of other things. Movie takes 2 minutes. The end.

In fact, this is the world we are building for ourselves. We're going to be like animals in a zoo, unable to affect nothing. Just like a cat has no idea why you're doing 99% of the things you do, but has to go along with it, similarly you will have no idea why the robot networks do 99% of their activities, you just kinda live your life with as much understanding as a cat has in your house, as you go about your daily business.

The closest I can think of is Isaac Asimov's "I Robot" maybe. And even there, the robots weren't in charge really.

Re:Science fiction hasn’t prepared us to imagine machine lea... by Izkata on Sunday February 07, 2021 @01:00PM (#26056713)
> Imagine in Minority Report where Tom Cruise is instantly caught because his whereabouts can easily be tracked and triangulated, by his gait, infrared heart signature, smell, and a number of other things. Movie takes 2 minutes. The end.

Agh, I can't find it now, but there's a short film half based on this: A time traveler from the future is identified instantly because she's in two places at once. The short has both of them in adjacent interrogation rooms, with two onlookers - a rookie and an experienced investigator - talking about how to identify time travelers. It ends with the experienced one commenting that they've been showing up more and more often.

Minority Report might not be possible with such technology, but it does open different possibilities.

Re:Science fiction hasn’t prepared us to imagine machine lea... by Malic on Sunday February 07, 2021 @01:41PM (#26057024)
Do share the name of the short, if it comes to mind later.
Re:Science fiction hasn’t prepared us to imagine machine lea... by jodrellblank on Sunday February 07, 2021 @04:32PM (#26058378)
I have a feeling it might be "Plurality" by DUST on YouTube, a 15min short film - https://www.youtube.com/watch?v=pocEN5HprsM

DUST make a lot of cool sci-fi short films, worth checking some of their others too https://www.youtube.com/c/watchdust/videos e.g. Bleem, the number between 3 and 4, slightly remeniscent of the film Pi and the crazy mathematician trope https://www.youtube.com/watch?v=qXnFr1d7B9w or Orbit Ever After, a love story in a dystopian Brazil style future of orbital habitats https://www.youtube.com/watch?v=DpFXMIxlgPo

And just because, from another channel a https://www.youtube.com/watch?v=vBkBS4O3yvY a short about quantum suicide - One-Minute Time Machine | Sploid Short Film Festival.

Re:Science fiction hasn’t prepared us to imagine machine lea... by Izkata on Sunday February 07, 2021 @05:40PM (#26058914)
Yep, "Plurality" is it - the parts of the interview I'm remembering are the explanation at 9 minutes and the plane crash at 9:40. Scrolled through their videos earlier but the name didn't stick out.
Re:Science fiction hasn’t prepared us to imagine machine lea... by BlueTemplar on Friday February 12, 2021 @10:11PM (#26121063)
Asimov wrote about that with his "zeroth" law of robotics.
Re:Science fiction hasn’t prepared us to imagine machine lea... by m463 on Sunday February 07, 2021 @02:35PM (#26057494)
That touches on a point about science fiction I've noticed.

reality can be boring. Reality dictates that we travel at a fraction of the speed of light. We cannot fix things we did. We have a limited lifespan.

Honestly the made-up stuff makes fiction a lot more entertaining. Time travel is really fun (though primer required a dive into wikipedia to unravel). Warp drives and wormholes open the universe to exploration. Living forever might be just as fun as time travel - you can fix stuff forward or just see it all. I don't mind suspending my disbelief.

EDIT: On the other hand, there might be one real subject that is interesting from

https://jsomers.net/i-should-have-loved-biology/

it had a quote:

Imagine a flashy spaceship lands in your backyard. The door opens and you are invited to investigate everything to see what you can learn. The technology is clearly millions of years beyond what we can make.

This is biology.

- Bert Hubert, "Our Amazing Immune System"

Re:Science fiction hasn’t prepared us to imagine machine lea... by perilunar on Monday February 08, 2021 @05:01AM (#26062629)
I'm the opposite: I find FTL, warp drives, and wormholes a bit tedious in SF. They've been done to death, and all they do is make exploring boring by reducing the immensity of the universe to nothing. Time travel is fun, but only for the jokes and paradoxes.

Realistic SF is more entertaining IMO. e.g. I much prefer The Expanse or The Martian to Star Trek or Star Wars.

Re:Science fiction hasn’t prepared us to imagine machine lea... by Gibbon1 on Sunday February 07, 2021 @05:52PM (#26058976)
I have long and continuous string of 'jokes' that are about a future where common technological items have been replaced by some sort of genetically engineered plant, animal or fungus.
Re:Science fiction hasn’t prepared us to imagine machine lea... by indymike on Sunday February 07, 2021 @12:14PM (#26056358)
"ML is, to most non-technical people, intensely boring."

Maybe, or maybe it's just an old trope as you point out. So much of science fiction assumes some level of intelligent computers and has since the beginning. The phrase "machine learning" is really a rebrand of the "thinking machines" of the 60s and artifical intelligence" of the 70s and 80s. Even in the old Star Trek TV series, you had people talking to the computer, not unlike we talk to Alexa, Siri and Hey Google today.

That said, now that people are seeing ML affect their lives directly, there is a lot of exploration that may be possible, as perhaps, ML is just not science fiction anymore.

Re:Science fiction hasn’t prepared us to imagine machine lea... by notahacker on Sunday February 07, 2021 @01:23PM (#26056875)
I think the point is we gained the scifi UX, and lost most of the interesting plot devices. We got the talking computer without enough self awareness or reliability or uniqueness compared with other forms of data interrogation to be a particularly interesting plot point.

Alexa and Siri and Google Home aren't going to take over the world or try to become human, and aren't infallible or even particularly smart. They're a speech input interfaces over a search engine with some jokes hardcoded in. From a technical standpoint, very impressive; from a fiction standpoint a dead end

Re:Science fiction hasn’t prepared us to imagine machine lea... by drdeadringer on Sunday February 07, 2021 @12:55PM (#26056680)
> ML is, to most non-technical people, intensely boring. How do you dramatize it?

To me it's akin to several scenes in the film "War Games" where you basically have to make a rogue AI in a computer sexy on film.

"Show a computer thinking. Make it scary. Inhuman. Enhance that it's impersonal."

So we get a camera person slowly walking around an obelisk-like table with ominous music. "This is where the AI lives, thinking on how to rain nuclear fire upon the vile Soviets, no humans need interfere, enhance and intensify, will Tic-Tac-Toe save us from our folly". And around and around the evil obelisk table we go watching bits flip up and down back and forth with nuclear missiles in question.

You can find similar elsewhere. Dramatic flashing lights on a server rack, a human taken over by external forces blindly jabbing at a keyboard or keypad with intense purpose. All of a sudden from these wonders computational magic happens.

Re:Science fiction hasn’t prepared us to imagine machine lea... by Balgair on Sunday February 07, 2021 @11:25AM (#26056006)
Hey Mr. Stross, I'm a big fan of your work! Thanks for hanging out here on HN with us. I thought Accelerando was superb. Keep up the hard work of writing! I know it can be tough, but your efforts have really paid off, at least to me.

One question, if you're up for doing any questions: what do you think about the use of drones and loitering munitions in the recent Azerbaijani-Armenian War of 2020?

Thanks again for all the hard work!

https://en.wikipedia.org/wiki/2020_Nagorno-Karabakh_conflict

Re:Science fiction hasn’t prepared us to imagine machine lea... by lostdog on Sunday February 07, 2021 @06:10PM (#26059093)
Scifi authors have definitely been writing about smart computers for a while now. Maybe some of the things that are newly specific to ML can be fodder for writing:

- When building an ML model, you think much less about the structure of the model and much more about getting a variety of data to feed it. One could imagine some really silly situations. If you're training an affect-recognition model, you might want to contract every single actor in hollywood to act out a single scene. Maybe your voice recognition model is not working on certain people, so you hunt down a specific person and force them to read all of Shakespeare's work out loud. You might work on self-driving problems, and every day you instruct a full village of people to enact a precise ballet of driving, walking, and roadwork, to get the autonomous brain to learn some weird corner case of reasoning. Similar to Player Piano, so many people will be working on non-directly-productive work, almost play-acting work so a computer can do it for real.

- Sometimes ML doesn't work in really weird specific situations. In the 90s, your program could stop working because the lighting and shadows changed, but now the reasons for something failing are so much more obscure. What is it like becoming an expert in psychology for something that doesn't even really think? What does that person do day-to-day and what does their boss think of them? Is it more like being an independent psychiatrist, or more like a police detective? (then again, I'm drifting into an Asimov plot even as I write this...)

- Each object you train an ML model on takes a certain amount of investment, in data collection, in debugging, and in adjusting the training process. Each object adds expense, so maybe a solution is to stop adding objects? Maybe your Alexa enhanced home edition was built in 2025, so to keep your house in order you can't buy items made from 2026 onwards. Or maybe it's a big societal issue, so the government mandates that every new item created must pay some kind of registration fee. Maybe it only allows 10 new items per year. Some people would be pretty unhappy about that.

Maybe you're right! Maybe switching from straight edges screws to philips screws makes for a really boring story, because we've already written every story that accounts for some kind of screw driver.

Re:Science fiction hasn’t prepared us to imagine machine lea... by DiggyJohnson on Sunday February 07, 2021 @02:17PM (#26057347)
Do you frequent any forums or sites recommend for the serious amateur interested in the production of the sci-fi?

I especially appreciate this discussion. It’s fun to think about the gaps in our imagination. Especially when it comes to science fiction, those gaps are often wider than we think.

Good luck with your work! I’ll be on the lookout for Invisible Sun, unless you recommend a different title.

Besides ML, do you have any other fururist predictions that are not being realized in science fiction?

Re:Science fiction hasn’t prepared us to imagine machine lea... by bfdm on Sunday February 07, 2021 @10:55AM (#26055802)
I tend to agree that ML will not itself be the subject, but rather a device or tool misused by Someone Bad. As you say, it's a necessary and integral piece of the story, but not the star.

For example, it brings to mind some combination of Minority Report and Eagle Eye, say. Where a surveillance state combined with ML analysis leads to something akin to pre-crime arrests and the fight back against that.

Re:Science fiction hasn’t prepared us to imagine machine lea... by Izkata on Sunday February 07, 2021 @12:48PM (#26056608)
> I tend to agree that ML will not itself be the subject, but rather a device or tool misused by Someone Bad.

I got a counterexample:

Person of Interest [0] was a crime series from 2011-2016 premised around machine learning. The opening narration from each episode of the first season[1]: You are being watched. The government has a secret system, a machine that spies on you every hour of every day. I know because, I built it. I designed the machine to detect acts of terror but it sees everything. Violent crimes involving ordinary people. People like you. Crimes the government considered "irrelevant". They wouldn't act, so I decided I would. But I needed a partner, someone with the skills to intervene. Hunted by the authorities, we work in secret. You will never find us. But victim or perpetrator, if your number's up, we'll find you.

Revealed in flashbacks over the first season, the government doesn't have access to the system. It runs independently (even from its creator) and just provides information.

Being TV it does of course expand past the original premise, with a reveal that it's not just a machine learning system but the world's first true AI, and later another AI with conflicting goals is brought online. But for the first season at least, the machine sticks to the role described in the narration, and appears to be just a machine learning system.

[0] https://en.wikipedia.org/wiki/Person_of_Interest_(TV_series)

[1] https://www.youtube.com/watch?v=yBfVndEtDyY

Re:Science fiction hasn’t prepared us to imagine machine lea... by dllthomas on Sunday February 07, 2021 @11:03AM (#26055865)
If you haven't read Minority Report, I recommend it.
Re:Science fiction hasn’t prepared us to imagine machine lea... by akovaski on Sunday February 07, 2021 @12:04PM (#26056296)
> Where a surveillance state combined with ML analysis leads to something akin to pre-crime arrests

While I haven't seen Minority Report or Eagle Eye, this aptly describes the anime TV series Psycho-Pass (2012). If I remember correctly, the show is mostly focused on the effects of having a crime-coefficient system.

Re:Science fiction hasn’t prepared us to imagine machine lea... by ilaksh on Monday February 08, 2021 @02:16AM (#26061663)
Great point. However,

I assume that you are aware but ML really is moving towards more general purpose AI.

For example, the Turing Award winners for Deep Learning (Hinton/LeCun/Bengio) have all listed the numerous shortcomings of today's narrow AI and public declared an earnest interest in more human-like capabilities. And started serious research programs attacking those shortcomings. With many of the current generation of researchers quite engaged with them.

There is progress on self-supervised learning, transfer learning, multimodal learning, more powerful models such as the transformer, extracting more accurate and fundamental latent spaces, model-based, online learning, more modular systems, 3d reconstruction from images and even videos, J. Tenenbaum's clear functional explanation beginning to be addressed with the new neural network tools, etc. Most of the results are not at the present moment inspiring enough to base a novel around. But there are many promising threads.

Re:Science fiction hasn’t prepared us to imagine machine lea... by justin66 on Sunday February 07, 2021 @12:39PM (#26056539)
It’s a bit of a tangent, but I got a kick out of hearing Paul Krugman make a glowing endorsement of your work last week:

https://www.nytimes.com/2021/02/04/podcasts/ezra-klein-podca...

Re:Science fiction hasn’t prepared us to imagine machine lea... by superkuh on Sunday February 07, 2021 @02:51PM (#26057630)
Robert Charles Wilson's "Blind Lake" (2004) is a scifi book about a (then) very near future when the data from telescopes would be almost as much hallucinated from big data models as composed of actual data from measurements. It's plot goes a little more quantum handwavy than direct machine learning but the gist is the same.
Re:Science fiction hasn’t prepared us to imagine machine lea... by jayd16 on Sunday February 07, 2021 @12:32PM (#26056489)
I feel like the Running Man is a good example of machine learning in sci-fi.

It dug into deep fakes and how they could be used to create a massive propaganda machine. I wouldn't call that boring.

Re:Science fiction hasn’t prepared us to imagine machine lea... by alecco on Monday February 08, 2021 @05:34AM (#26062850)
Greg Egan opened up the path with Sci-Fi novels based on hard physics. They have a select audience but they are a treasure.
Re:Science fiction hasn’t prepared us to imagine machine lea... by gradys on Sunday February 07, 2021 @11:04AM (#26055873)
How do I make sure I hear about Invisible Sun when it comes out?
Re:Science fiction hasn’t prepared us to imagine machine lea... by ideonode on Sunday February 07, 2021 @11:11AM (#26055929)
It's Charles Stross, one of the leading SF writers of the day.
Re:Science fiction hasn’t prepared us to imagine machine lea... by cstross on Sunday February 07, 2021 @11:24AM (#26055997)
... It's also the ninth (and final) book in a long-running series, so not the greatest starting point!
Re:Science fiction hasn’t prepared us to imagine machine lea... by klyrs on Sunday February 07, 2021 @01:12PM (#26056802)
Hah, Robert Jordan taught me to watch for the phrase "[n]th (and final)". No, I won't start on that book, but I'll definitely pick up a copy of the first :)
Re:Science fiction hasn’t prepared us to imagine machine lea... by cstross on Sunday February 07, 2021 @03:07PM (#26057766)
Hint: I remastered the original six book series in three revised omnibus editions circa 2011. (There's then a subsequent trilogy, of which "Invisible Sun" is the climax.) Anyway, start with "The Bloodline Feud" rather than the slim original marketed-as-fantasy six-pack. I learned a lot in the decade between writing the first books and re-doing them, and the omnibus versions read more cleanly.
Re:Science fiction hasn’t prepared us to imagine machine lea... by klyrs on Sunday February 07, 2021 @06:26PM (#26059204)
Awesome, thanks!
Re:Science fiction hasn’t prepared us to imagine machine lea... by Geminidog on Sunday February 07, 2021 @11:09AM (#26055916)
It’s even boring to technical people. It reduces intelligence to a multidimensional optimization problem. Now intelligence just involves all kinds of mechanical ways to fill out the weights for a neural network. I use to be more interested. Upon learning more about it, I am less motivated.
Re:Science fiction hasn’t prepared us to imagine machine lea... by cercatrova on Sunday February 07, 2021 @11:37AM (#26056108)
I've found exactly the same experience. Data science is mostly cleaning data in the first place, and the 10% that isn't, it's just fiddling knobs (hyperparameter optimization) to get the model to work.

But man, I can't argue the incredible results it creates. Perhaps that's why people do it, for the ends not the means.

Re:Science fiction hasn’t prepared us to imagine machine lea... by karmakaze on Sunday February 07, 2021 @11:41AM (#26056135)
That's the difference between research and application. Someone had to first come up with better ways of formulating/training models.
Re:Science fiction hasn’t prepared us to imagine machine lea... by octodog on Monday February 08, 2021 @06:31AM (#26063215)
I work in a data science team and I think that motivates a lot of my colleagues. Delivering a product and looking at the massive impact it has on the business is very satisfying.
Re:Science fiction hasn’t prepared us to imagine machine lea... by karmakaze on Sunday February 07, 2021 @11:39AM (#26056121)
That's one way to look at it.

What's described there is the predicting patterns, which is a part of intelligence but there's much more to discover and invent. Even within the 'optimization' task there's huge differences in the leaps from NNs to DNNs and from DNNs to AlphaGo/Zero. The details are what make it interesting.

If we were to understand exactly how the brain operates and learns, we'd see that it's solved/solving just an optimization problem, but that doesn't make it uninteresting.

Re:Science fiction hasn’t prepared us to imagine machine lea... by saeranv on Sunday February 07, 2021 @02:38PM (#26057524)
I'm sure this is due to my beginner status in ML/DL, but I'm really disappointed in how much deep learning seems removed from the things that I enjoyed the most in statistical learning.

I enjoy the creative challenge of applying domain knowledge when building (for example) linear or bayesian regressions. In contrast, DL seems like a whole bunch of hyperparameter tuning and curve plotting. Curious to see if this assessment seems correct from those more experienced...

Re:Science fiction hasn’t prepared us to imagine machine lea... by mmcnl on Sunday February 07, 2021 @05:59PM (#26059029)
Technical is quite a broad term. There are quite some challenges in designing and engineering large ML data pipelines, both from a technical and business perspective. But I agree it's a specific problem that is arguably boring to a lot of people. Some people take more fun in the modelling part, others more in the engineering. Personally, I'm more into the engineering part than creating the actual model.
Re:Science fiction hasn’t prepared us to imagine machine lea... by gnramires on Sunday February 07, 2021 @01:30PM (#26056935)
Isn't that like saying, "I used to marvel at nature, that it has elements such as fire, water, ice, and amazing living things. Then I discovered it is all made of atoms interacting... I am now less motivated." ?

I mean, the fire, the water, the ice, the amazeness of life and intelligence are still there. You just gained a new foundational view. Now you can understand and manipulate better what you already knew, maybe now you learned about plasma, or even extremely advanced and mysterious phenomena like bose-einstein condensates or superfluidity. The old wonders are still there, you've gained new ones.

I'm not going to claim complete cognitive equivalence (or even preference) between the two states of mind, but it is a bit like childhood: firmly believing in Santa Claus, or Wizards or whatever can be exciting, perhaps more exciting than knowing they are myths; but growing up and understanding they are mythical brings new opportunities, capabilities, and even new mysteries you could not reach before (buying and building whatever you want, vast amounts of knowledge, understanding more about technology and society, etc.). It's the adults that keep us alive and well, that make decisions for us and for society at large. So perhaps (although I'm not entirely convinced by the cumulative argument) truth is a sacrifice, but it is one well worth bearing, at least for me. I am deeply interested in how intelligence works, in how "the sausage is made" (at least for certain highly useful sausages that compose the fundamentals of the world).

Even more, understanding is above all a responsibility, if not for all of us, at least for some of us, or hopefully in one way or another for most of us.

I can't recommend enough Feynman on Beauty: (this argument is largely inspired by that)

https://fs.blog/2011/10/richard-feynman-on-beauty/

In the same vein, intelligence to me used to be a black box where you got input from the world, some kind of wondrous magic happened, and then you got talking kids, scientists, artists, and so on. Now I still view it as wondrous, but now I understand the fundamental is apparently a network-like structure with functional relationships that change, adapt to previously seen information in other to explain it, that there are a number of interesting phenomena and internal structures (going well beyond the simple idea of 'parameter tuning') that can be formalized -- essentially the architecture of the brain (or better, 'a brain').

To give an example, there have been formalizations of Curiosity, i.e. Artificial Curiosity, and I consider it essential for an agent interacting independently in the world or in a learning environment (part of the larger problem of motivation). How amazing is it to formalize and understand something so profound and fundamental to our being as Curiosity? I felt the same way about Information theory years ago. How amazing is it that we've built robots (in virtual environments), and it works -- they're curious and learn the environment without external stimulus?

Above considerations aside, I find that amazing, beautiful, awesome.

Re:Science fiction hasn’t prepared us to imagine machine lea... by gnramires on Sunday February 07, 2021 @03:10PM (#26057790)
There's another related concept I came up with thinking about this discussion (which I've had with friends as well): 'freedom of utility'.

The basic idea is, forget about what you think is beautiful or motivational. Suppose you could choose to be motivated by something. Would you choose to be motivated by superficial mystery, or by deep knowledge of how things are? Should you choose to find beautiful just the surface of the flower, or also the wonders of how it works, its structure as a system, the connections to evolution and theory of color and so on -- all of which could turn out to be useful one way or another. If you could choose, would you choose to be exclusively motivated by the immediate external appearance or by the depth and myriad of relationships as well?

Unfortunately, (unlike AI systems we could design) I don't think we have complete control of our motivation -- our evolutionary biases are strong. But I'm also fairly certain much of our aesthetic sense can be shaped by culture and rational ideals. If I hadn't heard Feynman, watched so many wonderful documentaries (and e.g. Mythbusters) and many popularizers of science, perhaps I wouldn't see this beauty so much as I do -- and I'm grateful for it, because I want to see this beauty, I want to be motivated to learn about the world, and to improve it in a way.

Re:Science fiction hasn’t prepared us to imagine machine lea... by jacquesm on Sunday February 07, 2021 @01:47PM (#26057074)
Sagan: "The very act of understanding is a celebration of joining, merging, even if on a very modest scale, with the magnificence of the Cosmos."
Re:Science fiction hasn’t prepared us to imagine machine lea... by Geminidog on Sunday February 07, 2021 @03:54PM (#26058103)
> Isn't that like saying, "I used to marvel at nature, that it has elements such as fire, water, ice, and amazing living things. Then I discovered it is all made of atoms interacting... I am now less motivated." ?

Yes it is exactly what I'm saying. I'm less interested because of this. I could turn it around and also say that with your extremely positive attitude you can look at a piece of dog shit and make it look "amazing." Think about it. That dog shit is made out of a scaffold of living bacteria like a mini-civilization or ecosystem! Each unit of bacteria in this ecosystem is in itself a complex machine constructed out of molecules! Isn't the universe such an interesting place!!!!!

This history of that piece of shit stretches back though millions of years of evolutionary history. That history is etched into our DNA, your DNA and every living thing on earth!!! All of humanity shares common ancestors with the bacteria in that piece of shit and everything is interconnected through the tree of life!!! We can go deeper because every atom in that DNA molecule in itself has a history where the scale is off the charts. Each atom was once part of a star and was once part of the big bang! We, You and I are made out of Star Material! When I think about all of this I'm just in awe!!!! wowowow. Not.

I'm honestly just not interested in a piece of shit. It's boring and I can't explain why, but hopefully the example above will help you understand where I'm coming from.

Re:Science fiction hasn’t prepared us to imagine machine lea... by gnramires on Sunday February 07, 2021 @06:17PM (#26059131)
Well... dog shit is kind of amazing. ;)

You see, there are people out there that legitimately, professionally study poop for a living. I read a book (well, part of it) Gorillas in the Mist, by Dian Fossey, and there is an appendix on parasites, mostly using fecal analysis. Literally, a chapter on poop and worms. Reading it without prejudice, I found it extremely interesting.

Should we just say 'ewww', 'dog shit is boring, no one should study it'; or should we give it the benefit of doubt? What makes something interesting? I'm sure you could study poop and parasites for years -- they tell you about the diet of an animal without having to follow it day and night, they reveal parasites that may be of health concern for human poop.

Should we, as a society, forsake all study of poop by deeming it boring? Are those people that study poop, and don't find it boring, wrong? Or maybe they secretly go about their job finding it extremely boring? I doubt it.

> Yes it is exactly what I'm saying. I'm less interested because of this.

I think you're falling victim to reductionism. I meant my example literally: because everything is just atoms, should everything be boring? (if intelligence is just parameter adjustment) I suppose you don't find literally everything boring despite literally everything being just interacting atoms.

You could have this reductionist attitude on anything really:

Once I found out mathematics is just manipulating symbols, I am less motivated/Once I found math is just deriving from axioms, I am less motivated/Once I found life is just a bunch of organisms fighting for survival, I am less motivated

Does it really make sense to be less motivated, is the subject matter really boring, or are you just taking a reductionist argument and replacing the nuance and complexity and beauty of the real thing with a reductionist model (that doesn't really tell us much about how it works)?

Going even further: forget about machine learning. You can formulate physics so that Nature, everything, is locally minimizing (optimizing) a high-dimensional energy function. Literally everything in the Universe is parameter tuning! Oh no, everything is boring! :p

To me, then, there are three pillars of what makes something interesting:

1) It is useful;

2) It has breadth of knowledge (i.e. it's not a trivial matter you can learn in one sitting);

3) It has structure (i.e. it's not just rote memorization)

If I pointed someone to a perfectly uniform white wall and with an extremely positive attitude he declared "Amazing!", and spent hours going "Look how white the white is... what purity, I will stand here all day contemplating different aspects of the whiteness", I'd think he's yes a bit different. But it's not difficult to argue why we think that.

Another point of confusion, is that we're not all in the same situation. Each person has a set of skills, and a background knowledge, such that, for an individual, a subject can seem more or less useful, more or less related to everything he knows (thus much structured, connected, rich), and more or less aligned with his skills. It's perfectly acceptable to declare something as not interesting to him, but not plain boring, universally uninteresting.

I cannot advance much further without talking about the specifics of intelligence: do you know learning theory (PAC learning, etc.), reinforcement learning, all the interesting mathematical structures e.g. in convnets, GANs, Wasserstein-GANs, cognitive psychology, neurobiology, etc.. I think my argument is easy because in this case 'intelligence' is so vastly broad, reaching most areas of math, engineering and science that I doubt with serious effort someone could still blankly classify it as uninteresting (unless you literally do find everything uninteresting... you should be a bit worried about that, I'm serious).

And like in every field in practice one would not sit every day thinking in abstract terms about 'intelligence' -- you would be trying to solve specific problems e.g. what kind of neural architecture could be used to solve a specific problem, what kind of data augmentation can I contribute, or more advanced problems like what is the internal architecture of a robot.

Thank you for the opportunity of laying out those thoughts :)

(Please read my other comment as well, and I have a few things to add w.r.t. hyper-specialization)

Re:Science fiction hasn’t prepared us to imagine machine lea... by Geminidog on Monday February 08, 2021 @03:05AM (#26061915)
When I said you're the guy that can see the bright side of dog shit I was startlingly accurate. You're that one guy people call "excessively positive."

Every time your brain sees something related to "science" it automatically dumps a gallon of dopamine into the happy center of your brain giving you euphoria equivalent to a line of heroin.

I wonder what's your positive spin on the holocaust? There's actual science that came out of that event.

Re:Science fiction hasn’t prepared us to imagine machine lea... by Schiphol on Sunday February 07, 2021 @11:21AM (#26055980)
> It reduces intelligence to a multidimensional optimization problem.

Did you mean to say "... which it is not", or "which it is, thus the boringness"?

Re:Science fiction hasn’t prepared us to imagine machine lea... by Geminidog on Sunday February 07, 2021 @11:26AM (#26056011)
Let me clarify. I mean “intelligence from the perspective of modern ML” is just an optimization problem.