Re:Google Home: An Insight Into a 4-Year-Old’s Mind
by pavel_lishin on Friday May 19, 2017 @03:35PM
(#14378753)
> Under the covers, it's like an old "choose your own adventure" game, assembling a narrative out of parts. And it uses eye tracking to detect what you're interested in. Do you like character A? Then we'll emphasize A.
Hannu Rajaniemi (science fiction author) tried to go further, and attempted to create an "interactive" narrative that actually used some brain activity sensors to see what imagery you most responded to: http://neurofiction.net/
Re:Google Home: An Insight Into a 4-Year-Old’s Mind
by mncharity on Friday May 19, 2017 @04:37PM
(#14379142)
> what imagery you most responded to
Apr 1, 2020 - Scary Zombie Game introduced "scared as you want to be"(tm), using real-time emotive feedback to adjust game art and story to achieve the desired levels, types, and temporal profiles of scare. The "won't startle a baby bunny" profile developed a camp cult following. Valve reports no player has ever completed the "continuously mounting dread with Poisson spikes of terror" profile.
With eye tracking perhaps widespread in the 2018 generation of HMDs, it seems an area likely to get increasing attention.
There's more to it.
I'm interested in multi-scale interdisciplinary story telling for science education. Sort of, sit down on the floor with a graybeard, who has fascinating stories about engineering and the world. And videos and interactives and questions. And you "pick up" all sorts of understanding and skills. Rather than the usual incoherent memorize and regurgitate.
So say you're today writing a web page with embedded videos. When showing the page in person, you can see what's of interest to the viewer; when something is getting boring; what is understood and what's confusing. You can respond to questions, address misconceptions, point to related content, and suggest different paths through the material. But what about when the page is viewed normally? Youtube-like "related links" are very limited. You can, at long last, do speech recognition, on some browsers. But dialog systems? Not ripe. Something as simple as "if they ask about those ripples, show them this other video" still isn't easy enough. "[R]espond in a meaningful way"? That could be breathtaking.
Someone did an art project. You go, and watch an interesting video. But why is it interesting? Under the covers, it's like an old "choose your own adventure" game, assembling a narrative out of parts. And it uses eye tracking to detect what you're interested in. Do you like character A? Then we'll emphasize A.
There's old advice, that since history is all connected, you should approach it from whatever interests you. Textiles, architecture, materials, food, games, environment, governance, whatever. It's all tied together, so start pulling the thread anywhere. Science and engineering are also very very richly interwoven. Or should be. We just teach it so very wretchedly.
And then there's AR/VR coming.
And for the "but irreplaceable humans!" arguments, there's work on collaborative human/crowd/computer composite agents. Like http://hdl.handle.net/1802/29594 .
So yeah. The next decade could be awesome.