News for hackers. Stuff that matters.
Re:Google Goggles by bradgessler on Monday December 07, 2009 @04:52PM (#982261)
This is a great example of how Google could out-do the iPhone. The more non-trivial mobile applications have some processing that happen in the cloud. If Android phones could translate voice in real-time during a phone call and the iPhone could not, which phone would you consider buying?

Realistically though Google wants their services and applications on all platforms; now if only the App store would approve these...

Re:Google Goggles by paul9290 on Monday December 07, 2009 @06:52PM (#982565)
Yeah but to me the quality of any manufacturer then Apple falls short. I've owned Windows Mobile, Andriod (HTC Hero) and now iPhone. iPhone for me is superior.

Google i think needs to make their own device to match the quality/stability of the iPhone!

Re:Google Goggles by stcredzero on Monday December 07, 2009 @11:14PM (#982993)
Yeah but to me the quality of any manufacturer then Apple falls short.

If it had been written "qualaty" then it would've been a delicious Dilbert reference. (For more than one reason -- left as exercise, hint included.)

Re:Google Goggles by jodrellblank on Monday December 07, 2009 @05:07PM (#982309)
One step closer to photographing a sign in a foreign country and doing OCR followed by Google Translate, maybe followed by overlaying the translated text back on the sign.

I think this would be a killer feature. I've never had much of a positive response when posting it as an idea previously - is it the case that if it really would be a killer feature, people would be all over the idea as well as the implementation, or is it possible to be a little supported idea that turns into a killer feature?

(Edit: Or maybe it's just more a European thing where several foreign languages are a few hours drive in any direction?)

Re:Google Goggles by litewulf on Monday December 07, 2009 @05:56PM (#982432)
One thought I had is that there really aren't enough different signs.

In most foreign countries, I've been able to recognize signs for bathrooms and such, and most place names I can memorize (even if I can't read the language I can still think "okay, I want to go to the one with the squiggly second character").

I actually think this has high "cool factor", but have difficulty really coming up with uses. I think restaurant menus (as mentioned by my sibling comment) is probably the only real use, and even then knowing the name of the dish doesn't guarantee an item I'm able to eat.

Also, when I go abroad, I am definitely not enabling data roaming. In some countries, buying a prepaid SIM requires lots of documentation which is difficult to do if wandering around doing tourist-y things, etc.

(Sorry, I do think the idea is cool, I'm just trying to come up with reasons why its not the neatest thing since sliced bread)

Re:Google Goggles by jodrellblank on Monday December 07, 2009 @07:15PM (#982613)
> but have difficulty really coming up with uses

Uses would be more about being a tourist and getting a feel for where you are than mens/womens toilets - as you say, you can memorise those fairly quickly.

More like, standing in a subway, there's a poster, it says something about the train something ... wonder what? Walking past a big lake, there's a sign about some project that involves a pipe low down and a pipe further up, but what is it doing - taking thermal energy or using the water as coolant? Walking through the city streets, there's a plaque on the side of a building - something something 1872 something national? people? something something Joan 1st. Eh? What's on these fliers that are being handed out? What are the menu descriptions?

The easier it is to do, the more likely you are to do it - it's only important things that you would fish out a dictionary and start deciphering, this would be for everything and anything which attracts your interest.

Good point about the data roaming, though.

Re:Google Goggles by thalur on Tuesday December 08, 2009 @06:53AM (#983522)
> Also, when I go abroad, I am definitely not enabling data roaming.

I think this is an important point, which is freqently forgotten. So many apps that would be useful in a foreign country are useless because they require internet access. When I went to Bulgaria last year I would have loved to have a translator app for my iphone, but every single one available required internet access, which there's no way I'm paying for at £3/MB!

Re:Google Goggles by gaius on Tuesday December 08, 2009 @12:26PM (#984120)
If you are with a provider that is everywhere anyway, like Vodafone or T-mobile, the idea of roaming is very obviously just about gouging money. It's not as if T-mobile has to pay a third party by the Mb to ship data from Germany to the UK, they own all the infrastructure anyway!
Re:Google Goggles by jacobolus on Monday December 07, 2009 @09:15PM (#982820)
All it needs is OCR and a cross-language dictionary built in. There's no need for data roaming to make this sort of thing.
Re:Google Goggles by mbrubeck on Monday December 07, 2009 @09:57PM (#982877)
True, but without a data connection you're limited to the client's processing power. With analysis on the server, you can use algorithms that require more code, more CPU, or more memory, as well as much larger datasets.
Re:Google Goggles by sgk284 on Monday December 07, 2009 @08:29PM (#982749)
http://www.pictranslator.com/

I attended their launch party last month in Seattle. Works surprisingly well.

Re:Google Goggles by basugasubaku on Monday December 07, 2009 @10:12PM (#982902)
Off-topic, but I found it funny that their icon contains the Chinese, Korean, and Japanese flags yet they don't support any of those languages.
Re:Google Goggles by lpgauth on Monday December 07, 2009 @11:57PM (#983060)
Also off-topic, but one of the signs is "Danger tanks". Wonder if you'd pull out your iPhone to translate that sign.
Re:Google Goggles by jacobolus on Monday December 07, 2009 @05:54PM (#982429)
I’ve seen a working demo of this in an iPhone app, a few months ago: it’s like some kind of dark magic to see the translated words show up in the still-moving picture. I don’t know if the guy has released his stuff yet though.
Re:Google Goggles by benatkin on Monday December 07, 2009 @06:34PM (#982520)
I've seen such a demo as well. Was it written in C++ so the core of the app could be developed and tested in Visual Studio?
Re:Google Goggles by dangrover on Monday December 07, 2009 @09:01PM (#982799)
I think I met that guy too. I wonder when it's gonna be out?
Re:Google Goggles by roc on Monday December 07, 2009 @05:38PM (#982386)
To sell it to Americans, switch your example to restaurant menus. ;)
Re:Google Goggles by natmaster on Monday December 07, 2009 @07:18PM (#982622)
Previous work in the domain by others:

Nokia: http://digital.venturebeat.com/2008/04/11/nokia-develops-nav... (they use the golden gate as their example too) Also: http://www.mobvis.org/publications/MMT2007_Paletta.pdf, http://mirw09.offis.de/paper/What%20is%20That%20-%20Object%2...

'World browser': http://www.wikitude.org/

Using GPS together with the compass to get interesting results: 2006, Japan: http://www.nytimes.com/2006/06/28/technology/28locate.html and now there are iPhone applications http://www.youtube.com/watch?v=U2uH-jrsSxs&feature=playe...

Re:Google Goggles by thrdOriginal on Monday December 07, 2009 @04:12PM (#982163)
For those of us who may have done a couple searches on the Market wondering why this isn't showing up: google goggles requires Android version 1.6.
Re:Google Goggles by jrockway on Monday December 07, 2009 @04:38PM (#982227)
Which Android products with Market don't have 1.6 yet?
Re:Google Goggles by mbrubeck on Monday December 07, 2009 @05:10PM (#982315)
At least some of the HTC phones with "Sense" UI, like the Verizon Droid Eris, are still shipping with Android 1.5.
Re:Google Goggles by jrockway on Monday December 07, 2009 @05:32PM (#982367)
Ah, the joys of unsupported third-party hacks :)
Re:Google Goggles by thrdOriginal on Monday December 07, 2009 @05:35PM (#982377)
The Sprint HTC Hero which launched two months ago as well as T-Mobile's MyTouch both shipped with 1.5; the T-Mobile G1 can be upgraded to 1.5.
Re:Google Goggles by benatkin on Monday December 07, 2009 @06:36PM (#982526)
The T-Mobile G1 was updated to 1.6 a couple of months ago.

http://www.gsmarena.com/tmobile_g1_and_mytouch3g_get_android...

Re:Google Goggles by simanyay on Monday December 07, 2009 @06:54PM (#982572)
myTouches should be on 1.6 already. T-Mobile was pushing the update in October (November?).
Re:Google Goggles by anguslong on Monday December 07, 2009 @08:56PM (#982790)
Confirmed on my MyTouch (worst phone name evar - though very happy with the beast).

App works fantastic in practice in my tests, though choked on one case tonight. Had kids in car, drove by movie theater -- no showtimes/reader board visible outside (theater is in the mall).

Tried to get showtimes by 'reading' AMC theater logo on side of building ("daddy, why are you taking a picture of that building?"). No go. Google maps and gps to the rescue.

Re:Google Goggles by nym on Monday December 07, 2009 @03:40PM (#982078)
Augmented reality starts becoming more than just a pipe dream. Expect a lot more of this.

P.S. Just went to ARdevcamp at Hacker Dojo last Saturday- it was a really exciting event. There were a lot more people than I expected, and lots of interesting discussion about this emerging space.

Re:Google Goggles by erikstarck on Monday December 07, 2009 @04:49PM (#982256)
First there was the internet of Documents (www).

Then there was the internet of People (social networks).

And the internet of Places (maps, LBS, still happening).

Soon we will see the internet of _Objects_ and something like Google Goggles will be the key driver.

Documents -> People -> Places -> Objects. What's next?

Re:Google Goggles by wallflower on Monday December 07, 2009 @05:35PM (#982376)
Perhaps not Google. Maybe Google and Facebook.

Robert Scoble has an interesting perspective on the ambitions of Facebook.

"Phase 1. Harvard only.

Phase 2. Harvard+Colleges only.

Phase 3. Harvard+Colleges+Geeks only.

Phase 4. All those above+All People (in the social graph).

Phase 5. All those above+People and businesses in the social graph.

Phase 6. All those above+People, businesses, and well-known objects in the social graph.

Phase 7. All people, businesses, objects in the social graph."

http://scobleizer.com/2009/03/21/why-facebook-has-never-list...

Re:Google Goggles by selven on Monday December 07, 2009 @08:00PM (#982694)
Fully integrated augmented reality. Once we get mind-machine interfaces working, we could have an application that looks at every object around you, checks which one you're focusing on and somehow the entire Wikipedia article on it is already in your mind.
Re:Google Goggles by ntoll on Monday December 07, 2009 @07:24PM (#982633)
Documents -> People -> Places -> Objects. What's next?

You should check out FluidDB from the FluidInfo guys... http://fluidinfo.com/

Re:Google Goggles by Maciek416 on Monday December 07, 2009 @03:25PM (#982051)
Can anyone who has an Android phone who has tried this out for a few hours/days report on how well this works in practice? This looks pretty fantastic, especially if it can also read stuff like QR codes, etc.
Re:Google Goggles by gchucky on Monday December 07, 2009 @04:03PM (#982141)
Just gave it a test and it works pretty well. The image needs to be clear, but it was able to read the American Express logo off of my bill, a website address off of a keychain, and the Time Warner logo off of the remote.

Edit: I tried an image of the Centrino and Vista logos side by side on my laptop and its top result was for a German book. It did get the Centrino logo in the Other results, though.

Re:Google Goggles by danfitch on Monday December 07, 2009 @03:58PM (#982126)
Tried it out searched a book cover...worked searched some text on a page worked... I wasn't going outside in 20 degree weather to check on the locations but from inside it kinda worked... not bad
Re:Google Goggles by jimmyjim on Monday December 07, 2009 @03:46PM (#982090)
It works exactly as advertised. Delightfully accurately.
Re:Google Goggles by jfno67 on Monday December 07, 2009 @04:33PM (#982218)
Worked pretty good on logos around the office. Also great for business card, recognised all the data, but the add to contact was not selecting the most relevant data.

It did great with QRCode too, but those were already easy to read. It's faster with Barcode Scanner.

Re:Google Goggles by harry on Monday December 07, 2009 @04:19PM (#982189)
This works really well. Picked out the KU logo and Swingline staplers perfectly. Choked on a big box o Jolly Ranchers. I'll prolly keep futzing with this for the rest of the day now.
Re:Google Goggles by harry on Monday December 07, 2009 @04:23PM (#982200)
Took a picture of a Halflife 2 poster I have in my office (http://store.valvesoftware.com/productpages/prints/product_H...) - not only did it return a strider battle youtube but also a wiki article on it.
Re:Google Goggles by nym on Monday December 07, 2009 @04:52PM (#982263)
Worked with a bottle of A1 steak sauce and a restaurant logo - although I think it used OCR actually for the 2nd one, but still impressive.
Re:Google Goggles by amohr on Monday December 07, 2009 @04:05PM (#982149)
google just started a campaign for "favorite places" google.com/favoriteplaces that uses QR - I assume these are not entirely unrelated.
Re:Google Goggles by cmelbye on Monday December 07, 2009 @07:44PM (#982669)
Damn you for making me want an Android-based phone, Google! First free turn-by-turn navigation, now this. Argh. Once AT&T gets a good Android phone, I'm switching.
Re:Google Goggles by jcapote on Monday December 07, 2009 @07:59PM (#982693)
Just tried it on my G1; This works really well.
Re:Google Goggles by mrtron on Monday December 07, 2009 @05:07PM (#982308)
The number of mashups I would like to do...

Desperately awaiting an API.

Re:Google Goggles by jpwagner on Monday December 07, 2009 @03:55PM (#982118)
there's some scary future uses for this.

getting someone's number at a bar will be so much easier.

Re:Google Goggles by pgbovine on Monday December 07, 2009 @04:01PM (#982137)
cell phone cams + face recognition + facebook ==> super creepy

EDIT: since people post so many pics of themselves on facebook under all sorts of lighting conditions and angles, that might actually make face recognition somewhat feasible from a cell phone cam. of course, efficiently searching thru a corpus of millions of faces (each taken at several different angles) is an enormous technical challenge. i envision some app like Shazam being developed to recognize faces rather than songs ...

Re:Google Goggles by ericd on Monday December 07, 2009 @05:06PM (#982306)
Yep, FB has an enormous corpus of accurate training data due to its millions of users performing tagging on hundreds or thousands of photos each. I would venture to say that they're the only ones that could do this/enable this to be done.
Re:Google Goggles by liuliu on Monday December 07, 2009 @05:00PM (#982287)
I've done this kind of research 4 years ago based on general Internet image. That was a failure, but because of the rising of Facebook, it might work again. Someone already work on this for sometime: face.com.
Re:Google Goggles by quilby on Monday December 07, 2009 @05:47PM (#982409)
Ive talked with one of the guys from face.com . They have put a lot of effort into making their system very fast and scalable.

He told me that they built it from scratch and did not use OpenCV. Some parts were even written in assembly.

Im pretty sure that this is the only web application that I use that has had major parts of it written in assembly.

Re:Google Goggles by liuliu on Monday December 07, 2009 @08:36PM (#982762)
I agree that for some specific tasks OpenCV is not particularly useful (I have to write detector and trainer from scratch even there is opencv haartraining. The OpenCV crowd are most interested in applying it to real-time video processing and put little effort on Internet scale problem).

But for assembly optimization it is really not as useful as it used to be. Scalability is more about how to get sub-linear time complexity and efficient communication pattern. Nowadays c compiler can get fairly good assembly code and for low level optimization, human cannot compete with machine (how many people knows the particular cache line alignment trick on old core i7?). Multimedia instructions (SSE/MMX/3D Now) are useful but most of them can be done by function call instead of hand-crafted assembly.

Re:Google Goggles by talklittle on Monday December 07, 2009 @04:29PM (#982211)
And the GPS info could narrow down the search in most cases.
Re:Google Goggles by wallflower on Monday December 07, 2009 @07:06PM (#982596)
> of course, efficiently searching thru a corpus of millions of faces

There was research cited here a while ago on the high accuracy obtained by constraining the search space to within one's social graph (hundreds vs millions). While it might not identify the stranger at the bar, it might identify their companions and so on. Six degrees of separation in real-time.

Re:Google Goggles by mbrubeck on Monday December 07, 2009 @05:09PM (#982313)
Add in security camera networks and you get all sorts of geographic applications without the need for always-on GPS!
Re:Google Goggles by hristov on Monday December 07, 2009 @04:43PM (#982243)
For me this won't be very useful until someone develops the more crucial ass recognition technology.
Re:Google Goggles by aw3c2 on Monday December 07, 2009 @04:38PM (#982226)
quick, patent it
Re:Google Goggles by symesc on Monday December 07, 2009 @03:57PM (#982124)
Google's relentless focus on speed within search is going to play perfectly in the realm of augmented reality.

I anticipate a video version of this soon.

Re:Google Goggles by Prolorn on Monday December 07, 2009 @04:58PM (#982278)
Doesn't the "Places" feature count as video?

http://www.google.com/mobile/goggles/#place

Re:Google Goggles by symesc on Monday December 07, 2009 @07:52PM (#982684)
Yes.

But as per the other response here, I'm not sure it's using the video so much as the location and orientation to deliver results.

I'd like to see a version, like the still-photos, whereby the search engine is translating in real time as new objects enter the frame.

While I'm at it, I'd like it to perform these tasks with a T-800-style HUD.

Droid indeed.

Re:Google Goggles by Devilboy on Monday December 07, 2009 @05:37PM (#982383)
If I understand it correctly it just uses your GPS and magnetometer to work out where you are, it doesn't actually use the video data like it does for the still pictures you feed it.
Re:Google Goggles by wallflower on Monday December 07, 2009 @04:59PM (#982280)
I'm eagerly awaiting an AR app for language learning. See the native labels for objects like a VH-1 Popup video.
Re:Google Goggles by migpwr on Monday December 07, 2009 @05:01PM (#982291)
It works surprisingly well! It also includes an option to rate the results at the bottom of the search results.
Re:Google Goggles by cyen on Monday December 07, 2009 @05:33PM (#982369)
reminds me of a much more practical version of some of the cool bits from the "sixth sense" interface that was presented at TED / all over the news awhile ago - http://www.pranavmistry.com/projects/sixthsense/ . There, their prototype was also able to "look at" an object and return information about it immediately (e.g. you hold up a book in front of the camera, a processor recognizes it and pulls some relevant information, and the mini projector next to the camera projects the information back onto the book cover)
Re:Google Goggles by quilby on Monday December 07, 2009 @05:51PM (#982422)
Where does the info for the landmark recognition feature come from? Is it from street view?

I dont see how the landmark recognition feature could be useful. If you have a camera + 3g on your phone, you have a GPS.

Re:Google Goggles by mbrubeck on Tuesday December 08, 2009 @09:41AM (#983724)
The latest iPod Touch has a video camera but no GPS. The same is true of various other non-phone handheld tablets. (Though landmark recognition might not be useful on those, since apparently it actually uses the GPS and compass as input...)
Re:Google Goggles by Retric on Monday December 07, 2009 @05:57PM (#982436)
3g adds nothing to this. Any network of sufficient bandwidth would work.
Re:Google Goggles by steveklabnik on Monday December 07, 2009 @04:40PM (#982230)
Reminds me of the first time I saw TinEye. Mobile is sweet, though.
Re:Google Goggles by natmaster on Monday December 07, 2009 @06:38PM (#982534)
Very cool. I am interested in learning where they got their data from, and how they trained their image recognition algorithms.
Re:Google Goggles by zooted on Monday December 07, 2009 @07:28PM (#982644)
Re:Google Goggles by JCThoughtscream on Monday December 07, 2009 @04:42PM (#982236)
Oh, wow. With Google's backing, an AR future suddenly doesn't seem very far off at all.
Re:Google Goggles by wglb on Monday December 07, 2009 @05:29PM (#982357)
Very cool. It seems to work on the first few things I tried with my droid.
Re:Google Goggles by eduardoflores on Monday December 07, 2009 @05:00PM (#982284)
why aren't they enabling this for PCs/Netbooks & webcams?
Re:Google Goggles by ephermata on Tuesday December 08, 2009 @12:54PM (#984183)
Speculation: Because those aren't as mobile as a phone, and because Android needs something to differentiate itself from the iPhone. First seamless turn by turn directions, now this.
Re:Google Goggles by fleaflicker on Monday December 07, 2009 @04:06PM (#982150)
there's an Easter egg in the yelp iphone app that does something similar.
Re:Google Goggles by GrandMasterBirt on Monday December 07, 2009 @04:13PM (#982168)
impressive. Yet another reason to get droid. I wonder if verizon will get google to make these tools exclusively for the droid only.
Re:Google Goggles by nym on Monday December 07, 2009 @04:18PM (#982185)
It's already on the market available for phones other than Verizon's droid (tested on T-Mobile / G1).