News for hackers. Stuff that matters.
Re:Magic Sudoku – Solve Sudoku with the power of AR by yeldarb on Thursday September 21, 2017 @12:22AM (#15300577)
Actually the solving of the puzzle itself is just done with a simple recursive algorithm.

I trained a neural network to do the computer vision part to interpret the puzzles.

And there are a bunch of pre-trained networks built into iOS11's Vision API and ARKit that the app just uses black box.

Re:Magic Sudoku – Solve Sudoku with the power of AR by sdrothrock on Thursday September 21, 2017 @12:30AM (#15300607)
ahh, sorry for the misunderstanding.

Does the network do well with handwriting, e.g. puzzles that have been half-solved?

Re:Magic Sudoku – Solve Sudoku with the power of AR by yeldarb on Thursday September 21, 2017 @12:35AM (#15300623)
Well I wasn't going to spill the beans just yet but if you promise to keep a secret.. working on that for v2 :)

Edit: Although so far I've learned that some people have VERY bad handwriting. I'm having a hard time sanitizing a dataset because I can't even tell what digit they were trying to write

Re:Magic Sudoku – Solve Sudoku with the power of AR by IanCal on Thursday September 21, 2017 @03:36AM (#15301248)
Re:Magic Sudoku – Solve Sudoku with the power of AR by yeldarb on Thursday September 21, 2017 @03:50AM (#15301322)
Tried those first but no, they didn't work great with the data I was able to extract; those datasets are only handwritten digits which apparently weren't close enough to the computer printed ones.

I think the artifacts from the square borders (eg if it's slightly mis-cropped or misaligned) were also tripping up the model before I had my custom dataset loaded in there.

Edit: I should say this was my first stab at doing machine learning so I may be missing something; definitely open to ideas or suggestions!

Re:Magic Sudoku – Solve Sudoku with the power of AR by Tenobrus on Thursday September 21, 2017 @10:56AM (#15304052)
Shouldn't you be able to generate a lot of synthetic "printed-looking" digits very easily? Just get say 20 common fonts and render each digit with random rotations and scaling etc.
Re:Magic Sudoku – Solve Sudoku with the power of AR by yeldarb on Thursday September 21, 2017 @11:08AM (#15304190)
That's definitely on my list of things to try! Thanks for the push in that direction
Re:Magic Sudoku – Solve Sudoku with the power of AR by ianamartin on Thursday September 21, 2017 @12:47AM (#15300671)
I'm that guy. Sorry :(

I have the worst handwriting.

People are like, "Dude, wtf?" when I try to whiteboard stuff.

Re:Magic Sudoku – Solve Sudoku with the power of AR by yeldarb on Thursday September 21, 2017 @12:49AM (#15300681)
All good; validates that I'm at least on the right track! Had to pare back my ambitions quite a bit to get _something_ finished before the iOS11 launch.

I didn't expect the reception to be so enthusiastic for v1 tbh; but I guess I chose a good place to call it an "MVP"

Re:Magic Sudoku – Solve Sudoku with the power of AR by inlined on Thursday September 21, 2017 @01:29AM (#15300804)
I'm really interested in the growth of ML on mobile apps. Did you test the ability to call existing ML APIs in the cloud and found they weren't responsive enough, or did it just feel more natural to run the net locally?
Re:Magic Sudoku – Solve Sudoku with the power of AR by yeldarb on Thursday September 21, 2017 @01:40AM (#15300839)
I've played with AWS Rekognition a little bit. It's definitely WAY faster to do it on-device. Plus it works even in Airplane mode.

I'm running the iOS11 Vision stuff, my own text recognition CoreML neural network (81 times per loop), plus all the ARKit stuff and I can still get 30-60 fps on my iPhone 7+

Re:Magic Sudoku – Solve Sudoku with the power of AR by tyhui on Thursday September 21, 2017 @01:27AM (#15300798)
There shouldn’t be a need for that. All the info information you need to solve it all come with the puzzle.
Re:Magic Sudoku – Solve Sudoku with the power of AR by Someone on Thursday September 21, 2017 @02:52AM (#15301072)
They want to recognize the handwriting to give the player feedback on errors made.