It's unclear whether Vision uses machine learning behind the scenes though. It's kind of implied in their docs that it uses CoreML behind the scenes (which makes sense with the other things it does like Face recognition and object tracking).
The nice thing is it detects "projected rectangular regions" so even if the puzzle isn't aligned with the camera it still works.
I do wish I had more control though; it runs into trouble sometimes and there's not much I can do other than apply heuristics afterwards to determine whether I should throw out the sample or continue.
Example of a bad read from Vision Rectangle Detection: https://imgur.com/a/RSpTG
Re:How We Built the ARKit Sudoku Solver
by zimpenfish on Friday October 13, 2017 @10:10AM
(#15465798)
> Example of a bad read from Vision Rectangle Detection: https://imgur.com/a/RSpTG
Well, it's technically correct - it did find a rectangle :)
> We use iOS11’s Vision Library to detect rectangles in the image.
Looking at https://github.com/gunapandianraj/iOS11-VisionFrameWork - this definitely doesn't touch CoreML