Magic Sudoku - ARkit solves Sudoku puzzles using the magic of Augmented Reality! Built using Swift, ARKit, Vision, CoreML and some machine learning/neural networks
Hey all - I'm the developer of the app. Tried to come up with an ARKit app that wasn't just a "floating 3d model"
The app reads the camera data and passes it through Apple's Vision apis and into a CoreML model trained on recognizing Sudoku and then solves the puzzle and re-projects it out back into the scene.
Version 1 is mostly a tech demo and a "look what my phone can do now!" app. In V2 I hope to add a lot more useful features for actual players doing actual paper Sudoku puzzles.
@braddwyer Real cool! My use case would be to use it once I'm like: there's no way I'll be able to find the solution! Will with work with a failed sudoku attempt where some of the numbers are filled out? Rock on!
@aurorakb not yet! Definitely on the roadmap though. Need to train my neural network on more handwriting samples and then work on the UI. Coming soon :)
@braddwyer Well, technically you could do a couple things, re-create the sudoku in the app itself and let me solve it from within the app - this would be more 2D. Or you can just let me solve it in AR somehow haha, so there's no handwriting involved.
Between IKEA Place, the measuring apps, GIPHY, and now Magic Sudoku this has been a crazy week for AR. I cannot wait to see where this technology is in 2 - 3 years.
@yevgeniya_galich v1 is mostly a tech demo. Hoping people will want to show it off as a "look what my phone can do now!" feature.
In v2 we'll be adding features that make it actually useful for people who play paper sudokus. Stay tuned :)