Hi yeldarb! This is a really neat app. I don't want to diminish your creation, so please don't think I'm trying to put you down with this question:
How much of this was just glue-code to integrate a few modules, vs. how much did you have to do from scratch?
I'm asking to try to get an idea to see if ARkit is within the reach of an average joe- sudoku solver code could be a copy/paste, digit recognition could be a copy/paste, and ARKit should provide you with some environment/location info.
Have you tried to render individual digits in the existing empty squares instead of rendering a whole new grid? Coupled with a font detection algorithm this could end up looking more magical.
Hey, congrats on shipping! Unfortunately your app doesn't work for me :(. I've tried it on few sudoku designs on my laptop screen (don't have anything on hand right now) and there were two problems - the camera would not focus on the screen which resulted in blurry image, and second - it didn't recognize the puzzle correctly and returned incorrect results. I did put my screen flat on the table to simulate a paper laying on it, because I noticed the app doesn't work when the screen was upright - it rendered the results horizontally anyway.
Your app is awesome! What type of neural network did you use? Please write a post, I’m teaching myself machine learning and iOS development, and would love to learn from a successful developer!
Just tried it out, and it looks very good. It was a perfect way to demonstrate ARKit to colleagues. But for some reason it flips the board upside down.
Yeah, I am using Vision's rectangle detection.. but it's really touchy. I've got a lot of heuristics in there to throw out bad results and smooth things out.
It doesn't do well if there's something near the puzzle though (like a horizontal rule or text like you might see in a newspaper layout).
Any suggestions on a better way to segment the rectangles? Or any preprocessing tips (I couldn't really find anything that made it detect things more reliably)
Love these ideas! I have a long list of ARKit apps I want to build.. if only there were more months in a year.
I think my favorite is a Mario Kart style "ghost mode" for running. Where you could tell it what pace you wanted to go and it'd show ghost running in front or behind you at that pace!
Wow, I was at a hack night and saw a demo by someone who had made exactly this type of app on his computer using its webcam. He built a neural network and trained it, and it could even handle angles that weren't straight on. I don't think he's the same guy, but yeah, it's a clever idea.
I just submitted v1.1 to the App Store that supports puzzles on a vertical plane so once that lands you can load up https://websudoku.com on your computer monitor to try it out!
A crossword solver was what I originally set out to build. iOS11's Vision APIs for rectangle detection weren't good enough to even have a shot at it though.
With better rectangle detection I think it'd be pretty doable!
[+] [-] yeldarb|8 years ago|reply
(I was going to write up a medium post about the technical side of building the app but haven't gotten a chance yet)
[+] [-] olympus|8 years ago|reply
How much of this was just glue-code to integrate a few modules, vs. how much did you have to do from scratch?
I'm asking to try to get an idea to see if ARkit is within the reach of an average joe- sudoku solver code could be a copy/paste, digit recognition could be a copy/paste, and ARKit should provide you with some environment/location info.
[+] [-] pveierland|8 years ago|reply
[+] [-] M4v3R|8 years ago|reply
[+] [-] generic_T|8 years ago|reply
[+] [-] vegardx|8 years ago|reply
[+] [-] sdrothrock|8 years ago|reply
[+] [-] krilnon|8 years ago|reply
[+] [-] wlll|8 years ago|reply
[+] [-] dmichulke|8 years ago|reply
[+] [-] iamflimflam1|8 years ago|reply
Are you using the rectangle detection from Vision? https://www.youtube.com/watch?v=wt96OomJY9A
[+] [-] ToJans|8 years ago|reply
[+] [-] yeldarb|8 years ago|reply
Yeah, I am using Vision's rectangle detection.. but it's really touchy. I've got a lot of heuristics in there to throw out bad results and smooth things out.
It doesn't do well if there's something near the puzzle though (like a horizontal rule or text like you might see in a newspaper layout).
Any suggestions on a better way to segment the rectangles? Or any preprocessing tips (I couldn't really find anything that made it detect things more reliably)
[+] [-] sowbug|8 years ago|reply
- point at a board game and either do all the boring scorekeeping for me, or else advise me on best strategy
- take a photo of a bunch of lottery tickets and tell me whether I've won
[+] [-] pricechild|8 years ago|reply
It's just done with a QR code.
Unfortunately... there was a bug and it told people they hadn't won: http://www.independent.co.uk/news/uk/home-news/national-lott...
[+] [-] yeldarb|8 years ago|reply
I think my favorite is a Mario Kart style "ghost mode" for running. Where you could tell it what pace you wanted to go and it'd show ghost running in front or behind you at that pace!
[+] [-] rawnlq|8 years ago|reply
The cool new thing is projecting the solution onto the paper and having it track correctly!
[+] [-] cableshaft|8 years ago|reply
[+] [-] opendomain|8 years ago|reply
[+] [-] cultavix|8 years ago|reply
[+] [-] yeldarb|8 years ago|reply
Sneak peek of that update: https://twitter.com/braddwyer/status/910861205442527233
Several bug fixes included as well based on input from early users.
[+] [-] splike|8 years ago|reply
[+] [-] yeldarb|8 years ago|reply
With better rectangle detection I think it'd be pretty doable!
[+] [-] jdoliner|8 years ago|reply
[+] [-] gattilorenz|8 years ago|reply
[+] [-] DanBC|8 years ago|reply