WingNews logo WingNews GitHub [2]
top | item 25253598

Apple Create ML: Creating an Image Classifier Model

276 points| tosh | 5 years ago |developer.apple.com | reply

57 comments

order
[+] yeldarb|5 years ago|reply
CreateML is getting really impressive. I just went through the process of using it to train an Object Detection model to detect sharks and fish at an aquarium (and deploying the model to an iPhone) last week.

Final result: https://twitter.com/braddwyer/status/1330654868839784451

The full walkthrough video: https://www.youtube.com/watch?v=kBn7Cd8Z8yE

[+] wil421|5 years ago|reply
Do you think it would be possible to detect the species of shark? I was thinking about trying to detect what breed of dog or maybe species of fish someone caught.
[+] criddell|5 years ago|reply
That's really neat. Once your model is complete, does it work offline?
[+] crb002|5 years ago|reply
What apps do you use for drawing the labeling/bounding boxes?
[+] Unicode007|5 years ago|reply
Create ML is awesome and very user friendly. I achieved impressive accurate results to classify Among Us game states on Apple Silicon Macs to support keyboard controls.

https://news.ycombinator.com/item?id=25254954

I open sourced it today: https://github.com/andresavic/AmongKey

[+] tosh|5 years ago|reply
love this, I can already see how something like this could add keyboard shortcuts to apps that don't have them (or not the ones I want)

thanks for making this open source!

[+] codetrotter|5 years ago|reply
Next step will be to train the computer to detect who is acting suspiciously in the game, and then make the computer play the game for you so you don’t have to use any controls at all to play the game :p
[+] LeicaLatte|5 years ago|reply
If you are looking to automate training on your new M1 Macs, I have published some Create ML examples here which might help you get started - https://github.com/krishkumar/createml-playgrounds

These new chips run Create ML really well, no surprises there.

[+] dan1234|5 years ago|reply
Where did you get the movie reviews dataset? I'm interested in doing something similar for music.
[+] elpakal|5 years ago|reply
+1 on CreateML ease of use. Paired with some of the other models they provide out of the box, it can be very easy to get up and going quickly. I used it to create a mustache detector and before running an image through my model I needed to detect if an image had a face (images of hot dogs, for eg, were leading to weird results). I was delighted to find the ability to detect faces in a few lines of code right out of the box.

Now I just wish I could convert my model to Tensorflow! (or serve it over iCloud somehow?)

[+] douk|5 years ago|reply
I'm really curious if this training process is optimized for the new 8-core neural engine on the M1 SoC. I'd like to see a comparison between the performance on M1 vs Intel macs.

I supposed this might serve as a good demonstration of how the neural engine performs?

edit: Perhaps running inference in the iOS simulator on the macs would also be a comparison point?

[+] yeldarb|5 years ago|reply
We're actually running a benchmark of that very thing this week! I'll follow up with what we find.
[+] jagged-chisel|5 years ago|reply
For the ML-impaired, how portable is this process? Does it work on other ML platforms? Are the digital assets (specifically this MLMODEL file/bundle) easily transmuted to work with, say, TF?
[+] thebruce87m|5 years ago|reply
I’m also ML impaired, but would people really train the model on a Mac? Surely you would want to train in the cloud or on something with a proper discrete GPU. It seems that a better article would be how to take e.g. yolo and convert it.
[+] seek3r|5 years ago|reply
I did a quick Google search (so maybe I’m missing something) but there is no official support for converting Core ML — which is the foundation for Create ML — models to Tensorflow or PyTorch. You need to look for third-party libraries. Although there exist libraries to convert Tensorflow models to Core ML.
[+] uberneo|5 years ago|reply
Wondering if Create ML has a Sound Classifier as well.. Will make it easy to classify different bird's sounds or to identify music notes from different instruments.. something like piano/guitar notes classifier
[+] petargyurov|5 years ago|reply
For anyone looking into alternatives, I am currently compiling a list here [0]. The focus of the research is software that aids with the entire flow of a typical ecologist who wishes to classify/detect different species.

There are a lot of great pieces of software out there for non-technical users.

[0] https://www.notion.so/pgyurov/Camera-Trap-Pipeline-Solution-...

[+] iamgopal|5 years ago|reply
Is there a image classifier that use my Dropbox, scan all images sort by tag, and save all neural and tag data on folder itself ? That I can use to access all the images ?
[+] amelius|5 years ago|reply
That's cool. How can I transfer the learned model to an RPi so I can use it in my home automation project?
[+] petargyurov|5 years ago|reply
I am not too familiar with CreateML but take a look at Lobe. It allows you to export models and it also comes with the option of using MobileNet (which is more suitable for running on edge devices).

You can also find examples on how to use the exported model on Lobe's Github.

[+] nsriv|5 years ago|reply
This seems like Apple's answer to the recently Microsoft-acquired lobe.ai
[+] meesterdude|5 years ago|reply
Is there an upper limit to the number of classes you can train it to detect?
[+] momokoko|5 years ago|reply
It’s so sad to watch the success of Apple bring upon the impending death of open source.
[+] rodgerd|5 years ago|reply
Given pretty much every conversation on the topic of ML here advises people to use the proprietary NVidia ML tools with proprietary NVidia graphics drivers for NVidia cards, I'm failing to see this as any better or worse.