top | item 43432076

(no title)

varunnrao | 11 months ago

imo, Apple are actually ahead when it comes to the hardware side of the whole thing. Their vertical integration gives them an edge not many can match, when it comes to running ML models. It's a no-brainer for Apple to reduce the barriers for devs to build really cool native Mac/i{Pad}OS applications and incentivize them to leverage the built-in AI/ML abilities to a greater extent. The iPhone in part took off _because_ of the whole app ecosystem that got built around it. Sure they might take a loss in their services revenue in the short term but they get to be _the_ AI platform for at least the next decade and half - both on-device and server side with their new Apple silicon servers.

It's just that most Apple software seems to suck in some fundamental way right now. I don't know if it's a technical issue (SwiftUI being meh when compared to UIKit for example) or a culture issue or the money coming in insulating management from accountability. Software execution has been lagging behind the excellent hardware execution for almost all of the Tim Cook era. They desperately need someone like Scott Forstall to come in, kick butts and get stuff going again.

They ideally have a couple of years while waiting for Moore's Law to catch up to turn around their software side. Otherwise, it's a real shame that all that great hardware is just being used to run Electron B2B SaaS apps.

discuss

order

krackers|11 months ago

They also had (but squandered) the potential to be ahead on the software side. macOS is the only platform I'm aware of that has every app wired for scripting (AppleScript/Apple Events). And not only that, they already solved the issue of adoption since almost every well-behaved (read: non-electron) application has decent support for AppleScript.

It would take very little effort to put an LLM frontend on top of this, and yet they've not only abandoned applescript (or the underlying apple events) at a time when they could expose it to the masses, but have gone in the exact opposite direction with "Shortcuts".

Oh and the icing on the cake is that apple events can be sent over the network as well, and this infrastructure has existed since the early days of OSX.

varunnrao|11 months ago

I agree. The AppleScript/Apple Event Manager thing is an example of treating macOS like a second class citizen in the ongoing iOS-fication of the Apple Ecosystem. The point of macOS for me is that it's simple to use for most beginners but allows more advanced users to add complexity through tools like Apple Script and Automator and the underlying Unix base.

Like you say, an MCP server integrated with AppleScript/Apple Event Manager would instantly hook up any LLM with virtually all Mac apps. More Mac devs will then be incentivized to support these features. For people who find AppleScript un-intuitive, JavaScript is also supported. And in my view, this is a revolutionary way to use my computer - a very Star Trek way of using the computer.

chippiewill|11 months ago

> Their vertical integration gives them an edge not many can match, when it comes to running ML models.

They have an advantage when it comes to running them locally, but it feels like they're trying to push it onto consumer hardware before consumer hardware is at the point of actually being able to run useful LLMs.

varunnrao|11 months ago

You're right. The hardware right now can't run useful models.

But that's why I think they have a couple of years to sort out their software issues. When useful models can be run on their devices they have to be ready. The hardware advantage can only be an advantage when they have the software to run useful applications. Hopefully they don't get stuck in the typical big company bureaucracy and ego matches and instead can make a change for the better.

kelseydh|11 months ago

A lot of people forget that it was only recently that the Photos app on your iPhone could run OCR text search on pictures in your phone. Google had that feature on their phones many years before Apple.

visarga|11 months ago

Apple's TTS voices still run on 10 year old technology. Pretty disappointing, at one time the had the best system voices.

resource_waste|11 months ago

>imo, Apple are actually ahead when it comes to the hardware side of the whole thing.

It surely is just your opinion. Nvidia is king and Apple has found a way to market an integrated GPU and CPU RAM as something magnificent, rather than something that has existed since the dawn of computing.

There is a reason Nvidia is king. There is a reason corporations buy Nvidia and not Apple for their LLM uses.

wtallis|11 months ago

You seem to think that the AI market consists entirely of the segment that NVIDIA dominates (datacenter training and inference) and that the segment where NVIDIA is absent (inference on battery-powered devices) doesn't exist.