top | item 45389494

(no title)

barbarr | 5 months ago

Why is apple doing protein folding?

discuss

order

bobmarleybiceps|5 months ago

This may not be the actual reason in this case, but I think it's good to be aware of: A non-zero chunk of "ai for science" research done at tech companies is basically done for marketing. Even in cases where it's not directly beneficial for the companies products or is unlikely to really lead to anything substantial, it is still good for "prestige"

giancarlostoro|5 months ago

No idea, but can I be signed up for R&D jobs where you don't necessarily build something generating revenue?

Maybe these are just projects they use to test and polish their AI chips? Not sure.

nextos|5 months ago

Local inference. I imagine they have an interest in making this and other cutting edge models small enough to be possible to do quick inference on their desktop machines. The article shows that, with Figure 1E demonstrating inference on an M2 Max 64 GB.

Frankly, it's a great idea. If you are a small pharma company, being able to do quick local inference removes lots of barriers and gatekeeping. You can even afford to do some Bayesian optimization or RL with lab feedback on some generated sequences.

In comparison, running AlphaFold requires significant resources. And IMHO, their usage of multiple alignments is a bit hacky, makes performance worse on proteins without close homologs, and requires tons of preprocessing.

A few years back, ESM from Meta already demonstrated that alignment-free approaches are possible and perform well. AlphaFold has no secret sauce, it's just a seq2seq problem, and many different approaches work well, including attention-free SSMs.

Zacharias030|5 months ago

I think people often interpret a bit too much. Perhaps it’s just some researchers who got enough freedom to run and publish interesting work within apple. For a company like apple it makes sense to have a research lab with considerable freedoms even if protein folding is not a core interest, which is why you see it published but not the formula for the new Corning Gorilla glass…

mensetmanusman|5 months ago

Will be fascinating to see how the market breaks down in the future, will enough people want a third best model they can run on prem, or will people all be fighting in line for the top models that are a few cents more per token on supercomputers.

cowsandmilk|5 months ago

To sell computers? 20 years ago, Apple had scientific poster sessions at WWDC and worked to bring PyMol to the Mac. The pictures of proteins you see in the paper were generated with PyMol as are probably >50% of the protein images in scientific papers for the last 15 years.

whyenot|5 months ago

If Warren Delano (the author of PyMol) were still with us, I think he would be amazed at where we are now with AlphaFold, and all the rest. At least what he hoped for, that software like this would be open source and peer-reviewable, has mostly held true.

shpongled|5 months ago

Probably because ByteDance and Facebook (spun out into EvolutionaryScale) are doing it

IncreasePosts|5 months ago

They're jealous they haven't won a Nobel prize

Forbo|5 months ago

Reputation laundering?

EasyMark|5 months ago

They have a much better reputation that most companies. I think they're doing okay compared to google, facebook, oracle, etc. Few people are going to think a corp is "doing good" but reputation does still matter somewhat.

jama211|5 months ago

What’s there to launder? Perhaps they shouldn’t have as good a reputation as they do, but you can’t deny they do have a good reputation.

mabedan|5 months ago

Prowlly cuz Siri didn’t work out

lovasoa|5 months ago

How do you call the opposite of green washing? When you want to show that you are burning as much energy on training models as the others.