top | item 46435287

(no title)

__float | 2 months ago

You're counting the cost of running the model, but what about training it? You can't count the compute and data costs at $0.

discuss

order

philipkglass|2 months ago

You can assume that already-published open weights models are available at $0, regardless of how much money was sunk into their original development. These models will look increasingly stale over time but most software development doesn't change quickly. If a model can generate capable and up-to-date Python, C++, Java, or Javascript code in 2025 then you can expect it to still be a useful model in 2035 (based on the observation that then-modern code in these languages from 2015 works fine today, even if styles have shifted).

sarchertech|2 months ago

>2025-2035

Depending on other people to maintain backward compatibility so that you can keep coding like it’s 2025 is its own problematic dependency.

You could certainly do it but it would be limiting. Imagine that you had a model trained on examples from before 2013 and your boss wants you to take over maintenance for a React app.