top | item 18772554

(no title)

995533 | 7 years ago

It was not possible to increase speed by getting more powerful compute?

discuss

order

Fomite|7 years ago

No. Resources are not infinite, and we were already on the edge of what the resources at most sites where training would be done could be expected to have.

995533|7 years ago

Thanks. I think you are a correct exception to what I said. I should have known that using words like "nobody" would not go over well on HN (but tedious to type "a very large percentage"), despite that statement being a verbatim quote from one of the world's leading ML engineers and, to me, not controversial.

I do consider the cloud both widely available and near infinite in resource adding capability.

If it is really not economically feasible to add resources, then the performance gains were not as promising as thought (whether cloud or on-site).