? I'm not sure I can say more than I already did, but I'll try to be more specific:
The R community is categorically smaller than the python community. The support on community forums is harder to get, or non-existent (eg. with databricks).
Are you saying you've worked in places where its easier to find people that are familiar with R to help work on a project than it is to find people are familiar with python?
That you've found its easier to hire people who are familiar with R than it is to hire people who are familiar with python?
I... all I can say is that has not been my experience.
The places I've worked, of all the developers a small handful of people use R, and a small subset of those are good at it.
I don't hate R. I don't think it's a bad language. I'm saying: It's harder to support, because it's obscure, rarely used by most developers, and the people who use it and know it well are rare and expensive.
As a data engineer, expected to support workflows in production: Don't use obscure crap and expect other people to support it. Not R. Not rust. Not pony.
Using R on databricks, specifically, is a) unsupported^, and b) obscure and c) buggy. Don't do it.
(^ sorry, it's a 'tier 2 language' if you speak to DB representative, which means bugs don't count and new features don't get support)
All I can say, is that my experience has been that supporting python has been less painful; it's a simple known quantity, and its easy to scale up a team to fix projects if you need to.
Thanks for sharing. Seems your issues are more with databricks than R, but certainly R is more obscure.
At least in my experience we’ve never had issues with people learning it on the job and far fewer software issues from eg versioning, dependencies, regression bugs. It just works, there’s rarely even a need for a venv.
I’d never expect it applied as a general purpose language like python though, typical projects are <1k lines of some specific data task, perhaps our use cases are just different
wokwokwok|3 years ago
The R community is categorically smaller than the python community. The support on community forums is harder to get, or non-existent (eg. with databricks).
Are you saying you've worked in places where its easier to find people that are familiar with R to help work on a project than it is to find people are familiar with python?
That you've found its easier to hire people who are familiar with R than it is to hire people who are familiar with python?
I... all I can say is that has not been my experience.
The places I've worked, of all the developers a small handful of people use R, and a small subset of those are good at it.
I don't hate R. I don't think it's a bad language. I'm saying: It's harder to support, because it's obscure, rarely used by most developers, and the people who use it and know it well are rare and expensive.
As a data engineer, expected to support workflows in production: Don't use obscure crap and expect other people to support it. Not R. Not rust. Not pony.
Using R on databricks, specifically, is a) unsupported^, and b) obscure and c) buggy. Don't do it.
(^ sorry, it's a 'tier 2 language' if you speak to DB representative, which means bugs don't count and new features don't get support)
All I can say, is that my experience has been that supporting python has been less painful; it's a simple known quantity, and its easy to scale up a team to fix projects if you need to.
bovinejoni|3 years ago
At least in my experience we’ve never had issues with people learning it on the job and far fewer software issues from eg versioning, dependencies, regression bugs. It just works, there’s rarely even a need for a venv.
I’d never expect it applied as a general purpose language like python though, typical projects are <1k lines of some specific data task, perhaps our use cases are just different