(no title)
ksd482 | 1 year ago
I have time and again fell victim to fulfill all the prerequisites before I begin to attempt to understand a topic. This is a mistake I have made repeatedly. I now understand why this is tempting to do and why it is a mistake.
It is tempting to do so because you feel things will come easier to you if you fulfill the prerequisites first. But the problem is that there is just not enough time. AND, it actually may not be even necessary.
It is a mistake to do so because you are wasting time and ultimately it may not be necessary after all.
Even in a field such as pure mathematics (I have an MS in pure Math), it is okay to skim through some of the background material and understand it intuitively or even non-rigorously, while focusing on what you want to actually learn.
It took me a while to learn that and I am glad it is being repeated here by such an accomplished professor.
JustinSkycak|1 year ago
HOWEVER I think there's more nuance: there is tremendous value in having a baseline level of foundational knowledge in whatever domain you're in.
For instance, if someone hasn't learned math to an undergraduate level, and they try to sink their teeth into a math research problem, then they're probably going to spend all their time flailing around and being confused. Waste of time.
A better use of time would be for them to develop a baseline level of mathematical knowledge through a structured curriculum, and then take the leap once they've got their fundamentals down.
Same thing with machine learning. If you want to work on a research problem and you have your ML fundamentals down, then yeah, go ahead and jump right into the research problem. But if you don't even know how gradient descent works, or what an eigenvalue is, how to work with continuous probability distributions, etc., then you're woefully underprepared and you'd be better off just shoring up your foundations first.
lallysingh|1 year ago
The basics are the ones with the most different approaches developed to teach/use them, so they can most easily be skimmed by with cheap modern trickery.
DecayingOrganic|1 year ago
I've grown to really like this Richard Feynman quote: “Study hard what interests you the most in the most undisciplined, irreverent and original manner possible.” It feels like I've been finally granted permission to embrace my natural, messy way of learning.
Davidzheng|1 year ago
sage76|1 year ago
I think this is a lesson I am learning. I am going through the book PRML throroughly (which means attempting every single exercise) and writing out the solutions.
I also did the prereqs somewhat rigorously.
It has been incredibly time consuming.
senderista|1 year ago
vinnyvichy|1 year ago
gxs|1 year ago
I was a math major and I used to be adamant about reading the chapter perfectly before starting my problem sets.
I mentioned this to my math professor and he’d always say to not be afraid to jump into the problems, that my time was better spent that way.
My take on it is that a) it’s true and b) it works because reading with a purpose is very different than reading as a way of surveying something before you jump into a problem.