top | item 3703782

Learning From Data - Online Course

175 points| LiveTheDream | 14 years ago |work.caltech.edu | reply

45 comments

order
[+] andymatuschak|14 years ago|reply
Yaser Abu-Mostafa was (by enormous margin) the most effective professor I had at Caltech. Despite being such an expert in the field, he understands clearly when a concept is particularly challenging--and what about it makes it so. This class (the official equivalent) was one of my absolute favorites. Definitely worth a look!
[+] evan-arm|14 years ago|reply
What Andy says is absolutely true. This machine learning class was easily the best class I took at Caltech. Prof. Abu-Mostafa got a standing ovation at the end of the course the term I took it. I wish I could have taken more of his classes.

It was also fairly difficult -- the assignments were hard, but at every step, you could look at what you'd done and say "I know why I'm doing this, and I can see how this works."

I remember at the end of the term he took several students' notes and made copies of them, so that he could compare the students' notes with what he was trying to convey, and could know if he wasn't teaching certain parts of the class well enough.

It's a shame that not all professors are as dedicated and responsive to their teaching obligations as Prof. Abu-Mostafa.

Oh, also, "introductory" in this context is meant to differentiate it from "graduate level". Every student (mostly juniors and seniors) in this class will have had several terms of math, theoretical CS, and practical programming classes.

[+] tel|14 years ago|reply
This looks like the kind of class more people need to see. It's less "how to implement" things and more why things do or don't work.

I find this dreadfully important because when you study this math you realize that more often than anyone expects, standard ML is extraordinarily fragile, but also has some powerful justification. For instance, this[1] made me laugh with joy.

[1] http://work.caltech.edu/images1/canvas.png

[+] scoot|14 years ago|reply
> this[1] made me laugh with joy.

Whereas it went completely over my head...

[+] snikolov|14 years ago|reply
I agree that understanding the theory is very important.

The figure is very interesting. Would you care to explain it? I think I know what these are in theory, but perhaps I haven't internalized them enough to understand the visual representation.

[+] Stratego|14 years ago|reply
Online teaching is not so much about watering down than understand that your audience will not usually and probably cannot have the same level of focus that your on-campus students will have. It's not a judgement of skills, but a simple observation of psychological incentives.

Online is a great place to learn, but it's absolutely the wrong place to learn the exact same curriculum as offline.

[+] codenerdz|14 years ago|reply
These seem to be LIVE videos of the lectures broadcast during the workday in US. Their previously recorded page states that they will only provide videos of the first week. Not really doable by anyone in US timezone with a job.
[+] caycep|14 years ago|reply
i sent an email to clarify - i think they will have them available for download on the site after the live lectures.
[+] heifetz|14 years ago|reply
the best aspect of the andrew ng course was the homeworks using octave. Yes, it's watered down and not as mathematically rigorous as the real course, but you learn a lot of the essentials from the experience of coding machine learning algorithms, that I can't imagine learning as easily from doing non-programming homework.
[+] aseembehl|14 years ago|reply
Prof. Ng's class wasn't watered down. CS229A(http://cs229a.stanford.edu/) is the Stanford equivalent of the online ml-class. Ng also teaches another machine learning course at stanford(CS229) which focuses on the theoretical underpinnings of ML.
[+] snikolov|14 years ago|reply
My favorite classes (and the ones I've learned the most from) have always managed to balance theory and implementation. The formula has usually been a mix of

1) purely theoretical exercises emphasizing fundamental concepts

2) project-based assignments in which you must understand the theory and write a decent amount of code to apply it. Usually a bunch of code not central to the concepts has already been written for you. But just implementing it is still not enough. To test your conceptual understanding, they ask you to run your code in various situations and explain the results.

[+] archgoon|14 years ago|reply
I dunno. You're given the equations in that class. Translating from math notation to octave syntax doesn't require you to have any idea of why any of it works.
[+] donald_draper|14 years ago|reply
Agreed.

I think it's actually quite telling if other institutions feel obliged to ridicule efforts (by Coursera et al) to make online learning a new experience, rather than just copying existing concepts as exercised in traditional universities.

[+] mrleinad|14 years ago|reply
Anyone knows if a video for each class will be available after live streaming?
[+] lightcatcher|14 years ago|reply
As an undergrad at Caltech who will be taking this course next term, I find this intriguing. I'm wondering if this course will be as popular as the Stanford courses (looks like a lot less effort is being put into organization, design, etc) and how the difficulty of this will compare to the Stanford courses and an average Caltech course.
[+] sev|14 years ago|reply
Homeworks? Lack of a sign-up link? Interesting that they have grammatical errors on this page considering their goal here (to compete with other top universities doing the same thing)
[+] kliao|14 years ago|reply
who says they are trying to compete with other universities? the goal here is to provide quality education accessible to everyone. it also looks like the webpage was created by the professor himself (http://work.caltech.edu/ is his personal page) and may not be completely ready yet.
[+] crusso|14 years ago|reply
The whole site (including the content and graphics) was generated with three lines of very clever LISP as a proof of ML concepts.

Small mistakes are forgivable. ;)

[+] cop359|14 years ago|reply
The course seems all over the place. You learn very little about a lot of things... The topics don't really seem to build on each other. I'm not sure that's a good thing.
[+] CurtHagenlocher|14 years ago|reply
If this is anything like the classes I took as a Caltech undergrad, you will not learn "very little". Or if you do, you won't pass the class.
[+] psychotik|14 years ago|reply
Is there any reason to watch this live, instead of catching it on iTunes U or downloading older videos for later viewing? Just curious if there's something I'm missing something that adds value one way or another.
[+] benohear|14 years ago|reply
As I understand it, it's not only about watching the lectures but actually taking the course (with assignments and all). For that to work, it makes sense to be on the same schedule as the "real" students.

That said, I'd quite like to just watch the vids sometime later. Anyone know if / where they will be available?

[+] plessthanpt05|14 years ago|reply
Cool that so many things like this are popping up lately: Tom Mitchell at CMU putting up all of his lectures/material, the Stanford/coursera ML course, now this CalTech course... are there others?
[+] rdssassin|14 years ago|reply
hmm the commitment of watching the lectures live at a certain time is a bit of a negative for me
[+] ndefinite|14 years ago|reply
Did anyone see a sign up link?
[+] vilya|14 years ago|reply
No, but it does say "registration will be open next week" in big letters...