Just watch the first lecture and you won't be able to not watch the rest. It starts with making your own autograd engine in 100 lines of python, similar to PyTorch and then builds up to a GPT network. He's one of the best in the field, founder of OpenAI, then Director of AI at Tesla. Nothing like the scam tutorials that just copy-paste random code from the internet.
The "Let's build GPT: from scratch, in code, spelled out." demystifies so much of machine learning and chatbots. It's so cool to see how simple python code can be leveraged into something so amazing.
The best lecture series I have seen till date ( and I have seen lectures by top professors across great institutions in multiple countries) is Classical Physics by V. Balakrishnan from IIT Madras, India [1]. Only people who have thought about concepts deeply over a lifetime can deliver such truly delightful lectures. If you have an hour to spare, just listen to the first lecture [2] and it will profoundly impact your outlook on science (and physics in particular)
Not sure best ever, but I really enjoyed “The Other Side of History” (available from Great Courses Plus now Wonderium). I found the deep dive into daily life through history helped me better understand the common threads that all humans experience.
Course Description:
Imagine you're a Greek soldier marching into battle in the front row of a phalanx. Or an Egyptian woman putting on makeup before attending an evening party with your husband. Or a Celtic monk scurrying away with the Book of Kells during a Viking invasion. Welcome to the other side of history, the 99% of ordinary people whose names don't make it into the history books—but whose lives are no less fascinating than the great leaders whose names we all know. Here you'll encounter such diverse individuals as:
a Mesopotamian hunter-gatherer making a living in one of the world's earliest permanent settlements;
an Egyptian craftsman decorating the pharaoh's tomb in the Valley of the Kings;
a Minoan fleeing the island of Santorini during a volcanic eruption;
a Greek citizen relaxing at a drinking party with the likes of Socrates;
a Roman slave captured in war and sent to work in the mines; and
Thanks for this recommendation. It sounds like something I'd be interested in and I just found the audiobook for free as part of my Audible membership.
Gilbert Strang's lectures on Linear Algebra [1]. Prof Strang is an amazing lecturer with a unassuming style. He's the expert on Linear Algebra and makes the topic so much approachable.
Ken Joy's lectures on Computer Graphics [2]. Prof Joy is another amazing lecturer, making the Computer Graphics topics seeming easy.
Stanford CS221 Learn AI (2019) by Percy Liang and Dorsa Sadigh. Both professors are great lecturers. Andrew Ng's ML class was great, but it was more academically tuned. CS221 is more on the practical side and is more updated as ML is progressing fast.
Micromouse 2021-2022 by UCLA [4]. It's a short series taught by graduate students and probably it's incomplete, but the content and teaching are amazing. I wish I had this kind of class when I was in school. The teaching and materials are very approachable and easy to understand. It shows how basic electronic components and basic circuitry work. It shows how to put them together and how to write simple programs to control the components. The end result is a robotic mouse that can traverse mazes with seemingly intelligence.
Human Behavioral Biology, a Stanford course taught by Robert Sapolsky. It's a thorough look on some of our behaviors through the lens of hormones, neural/nervous system, and how evolution shaped us. Also, Pr Sapolsky is a great speaker with a complete deadpan humor.
This would be my choice too. He's a good storyteller.
Although like all good storytellers, don't believe everything he says. I looked up a couple of his more bizarre anecdotes, and they usually turn out not to be true. The one example I can remember is women living close together sync'ing up their menstrual period. That turned out to be probably a case of the researchers underestimating the intricacies of the statistics necessary to show that cyclic phenomenon of not quite the same length adjust towards each other.
Anything I have watched from Open Yale has been fantastic too. I feel like they have done a great job of curation and not just creating a list of random new class recordings.
Extremely clear and satisfying lectures that covers all of basic physics. Much of it is accessible to anyone with some spare time and first year university!
Timothy Snyder: The Making of Modern Ukraine. [0] gives you invaluable understanding about much more than just Ukraine.
MIT 16.885J Aircraft Systems Engineering, Fall 2005 [1] - the aircraft they focus on is the Space Shuttle. Amazingly demystifying. Some of the actual early designers talk there.
The Aircraft Systems Engineering lectures are great, I'm listening to them now.
It should be noted that the lecturer, Aaron Cohen, contradicts everything that has made SpaceX successful. From reusability, to innovation, to cost-cutting measures, to sticking with traditional contractors. But that is only testament to the challenges that faced SpaceX, it detracts nothing from Professor Cohen's brilliance. It's too bad that he never got to see how both cargo and manned spaceflight had progressed only a decade after his 2010 passing.
I was going to post MIT 16.885J Aircraft Systems Engineering, Fall 2005, really amazing, would be nice to have something like that for modern day systems
Sorry, can't resist: you probably mean pi radians (and by convention you don't even need the word radians). Pi degrees would imply your outlook barely changed at all.
Yeah this one is so much fun. I feel like I really grew as a programmer from this course. Scheme is the perfect teaching language because each concept being taught can be demonstrated in its pure form so you really “get it”. I had been a professional developer for 10 years or so when I went through this course, and it profoundly changed how I thought about code.
By Jeremy, who is the founding researcher at fast.ai.
Three things I love about this series
1. Jeremy seems like a power user of Jupyter notebook and uses them beautifully to run the lectures. The book on fastai is also written in Jupyter notebooks.
2. The lectures are super hands on - Jeremy actually fires up a jupyter notebook and runs code which often surprises him
3. I love how he describes he deep dives into a specific Kaggle competition. Describes in great detail his own attempts at getting up the leaderboard. It's almost like watching a poker player reveal her decision process before they make a move.
Geoff Hinton's legendary Coursera course on neural nets. It came out around the same time as AlexNet winning the ImageNet competition which sparked the current deep learning revolution.
At the time it was cutting edge to the point where he introduced a previously undescribed optimization method (RMSProp) that was subsequently used in papers, citing the lecture slides as their reference! But still accessible to anyone with basic college math. Of course it doesn't have any of the new stuff like transformers or diffusion models, but I still consider it as giving a good foundation for understanding backprop and neural nets.
Unlike every other AI course at the time it didn't try to teach you about all the other types of machine learning. Neural nets only. After taking it I was able to apply neural nets at work with pretty great results. Also, it gave me one of my favorite quotes: "To deal with hyper-planes in a 14-dimensional space, visualize a 3-D space and say 'fourteen' to yourself very loudly. Everyone does it."
Somewhere on Hinton's webpage, there's a series of mp4 lectures. They introduce general neural networks, and then lead into restricted boltzman machines, which he worked on. Probably one of the best introductions to RBMs.
The video series made by 3Blue1Brown are fantastic. He crafts visual math videos using an animation engine he has developed to provide great explanations for understanding concepts more deeply. Beyond the technical, his presentation style and insight makes them very motivational to follow.
CS193p - Developing Apps for iOS, by Paul Hegarty.
It's a course taught at Stanford University, some of which they've released publicly for free. Here's the latest incarnation, which covers SwiftUI:
https://cs193p.sites.stanford.edu
Building a prototype with Dan Gelbart [0]. An engineer and inventor, he has an 18 episode playlist of every aspect of using a machine shop to build prototypes. It teaches machining. Shop use, thinking though physical creation where order of operations is paramount. Really just a great learning experience even if you never plan on doing machining.
[+] [-] stjo|3 years ago|reply
Just watch the first lecture and you won't be able to not watch the rest. It starts with making your own autograd engine in 100 lines of python, similar to PyTorch and then builds up to a GPT network. He's one of the best in the field, founder of OpenAI, then Director of AI at Tesla. Nothing like the scam tutorials that just copy-paste random code from the internet.
[+] [-] lawkwok|3 years ago|reply
[+] [-] BatteryMountain|3 years ago|reply
[+] [-] sirwhinesalot|3 years ago|reply
[+] [-] wg0|3 years ago|reply
[+] [-] henkdehenker|3 years ago|reply
[+] [-] ronyfadel|3 years ago|reply
[deleted]
[+] [-] dev_0|3 years ago|reply
[deleted]
[+] [-] wanderingmind|3 years ago|reply
[1] https://archive.nptel.ac.in/courses/122/106/122106027/
[2] https://youtu.be/Q6Gw08pwhws
[+] [-] meany|3 years ago|reply
Course Description:
Imagine you're a Greek soldier marching into battle in the front row of a phalanx. Or an Egyptian woman putting on makeup before attending an evening party with your husband. Or a Celtic monk scurrying away with the Book of Kells during a Viking invasion. Welcome to the other side of history, the 99% of ordinary people whose names don't make it into the history books—but whose lives are no less fascinating than the great leaders whose names we all know. Here you'll encounter such diverse individuals as:
a Mesopotamian hunter-gatherer making a living in one of the world's earliest permanent settlements;
an Egyptian craftsman decorating the pharaoh's tomb in the Valley of the Kings; a Minoan fleeing the island of Santorini during a volcanic eruption;
a Greek citizen relaxing at a drinking party with the likes of Socrates;
a Roman slave captured in war and sent to work in the mines; and
a medieval pilgrim on the road to Canterbury.
https://www.thegreatcourses.com/courses/the-other-side-of-hi...
[+] [-] CTmystery|3 years ago|reply
[+] [-] chickenimprint|3 years ago|reply
[+] [-] j00pY|3 years ago|reply
[+] [-] ww520|3 years ago|reply
Ken Joy's lectures on Computer Graphics [2]. Prof Joy is another amazing lecturer, making the Computer Graphics topics seeming easy.
Stanford CS221 Learn AI (2019) by Percy Liang and Dorsa Sadigh. Both professors are great lecturers. Andrew Ng's ML class was great, but it was more academically tuned. CS221 is more on the practical side and is more updated as ML is progressing fast.
Micromouse 2021-2022 by UCLA [4]. It's a short series taught by graduate students and probably it's incomplete, but the content and teaching are amazing. I wish I had this kind of class when I was in school. The teaching and materials are very approachable and easy to understand. It shows how basic electronic components and basic circuitry work. It shows how to put them together and how to write simple programs to control the components. The end result is a robotic mouse that can traverse mazes with seemingly intelligence.
[1] https://www.youtube.com/playlist?list=PL49CF3715CB9EF31D
[2] https://www.youtube.com/watch?v=01YSK5gIEYQ&list=PL_w_qWAQZt...
[3] https://www.youtube.com/watch?v=J8Eh7RqggsU&list=PLoROMvodv4...
[4] https://www.youtube.com/playlist?list=PLAWsHzw_h0iiz1EQEvQ9n...
Edit: added [4]
[+] [-] cranium|3 years ago|reply
https://www.youtube.com/watch?v=NNnIGh9g6fA&list=PL848F2368C...
[+] [-] olau|3 years ago|reply
Although like all good storytellers, don't believe everything he says. I looked up a couple of his more bizarre anecdotes, and they usually turn out not to be true. The one example I can remember is women living close together sync'ing up their menstrual period. That turned out to be probably a case of the researchers underestimating the intricacies of the statistics necessary to show that cyclic phenomenon of not quite the same length adjust towards each other.
[+] [-] epistemer|3 years ago|reply
Anything I have watched from Open Yale has been fantastic too. I feel like they have done a great job of curation and not just creating a list of random new class recordings.
https://oyc.yale.edu/courses
[+] [-] foooobaba|3 years ago|reply
[+] [-] unknown|3 years ago|reply
[deleted]
[+] [-] Phithagoras|3 years ago|reply
https://www.feynmanlectures.caltech.edu/
Extremely clear and satisfying lectures that covers all of basic physics. Much of it is accessible to anyone with some spare time and first year university!
[+] [-] dotancohen|3 years ago|reply
[+] [-] jnsaff2|3 years ago|reply
MIT 16.885J Aircraft Systems Engineering, Fall 2005 [1] - the aircraft they focus on is the Space Shuttle. Amazingly demystifying. Some of the actual early designers talk there.
[0] - https://www.youtube.com/watch?v=bJczLlwp-d8&list=PLh9mgdi4rN...
[1] - https://www.youtube.com/watch?v=iiYhQtGpRhc&list=PL35721A60B...
[+] [-] aivisol|3 years ago|reply
[+] [-] dotancohen|3 years ago|reply
It should be noted that the lecturer, Aaron Cohen, contradicts everything that has made SpaceX successful. From reusability, to innovation, to cost-cutting measures, to sticking with traditional contractors. But that is only testament to the challenges that faced SpaceX, it detracts nothing from Professor Cohen's brilliance. It's too bad that he never got to see how both cargo and manned spaceflight had progressed only a decade after his 2010 passing.
[+] [-] xrayarx|3 years ago|reply
[+] [-] lab11|3 years ago|reply
especially the section on streams (https://www.youtube.com/watch?v=JkGKLILLy0I&list=PLE18841CAB...)
It changed my outook on programming by pi degrees and I feel it is more needed then ever.
[+] [-] JDEW|3 years ago|reply
[+] [-] lll-o-lll|3 years ago|reply
[+] [-] ipnon|3 years ago|reply
[+] [-] graymatters|3 years ago|reply
[+] [-] asmr|3 years ago|reply
[+] [-] silent_cal|3 years ago|reply
[+] [-] ujjwalgrover|3 years ago|reply
By Jeremy, who is the founding researcher at fast.ai.
Three things I love about this series 1. Jeremy seems like a power user of Jupyter notebook and uses them beautifully to run the lectures. The book on fastai is also written in Jupyter notebooks. 2. The lectures are super hands on - Jeremy actually fires up a jupyter notebook and runs code which often surprises him 3. I love how he describes he deep dives into a specific Kaggle competition. Describes in great detail his own attempts at getting up the leaderboard. It's almost like watching a poker player reveal her decision process before they make a move.
https://www.youtube.com/watch?v=8SF_h3xF3cE&list=PLfYUBJiXbd...
[+] [-] rahimnathwani|3 years ago|reply
[+] [-] avinassh|3 years ago|reply
MIT 6.824 Distributed Systems by Robert Morris - https://www.youtube.com/watch?v=cQP8WApzIQQ&list=PLrw6a1wE39...
[+] [-] modeless|3 years ago|reply
At the time it was cutting edge to the point where he introduced a previously undescribed optimization method (RMSProp) that was subsequently used in papers, citing the lecture slides as their reference! But still accessible to anyone with basic college math. Of course it doesn't have any of the new stuff like transformers or diffusion models, but I still consider it as giving a good foundation for understanding backprop and neural nets.
Unlike every other AI course at the time it didn't try to teach you about all the other types of machine learning. Neural nets only. After taking it I was able to apply neural nets at work with pretty great results. Also, it gave me one of my favorite quotes: "To deal with hyper-planes in a 14-dimensional space, visualize a 3-D space and say 'fourteen' to yourself very loudly. Everyone does it."
[+] [-] yobbo|3 years ago|reply
[+] [-] erostrate|3 years ago|reply
Introduction to Cryptography by Christof Paar, I wanted to understand Bitcoin's secp256k elliptic curve on finite fields: https://youtube.com/playlist?list=PL6N5qY2nvvJE8X75VkXglSrVh...
The Maths of General Relativity by ScienceClic, I wanted to understand clearly Einstein's field equations (what the hell is a Ricci tensor) without having to read a book: https://youtube.com/playlist?list=PLu7cY2CPiRjVY-VaUZ69bXHZr...
[+] [-] dools|3 years ago|reply
https://www.youtube.com/playlist?list=PL6i60qoDQhQGaGbbg-4aS...
Seminar on Macroeconomics, Randall Wray:
https://www.youtube.com/playlist?list=PLnw-449iRxO-BbfN55FdO...
Modern Money and Public Purpose:
https://www.youtube.com/watch?v=0zEbo8PIPSc&list=PLoGqI16J4b...
[+] [-] antipotoad|3 years ago|reply
[1]: https://news.mit.edu/2014/lewin-courses-removed-1208
[+] [-] detourdog|3 years ago|reply
MIT physics 801 https://www.youtube.com/playlist?list=PLyQSN7X0ro203puVhQsmC...
MIT physics 802 https://www.youtube.com/playlist?list=PLyQSN7X0ro2314mKyUiOI...
MIT physics 803 https://www.youtube.com/playlist?list=PLyQSN7X0ro22WeXM2QCKJ...
[+] [-] say_it_as_it_is|3 years ago|reply
[+] [-] lab11|3 years ago|reply
[+] [-] pveierland|3 years ago|reply
Series on linear algebra: https://www.youtube.com/playlist?list=PLZHQObOWTQDPD3MizzM2x...
Animation engine: https://github.com/3b1b/manim
[+] [-] chrsig|3 years ago|reply
It really made...the interpretation of computer programs...click with me.
And there's a meta-circular evaluator designed to fit on the number of blackboards they had available. So that's cool.
https://ocw.mit.edu/courses/6-001-structure-and-interpretati...
[+] [-] JonCox|3 years ago|reply
It's a course taught at Stanford University, some of which they've released publicly for free. Here's the latest incarnation, which covers SwiftUI: https://cs193p.sites.stanford.edu
One of the earlier courses, back when it was all MVC + UIKit focussed, was how I learnt iOS dev and got a solid grasp of all the concepts: https://podcasts.apple.com/gb/podcast/ipad-and-iphone-applic...
Absolutely fantastic lectures, I feel very lucky they were available. Thank you Paul if you're reading!
[+] [-] misthop|3 years ago|reply
[0]https://youtube.com/playlist?list=PL_tws4AXg7asrBv1MMAq4AO68...
[+] [-] arisbe__|3 years ago|reply
MIT Calculus Revisited - An almost perfect no nonsense presentation (I like black boards too)
Francis Su - Real Analysis - Very engaging lecture style and great board work.
Feynman Messenger Lectures - Well its Feynman, and the content is interesting if you are still somewhat new to it.
Also StatQuest and Luis Serano for intuition/conceptualization in Stats & ML.
I have a network of channels on YouTube trying to aggregate lecture courses/series. Here are just two: https://youtube.com/@a-guess-at-the-riddle
https://youtube.com/@tuva-or-bust
[+] [-] antman|3 years ago|reply
[+] [-] pgayed|3 years ago|reply
Financial markets with Bob Shiller (Yale 2008):
https://youtube.com/playlist?list=PL8F7E2591EE283A2E
Financial markets with Bob Shiller (Yale 2011):
https://youtube.com/playlist?list=PL8FB14A2200B87185
Smart-as-a-whip, scathing rationality of John Geanakoplos in his financial theory course.
Financial Theory with John Geanakoplos (Yale 2011):
https://youtube.com/playlist?list=PLEDC55106E0BA18FC