(no title)
TotoHorner | 2 years ago
1. How exactly is AI being used here? Is there an AI chat-bot that I can ask for help? Do you generate problem-sets with AI? Check answers with AI? Is it GPT-4?
2. Do you utilize Spaced-Repetition in any way? Have you found that to be useful?
Thank you
JustinSkycak|2 years ago
1. The AI is more like an expert system that emulates the decisions of an expert tutor with regard to what tasks a student should work on at any given point in time (what should the student learn next, what do they need to review). There's a knowledge graph that encodes structural relationships between thousands of math topics (such as prerequisite relationships, but also other types). And then there's an algorithmic reasoning system that looks at a student's answers, overlays them on the knowledge graph, figures out what the student knows (and how well they know it), and decides what learning tasks are going to move the needle most given their personal knowledge profile. The decision-making is inspired by cognitive learning strategies such as mastery learning, spaced repetition, interleaving, minimizing associative interference.
2. Yes, spaced repetition is a core part of the system. Each student has a personalized spaced repetition schedule that adapts to their performance on each topic, and when choosing what topics a student should review or learn next, we're always trying to implicitly "knock out" as many due reviews as possible to maximize learning efficiency. (For instance, if a student is due for a review on one-step ax=b equations, we can implicitly "knock out" that review by having them learn two-step ax+b=c equations instead.)
From a quantitative standpoint, the spaced repetition model was one of the more challenging (but equally fun) parts to build. You normally think of spaced repetition in the context of independent flashcards, but in a hierarchical body of knowledge like mathematics, it gets really complicated because repetitions on advanced topics should "trickle down" to update the repetition schedules of simpler topics that are implicitly practiced (while being discounted appropriately since these repetitions are often too early to count for full credit towards the next repetition).
Our spaced repetition model not only accounts for implicit "trickle-down" repetitions but also minimizes the number of reviews by choosing reviews whose implicit repetitions "knock out" other due reviews (like dominos), and calibrates the speed of the spaced repetition process to each individual student on each individual topic (student ability and topic difficulty are competing factors).
TotoHorner|2 years ago
It would be awesome if you could also add GPT-4 as a kind of helpful tutor. Not sure if you're already experimenting with that.
> Our spaced repetition model not only accounts for implicit "trickle-down" repetitions but also minimizes the number of reviews by choosing reviews whose implicit repetitions "knock out" other due reviews (like dominos), and calibrates the speed of the spaced repetition process to each individual student on each individual topic (student ability and topic difficulty are competing factors).
That's super interesting and definitely one of the issues I faced while building anki cards for math classes I took in undergrad. Thanks again!
jacquesm|2 years ago