top | item 26349754

(no title)

gary_bernhardt | 5 years ago

Here's an anecdote about what happens when you design a product in the opposite way.

I own https://www.executeprogram.com, which has interactive in-browser courses on various software development technologies. Currently they all cover languages, more or less: TypeScript, SQL, various JS topics, regexes. (Disclosure: it costs money after you finish your 16th lesson.)

Almost all (maybe literally all) of our competitors are amenable to binging. It's true of books, video learning platforms, and most/all other interactive learning platforms.

Execute Program is very intentionally non-bingeable. When you start a course, you get 5 lessons on the first day, then it stops you and tells you to come back tomorrow. On the next day, you get some brief reviews of yesterday's lessons, then a few new lessons, then it stops you again until the next day. That cadence repeats until you finish the course. You can't binge/cram even if you want to.

(A bit more technical detail: it's a spaced repetition system with exponential review intervals, similar to those used for language learning in e.g. WaniKani and Anki. But it also has a lot of fine-grained knowledge of its own course structure, so it can use reviews to intelligently unlock different lessons depending on how the user performed on their reviews.)

Occasionally, we get support email from new users who don't like this. They want to cram a whole course in a day. But cramming is a very time-inefficient way to learn, so this is self-defeating! Since launch, we've had good success adjusting the app's behavior and internal explanations to reduce these complaints.

However, we still get emails from long-term users who appreciate the time limitations. Generally these fall into two categories:

1. Users like that an enforced break before the reviews provides tangible evidence that "yes, I genuinely understood yesterday's lessons". If we allowed cramming, that reassurance wouldn't exist; it's too easy to succeed at a review when you just finished the lesson 30 seconds ago.

2. Users like that the usage limits remove a source of anxiety and worry. You do your reviews and lessons, you finish, and then you wait until tomorrow. There's no temptation to think "I really should've done 10 lessons today instead of 5; I'm so lazy".

It's still possible for a very dedicated user to do all of our courses in parallel within their first monthly billing cycle. (Median course start-to-finish time is 8-18 days depending on the course.) So this scheme doesn't make users pay us more than they would otherwise. And they're spending the same amount of wall-clock time that they'd spend if they crammed all of the lessons in one day. That makes it pure win: they memorize the topics more deeply, they worry less, and they get those benefits for no extra time expenditure. The only exception I can think of would be people who think "I must get exposure to all TypeScript syntax and semantics before tomorrow morning, even if that significantly reduces my ability to remember what I learned."

Obviously I'm very biased here, and the goals that we're optimizing for don't even exist in most other product spaces. But I thought it would be nice to have a counterexample to "engagement at all costs".

discuss

order

charcircuit|5 years ago

Just because there are spaces, it doesn't mean something isn't "addictive." I was addicted to WaniKani when I first started it even if I wasn't binging it. Optimizing your product so users come every day (and hence every month paying for a subscription) you care that users engage every day more than the amount that they engage every day. Advertisement monetization streams care about how much time users are on the platform where subscriptions just care that users continue to use the platform.

gary_bernhardt|5 years ago

I think your argument here could be made about pretty much any activity that humans do repeatedly. The critical difference is that both WaniKani and Execute Program quickly tell you "go home, you're done", so it's difficult to dump hours of low-quality time into them. Whereas advertisement-driven platforms are incentivized to retain your eyeballs for as long as possible, as you pointed out.

dna_polymerase|5 years ago

> Just because there are spaces, it doesn't mean something isn't "addictive."

Right, this results in habit creation, which means sustainable addiction.

pixelbro|5 years ago

Uh, it's interesting that you see the design of your product as a counterexample, because to me it looks exactly like what mobile games have been doing as a mechanism for maximizing engagement.

You want to stop them from playing through too much of the game's content and burning themselves out on it. So you lock them out with a timer, forcing them to come back later. Then you reward them for coming back every day. This encourages them to turn the game into a habit and integrate it into their routine.

Looks to me like you've accidentally stumbled onto one of the very tactics games use to turn people into addicts.

cercatrova|5 years ago

Habits can be good or bad. In this case, one would want the user to be rewarded for coming back every day to learn programming. Habit acclimation is a neutral process, just because the parent uses the same tactics as those who use them for building bad habits does not mean that those processes are bad in and of themselves.

oarsinsync|5 years ago

> You want to stop them from playing through too much of the game's content and burning themselves out on it. So you lock them out with a timer, forcing them to come back later. Then you reward them for coming back every day.

Simultaneously offering a pay-to-play option that enables the user to bypass the timeout with money

wahnfrieden|5 years ago

Yes... I build iOS apps for learning Japanese ( https://reader.manabi.io https://manabi.io ) and recognized how the same kind of SRS system I was building is both optimal for learning and habit-forming in the same way as game dark patterns. It felt economically and morally fortunate but I recognize it’s not an easy or light responsibility to customers to get it right.

LaGrange|5 years ago

> Uh, it's interesting that you see the design of your product as a counterexample, because to me it looks exactly like what mobile games have been doing as a mechanism for maximizing engagement.

Addiction is a habit that interferes with other areas of your life. Smoking isn't bad because you're having something to do with your hands during a break, it's bad because it's expensive and impacts your health. Playing games for 8 hours is fine if you have time for that, but bad if it stops you from keeping your bathroom clean.

So yeah, intentional habit forming is using the same techniques as addiction building. The difference is, essentially, in the informed consent involved in the former.

imtringued|5 years ago

>Looks to me like you've accidentally stumbled onto one of the very tactics games use to turn people into addicts.

You're confusing something. It's the exact opposite.

"Games accidentally stumbled onto one of the very tactics you use to turn people into addicts."

Industries take advantage of human behavior, they don't invent them.

pedalpete|5 years ago

Unrelated to original thread - I find it interesting the way you approach this comment. You mention pricing almost as if you're apologizing. Your competitors, even if they are binge-focused, don't apologize for charging customers. They would never have a an advert that says "we've got this great course, but before you go check it out, I'll warn you, it costs money".

I like your thinking of non-binge learning, and think you could really use that as a differentiator, in your marketing.

Your site looks great, and I really like the way you approach it, or describe it here, but that isn't coming through in your branding. Think Salesforce's "no software", they showed who the enemy was, and put them squarely against it, and if you really look at it, they were selling a CRM, not selling "no software", you're even closer to your product.

If you haven't yet, you may want to check out the book Play Bigger and category creation.

Just a thought, best of luck to you.

gary_bernhardt|5 years ago

I appreciate it. We've struggled with communicating the non-binge aspect, and usually approach it from the other side: by talking about reviews, spaced repetition, remembering, etc. But I think you're right that approaching it from the "non-binge" side is a good idea. Coincidentally, we're about to do a major landing page revision, so the timing is right to give that a try!

As for apologizing for charging money... you're right there too. A lot of people will complain when someone dares to charge money for learning resources, even those that take multiple full-time staff to maintain. I think that's worn me down a fair bit!

Demigod33|5 years ago

Do you mean the book by Kevin Maney, Al Ramadan et al.?

donmcronald|5 years ago

I don't know if I'd like that. I grabbed some of Maximilian Schwarzmüller's courses off Udemy a couple years ago and, by far, my favorite thing was being able to blast through the simple concepts that I already understood and to slow down on the new stuff.

I think a recommended pace that's easy to achieve would make a nice goal, but I would balk at the idea of it being enforced if I were paying money for it.

bostonvaulter2|5 years ago

Ah, that looks really neat! I have a couple minor pieces of feedback after looking at the homepage. The graphic for "Review Exponentially" [1] was a little difficult to grok initially. My first thought was that time was flowing downwards. I think a labeled arrow indicating the flow of time would be helpful, perhaps also a label to indicate that the numbers at the bottom represent days (instead of relying on me to understand that implicitly because one of them is labeled "Day 4: Lesson".

Also in the "Course" section I think you should include a link to "All Courses" because I almost bounced because none of those three courses were interesting to me (but I eventually found the list at the bottom, and SQL is a topic I'm interested in solidifying further).

Lastly I think it would be great to have a sign-up list to be notified of new courses (I do realize that perhaps if you sign up for a free account you _might_ also get information about new courses, but that's doesn't seem fully certain).

[1] https://www.executeprogram.com/images/diagram-lessons-over-t...

gary_bernhardt|5 years ago

All good feedback, thanks! An upcoming landing rework will get the first two, and I added "separate sign-up list for new courses" to my queue.

feralimal|5 years ago

Your product has a feature that curtails 'addiction' for the benefit of the user - ie to improve knowledge via spaced repetitions. A knowledgeable customer will recommend you and come back for more. Great!

Social media requires time from those users - they want to know you, crack you open psychologically, so they can then be better at selling you stuff (and, incidentally, pass all that info on to 3 letter agencies for their population modelling etc). That is a different model. They want you to be deeply engaged for a long time. The longer the better.

JetAlone|5 years ago

Interesting. I was recently recently reminded about the "Pomodoro" method ("Pomodoro" = 25 minutes on, 5 minutes off, 1 "set" is 4 Pomodoros followed by an additional 30 minute break) - it might be interesting to have a learning platform with a Pomodoro timer baked right into the site.

jcelerier|5 years ago

> But cramming is a very time-inefficient way to learn,

who are you to judge how I learn ?

Zebrakopf|5 years ago

I don't think he is judging the way in which you learn. He's simply referring to the current state of research like: Putnam, et al. (2016). Optimizing Learning in College: Tips From Cognitive Psychology

There has been lots written on learning strategies but one thing we are rather certain of is that cramming is usually the worst way to retain information (if you want to learn it well). You can even read about funky neuronal reasonings for that argument if you are interested.

TeMPOraL|5 years ago

Expanding your thought a bit: for example, for people with ADHD-PI, cramming may in fact be the only way in which they can learn the stuff they're not currently being obsessive about.

That said, you can't optimize for everyone simultaneously. There's plenty of cramming-friendly resources available.

teraku|5 years ago

I first learned of spaced-repetition learning from wanikani when I started learning japanese kanji and can only recommend to everyone!!!

Great approach, Kudos!

torgian|5 years ago

Well this is very interesting. Congrats on the marketing, I’m going to check this out

cesarvarela|5 years ago

This reminds me of the drip feed algorithm used by Tinder.