Markov Chains for programmers

[HackOfAllTrades]

First thought upon reading the title: "Surely you could pay them to stay."

[westcort]

I have used Markov chains for a few fun projects, like this Markov chain headline generator (https://locserendipity.com/Markov_Headlines.html), and a Markov generator based on a certain someone's Twitter feed (https://locserendipity.com/Markov_Trump.html), but this looks like a good resources for more serious applications.

[ganzuul]

https://github.com/coleifer/irc/blob/master/bots/redisbot.py

This is great fun. Once it has learned a little about you and your friends it sometimes spits out a lyrical home-run. It is of course you who provide the intelligence of interpretation, but it still feels mysterious when it 'talks' in a way relevant to the context.

[m000]

- "Markov Chains for programmers." Cool!

- Opens PDF.

- Typeset in Computer Modern.

- Starts running, screaming in Comic Sans.

Jokes aside, CM is not the only game for math-heavy documents. Something like Libertinus [1] would probably be more screen-friendly.

[1] https://github.com/alerque/libertinus

[layer8]

This has been downvoted, but I think selecting more screen-friendly fonts is a valid concern nowadays. Personally I would also like to see a reflowable format (which I guess would mean HTML with MathJax).

[spekcular]

What's wrong with computer modern?

[raister]

The author has uploaded a version of the book in the libertinus font - I guess he heard your complaints!

[kjs3]

This is seriously the most insightful comment you can come up with? If it is, you would do well to consider silence.

[raister]

Only the frontispiece uses a different font (can't say for sure whether it is Comic Sans though) - the rest is pure Times new Roman.

[dddnzzz334]

Computer Modern is the best looking font

[raister]

Interesting find - really introductory examples. Good read, recommend it.

[jonititan]

Pymc3 is pretty good. https://docs.pymc.io/en/v3/

[b20000]

it’s for programmers but comes with matlab code and excel sheets

[Jtsummers]

Nothing wrong with either of those. Also, if you take the time to check out the book or its GitHub repo, then you will see that there is also C code and C "challenges" (projects) for the reader to go through.

[hvasilev]

There are just so many of these fun AI-related concepts that seem really cool and you get the chill that they will take over the world some day.

Decades pass and you realize they either have little to no application or are incredibly niche :(

Too bad that "solution in a search of a problem" is generally bad approach to problem-solving. I wish our industry was more fun as a whole.

[robbedpeter]

Most of the time, these things are resource hogs arriving way before their time to shine, either needing Moore's law to catch up the hardware, or some nerd to wrestle with the combinatorial explosion and win. Transformers can be seen as a variation on Markov chains, but the innovation of attention mechanisms means you can use hundreds of thousands of tokens and thousands of tokens in sequences without the problem space going all Buzz Lightyear on you.

https://www.zabaware.com/ultrahal/

Ultra Hal was a best in class chat bot when fixed response systems like Alice/ AIML were the standard. Ultra Hal used Markov chains and some clever pruning, but it dealt with a few hundred tokens as words and sequences only 2 or 3 tokens out. It occasionally produced novel and relevant output, like a really shitty gpt-2.

I think we may see a resurgence of expert systems soon, as gpt-3 and transformers have proved capable of automating rule creation in systems like Cyc. They've already incorporated direct lookups into static databases gpt / RETRO type models. Incorporating predicate logic inference engines seems like the logical and potent next step. GPT could serve as a personality and process engine that eliminates the flaw (tedium) in massive, tedious, human level micro-tasking systems from GOFAI.

It's worth going through all the literature all the way back to the 1956 summer of code and hunt for ideas that just didn't work yet.

https://en.wikipedia.org/wiki/Dartmouth_workshop

[Fomite]

...Markov Chains (via MCMC) underly most Bayesian inference problems, and pretty much all stochastic dynamical systems models are based on Markov Chains.

[klysm]

Markov chain Monte Carlo is incredibly useful and widely applied.

[skykooler]

Aren't Markov chains how predictive typing usually works? (or worked, I suppose the big players are probably using some sort of neural net now)