information theory

A short introduction to information theory

I lectured this week in my Biology of Mind course [http://biologyofmind.johnhawks.net/] about information theory, and in particular the concept of Shannon entropy. I’ve typed up a few notes for my students, and I’m cross-posting them on my own blog because they are relevant to another