[whereismyacc]

It sounds like you're talking about information entropy which to my understanding is analogue to but not the same as entropy in physics?

[ajkjk]

It pretty much is the same, except that entropy in physics usually has a constant in front of it.