Talk:Entropy (information theory)

Would someone familiar with the terms and practices AND of the English language go through and fix, please?

This is one of the worst-written pages I've ever encountered on Wikipedia; it sounds as though it was copied directly from a poorly-written upper-level textbook on the subject. The major problem is clarity - it uses longwinded, unnecessary phrases where simple ones would be both synonymous and much clearer to the reader, and has an inflated vocabulary. I don't understand the subject matter myself well enough to do a complete revision of it, though I am going to go through and do a cleanup of anything I am sure I know the meaning of.

If someone with more knowledge of the subject could do more in-depth work on it, that'd be very helpful. This is supposed to be an *encyclopedia* entry - that is, it's supposed to be a reasonably easily-understood explanation of a complex topic. Currently the "complex topic" part is more than covered, but there's not nearly enough of the "easily understood" part. In particular, the intro paragraph needs *heavy* revision, as it's the main thing non-technical readers will look at if they encounter this topic.

To forestall complaints of "It's a complex topic so it NEEDS complex language!": Yes, that's true, but there's a difference between technical terminology used to explain something and incomprehensible masses of unnecessarily-elevated vocabulary and tortured phrasing.

There is some instability as to the base for logarithms in formulas in this article. ${\displaystyle log}$ (without subscript) I assume is base e. Should this change be reverted. Can someone review log bases in the formulas? ~Kvng (talk) 14:59, 24 March 2025 (UTC)

The images used for example of "heads" and "tails" coin sides is visually distracting. The Lincoln cent is the most common coin in circulation in the world. Or, something simpler could be used like simple red and black sides. Chartjunk - Wikipedia 167.127.95.224 (talk) 16:23, 25 September 2025 (UTC)

I agree, it is a hopeless image Yesterday, all my dreams... (talk) 14:57, 11 March 2026 (UTC)

I saw somebody talk about the grammar but I think it's pretty well written. Kyars (talk) 17:24, 16 November 2025 (UTC)

Grammar is one thing, mathematics is another. The article has serious errors. I will try to fix some over time. Yesterday, all my dreams... (talk) 07:00, 12 March 2026 (UTC)

Alas, no. This is a BS artist. His paper offers nothing new besides a bunch of schoolboy howlers. ~2025-40133-09 (talk) 10:47, 7 January 2026 (UTC)

• I was not even aware of his work, and I am supposed to know the subject! After reading it, I should say that it is beyond schoolboy given his use of categories but certainly a convoluted approach which will remain obscure. I will say something about it in the article later. Yesterday, all my dreams... (talk) 15:07, 11 March 2026 (UTC)