information entropy
A measure of the uncertainty associated with a random variableA measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.
» Information theory about information entropy and physics talk about entropy are two different concepts that have the same name.
Meaning
1 senses(uncountable)A measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.
Examples
1 sentencesInformation theory about information entropy and physics talk about entropy are two different concepts that have the same name.
Translations
1 languagesSynonyms
1 synonymsWord family
1 related wordsLessons for this word
1 lessons- A1Countable and uncountable nouns — Because it can be uncountable