Kybernetika 47 no. 3, 337-355, 2011

Entropies of vague information sources

Milan Mareš

Abstract:

The information-theoretical entropy is an effective measure of uncertainty connected with an information source. Its transfer from the classical probabilistic information theory models to the fuzzy set theoretical environment is desirable and significant attempts were realized in the existing literature. Nevertheless, there are some open topics for analysis in the suggested models of fuzzy entropy - the main of them regard the formal aspects of the fundamental concepts. Namely their rather additive (i. e., probability-like) than monotonous (typical for fuzzy set theoretical models) structure. The main goal of this paper is to describe briefly the existing state of art, and to suggest and analyze alternative, more fuzzy set theoretical, approaches to the fuzzy entropy developed as a significant characteristic of the information sources, in the information-theoretical sense.

Keywords:

fuzzy set, uncertainty, information source, message, fuzzy entropy, fuzzy information

Classification:

94A17, 94A15, 94D05, 03B52