True or false? If is the probability of an event, then the Shannon information of the event is bits.
I’m quite interested in knowing what you believe, and why you believe it, even if you cannot justify your belief formally.
Formal version. Let be a discrete probability space with and let event be an arbitrary subset of Is it the case that in Shannon’s mathematical theory of communication, the self-information of the event is equal to bits?