Home QuantitiesPart 13

ℹ

Part 13: Information Science

Information content and entropy

84 entries· Edition 2008, 2025FR→ About this part

traffic intensity

A

E

number of simultaneously busy resources in a particular pool of resources

traffic offered intensity

A_{o}

E

traffic intensity (t13-1) of the traffic that would have been generated by the users of a pool of resources if their use had not been…

traffic carried intensity, traffic load

Y

E

traffic intensity (t13-1) of the traffic served by a particular pool of resources

mean queue length

L

(Ω)

1

time average of queue length

loss probability

B

1

probability for losing a call attempt

waiting probability

W

1

probability for waiting for a resource

call intensity, calling rate

λ

s^{- 1}

·second to the power of minus one inverse second

number of call attempts over a specified time interval divided by the duration (ISO 80000-3:2019, item 3-9) of this interval

completed call intensity

μ

s^{- 1}

·second to the power of minus one inverse second

call intensity (t13-7) for the call attempts that result in the transmission of an answer signal

storage capacity, storage size

M

1

b i t

o

B

·one, bit, octet, byte

amount of data that can be contained in a storage device, expressed as a number of specified data elements

equivalent binary storage capacity

M_{e}

1

b i t

where is the number of possible states of the given device

r

(v)

s^{- 1}

\frac{o}{s}

\frac{B}{s}

·second to the power of minus one inverse second , digit per second, octet per second, byte per second

quotient of the number of specified data elements transferred in a time interval by the duration of this interval

period of data elements, period duration of data elements

T

s

where r is the transfer rate (t13-11) when the data elements are transmitted in series

binary digit rate, bit rate

r_{bit}

(v_{bit})

s^{- 1}

b i \frac{t}{s}

·second to the power of minus one inverse second , bit per second

transfer rate (t13-11) where the data elements are binary digits

period of binary digits, period duration of binary digits, bit period

T_{bit}

s

where is the binary digit rate (t13-13) when the binary digits are transmitted in series

equivalent binary digit rate, equivalent bit rate

r_{e}

(ν_{e})

s^{- 1}

b i \frac{t}{s}

·second to the power of minus one inverse second , bit per second

binary digit rate (t13-13) equivalent to a transfer rate (t13-11) for specified data elements

modulation rate, line digit rate

r_{m}

u

s^{- 1}

B d

·second to the power of minus one inverse second , baud

inverse of the shortest duration of a signal element

quantizing distortion

T_{Q}

W

distortion of a signal resulting from the process of quantizing an original signal when the values to be quantized are within the working…

P_{C}

C

W

power supplied to the antenna feed line by a radio transmitter taken under the condition of no modulation

signal energy per binary digit

E_{bit}

J

where is carrier power (t13-18) and is period of binary digits (item 13-14)

error probability

P

1

probability that a data element be incorrectly received

Hamming distance

d_{h}

1

number of digit positions in which the corresponding digits of two words of the same length are different

clock frequency, clock rate

f_{cl}

H z

frequency at which a clock oscillates

decision content

D_{a}

1

where is the number of possibilities at each decision and the number of events

information content

I (x)

S h

H a r t

n a t

·shannon, hartley, natural unit of information

+ + + where is the probability of event

H

S h

H a r t

n a t

·shannon, hartley, natural unit of information

for the set where is the probability, and is the information content of event

maximum entropy

H_{0}

(H_{max})

S h

H a r t

n a t

·shannon, hartley, natural unit of information

maximum entropy occurs when for

relative entropy

H_{r}

1

where is entropy (t13-25) and is maximum entropy (t13-26)

R

S h

H a r t

n a t

·shannon, hartley, natural unit of information

where H is entropy (t13-25) and is maximum entropy (t13-26)

relative redundancy

r

1

where is redundancy (t13-28) and is maximum entropy (t13-26)

joint information content

I (x, y)

S h

H a r t

n a t

·shannon, hartley, natural unit of information

is the joint probability of events and

conditional information content

I (x \ | y)

S h

H a r t

n a t

·shannon, hartley, natural unit of information

information content (t13-2) of event under the condition that has occurred:

conditional entropy, mean conditional information content, average conditional information content

H (x \ | y)

S h

H a r t

n a t

·shannon, hartley, natural unit of information

where is the joint probability of events and , and is conditional information content (t13-31)

H_{+} (X \ | I)

S h

H a r t

n a t

·shannon, hartley, natural unit of information

conditional entropy (t13-32) of a set of emitted characters given the set I of received characters

H_{-} (I \ | X)

S h

H a r t

n a t

·shannon, hartley, natural unit of information

conditional entropy (t13-32) of a set of received characters given the set of emitted characters: , where is equivocation (t13-33) and is…

transinformation content, mutual information

T (x, y)

S h

H a r t

n a t

·shannon, hartley, natural unit of information

where and are the information contents (t13-24) of events and , respectively, and is their joint information content (t13-30)

mean transinformation content

T

S h

H a r t

n a t

·shannon, hartley, natural unit of information

for the sets , , where is the joint probability of events and , and is their transinformation content (t13-35)

character mean entropy

H'

S h

H a r t

n a t

·shannon, hartley, natural unit of information

where is the entropy (t13-25) of the set of all sequences of characters

average information rate

H^{*}

S \frac{h}{s}

H a r \frac{t}{s}

n a \frac{t}{s}

·shannon per second, hartley per second, natural unit of information per second

where is character mean entropy (t13-37) and is the mean value of the duration of a character in the set

character mean transinformation content

T'

S h

H a r t

n a t

·shannon, hartley, natural unit of information

where is the mean transinformation content (t13-36) for all pairs of input and output sequences of characters

average transinformation rate

T^{*}

S \frac{h}{s}

H a r \frac{t}{s}

n a \frac{t}{s}

·shannon per second, hartley per second, natural unit of information per second

where is character mean transinformation content (t13-39) and is the mean duration of the pair of characters with joint probability

channel capacity per character

C'

S h

H a r t

n a t

·shannon, hartley, natural unit of information

where is character mean transinformation content (t13-39)

channel time capacity; channel capacity

C^{*}

S \frac{h}{s}

H a r \frac{t}{s}

n a \frac{t}{s}

·shannon par seconde, hartley par seconde, natural unit of information per second

where is average transinformation rate (t13-40)

42 of 42 entries