Independent and Symmetric Channels in Information Theory
Explore the concepts of independent and symmetric transmission in information theory, including how they differ from noiseless channels. Learn about the properties of symmetric channels like Binary Symmetric Channels (BSC) and Ternary Symmetric Channels (TSC). Discover how to specify and model different types of channels in communication systems.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
\ \ Information Theory and coding lecture 13 :- Independent Transmission
Independent Transmission This is the opposite case of the noiseless channel, where the symbols {??} are independent of the symbols { ?? }, for all i and j. Thus, note: if we have independent transmission then the average mutual information is zero, also (using the relations between entropies and average mutual information)
Symmetric Channels The symmetric channels are those channels that have identical correct transition probabilities for all symbols and similarly for the incorrect transmission probability. Example:- Binary Symmetric Channel (BSC) its general form is given by:
Symmetric Channels Example:-Ternary Symmetric Channel (TSC)
Question Specify the type of the following channels (noiseless or/and symmetric) and then draw the model of each channel:
