Explain the fundamental concepts of Claude Shannon's information theory. Define entropy, mutual information, and channel capacity, and explain their theoretical significance. Discuss how these concepts apply to data compression, error correction, and the limits of communication systems.