LeetArxiv

LeetArxiv

Day 1 : AI Advent of Code

Claude Shannon : A Mathematical Theory of Communication

Murage Kibicho's avatar
Murage Kibicho
Dec 09, 2024
∙ Paid
6
6
2
Share

Introduction


The first paper we’re implementing is Claude Shannon’s 1948 paper, A Mathematical Theory of Communication.

The paper introduces Shannon Entropy - one of the cornestone ideas in Artificial Intelligence.

Here’s the main equation we’ll implement.

Shannon’s Equation of Entropy

LeetArxiv Notebook Day 1 Link

Find the LeetArxiv notebook here

Reminders

  1. P…

Keep reading with a 7-day free trial

Subscribe to LeetArxiv to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Murage Kibicho
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture