Python Unicode and Encoding — ELI5

Imagine every language in the world uses a different alphabet.

Chinese has thousands of characters. Arabic reads right to left. English uses 26 letters. Japanese has three different writing systems.

Old computers could only handle English. They used a tiny code table called ASCII with just 128 slots — enough for A-Z, numbers, and a few symbols.

Then the world needed computers that could write in every language.

Unicode is the solution. It’s like a massive phone book that gives every character from every language its own unique number. The letter “A” is number 65. The Chinese character “中” is number 20013. Even 🎉 has a number: 127881.

Encoding is how you turn those numbers into actual bytes that a computer can store and send.

The most popular encoding today is UTF-8. It’s clever because:

• Simple English letters use just 1 byte (fast and small)
• Chinese characters use 3 bytes
• Emojis use 4 bytes

It uses exactly as many bytes as needed — no waste.

In Python 3, strings are always Unicode. You can write "café" or "日本語" or "🐍" and it just works. Python knows the number for each character.

But when you save to a file or send over the internet, you need to pick an encoding. Python uses UTF-8 by default, which handles almost everything.

When things go wrong:

• You open a file saved in one encoding but tell Python it’s another
• You see UnicodeDecodeError or garbled characters like café

The fix is almost always: make sure both sides agree on the encoding (usually UTF-8).

One Thing to Remember

Unicode gives every character a number, encoding turns numbers into bytes, and Python 3 handles Unicode natively — just make sure your files and network connections use the same encoding.