- Ali's Newsletter
- Posts
- 🧠💡 Meet TOON — The Future of Compact Data for LLMs 🤖✨
🧠💡 Meet TOON — The Future of Compact Data for LLMs 🤖✨
🚀 Token-Oriented Object Notation (TOON) — The Smart Way to Talk to AI 🗣️💬
Hey there, AI explorers! 👋
If you’ve ever worked with Large Language Models (LLMs) like GPT or Claude, you know the pain:
💸 Every token costs money.
🐢 Long JSONs slow down your prompts.
😩 And your context window fills up fast.
Well, guess what? There’s a brand-new data format designed exactly for that problem.
It’s called TOON — Token-Oriented Object Notation, and it’s here to make your AI pipelines faster, cheaper, and cleaner ⚡
Let’s unpack this beauty 👇
🎯 What Is TOON?
TOON (Token-Oriented Object Notation) is a compact, human-readable, LLM-friendly format for structured data.
Think of it like JSON’s smarter, leaner sibling — one that speaks the same language as your model, but with fewer words.
💬 TL;DR: TOON = Less tokens ➡️ Less cost ➡️ Faster responses 💨
🧮 Why TOON Exists
When you feed structured data (like user profiles, configs, datasets) into an LLM, JSON can get token-heavy.
Every {, }, ", and , eats up tokens — and those add up 🧾
👉 TOON removes all that clutter.
It uses indentation, short delimiters, and a tabular layout to make your data super compact — without losing structure.
Example time! 🧑💻
JSON:
{
"users": [
{ "id": 1, "name": "Alice", "role": "admin" },
{ "id": 2, "name": "Bob", "role": "user" }
]
}
TOON:
users[2]{id,name,role}:
1,Alice,admin
2,Bob,user
🔥 That’s fewer tokens, clearer structure, and more space in your LLM context window!
🧠 Perfect for LLM Prompts
TOON was literally designed for LLMs — it’s not just a data format, it’s a prompt optimization strategy! 💪
Here’s why models love it:
✅ Compact — fewer tokens mean more data per prompt.
✅ Structured — indentation and headers help the model “see” data patterns.
✅ Readable — humans can easily write and debug it.
Whether you’re building:
🧾 Data-driven chatbots
📈 AI analytics pipelines
🧠 Context-rich retrieval systems
🗂️ Summarization or reasoning tools
…TOON helps you pack more signal into your prompt.
⚙️ Quick Start with the TOON API
The team behind TOON provides an awesome TypeScript SDK to make life easier 👇
🧩 Install
npm install @toon-format/toon
💻 Encode Data
import { encode } from '@toon-format/toon';
const data = {
users: [
{ id: 1, name: 'Alice', role: 'admin' },
{ id: 2, name: 'Bob', role: 'user' }
]
};
console.log(encode(data));
➡️ Outputs the compact TOON format above!
🔁 Decode Data
import { decode } from '@toon-format/toon';
const obj = decode(toonString);
You’re back to plain JSON — ready for your app or LLM! 🪄
💎 Cool Features You’ll Love
✨ Key Folding: Merge nested paths like data.metadata.items to save tokens.
✨ Tabular Arrays: Compact arrays of uniform objects (like CSV + JSON had a baby).
✨ Smart Quoting: Only quotes what’s needed.
✨ Human-Readable: No weird syntax — clean indentation like YAML.
✨ Token Efficiency: Up to 40% fewer tokens than JSON in some benchmarks.
🧪 When to Use TOON
💡 Best For:
Feeding structured data to LLMs (especially long lists, tables, or configs)
Prompt optimization
Embeddings or RAG pipelines
⚠️ Not Ideal For:
Deeply nested or irregular JSON structures
When you’re locked into legacy JSON-only systems
🌍 Why It Matters
We’re entering the age of prompt engineering — and efficiency is king 👑
Every token saved means:
💰 Lower cost per API call
⚡ Faster response time
🧠 More room for context
TOON is that quiet revolution that helps your AI workflows scale smarter, not harder.
🏁 Final Thoughts
🚀 TOON is not just another format — it’s a new way of thinking about data efficiency for AI.
For ML & LLM beginners, this is a great chance to learn how optimizing data structure directly affects model performance and cost.
So next time you’re prompting your model — don’t send bloated JSON.
Send it a TOON 🎵
👉 Check it out on GitHub: TOON Format on GitHub
💌 P.S.
If you liked this, subscribe to my Beehiiv newsletter for more easy-to-digest AI + ML tips, tools, and deep dives! 🧠💡
Let’s make prompt engineering fun again 🚀💬✨