How to build a second brain from your YouTube history
A practical workflow for turning years of passive watching into a knowledge graph you can actually use.
By BrainTube Team · · 9 min read
Most 'second brain' guides assume you're starting from zero. You're not. You probably have 1,200+ hours of YouTube history that already represents your intellectual interests better than any tag system you'd design from scratch. The work is to harvest it.
Step 1 — Audit, don't import
Open Google Takeout, export your YouTube watch history as JSON, and sort by channel. You'll find that 80% of your real learning lives in 15-30 channels. Everything else is noise. Import only the channels — not the full firehose — and you've already cut the problem 10x.
Step 2 — Group videos by question, not topic
Topics are too broad ('productivity', 'startups'). The unit that actually pays off is the question: 'how do solo founders price their first SaaS?' Create a Brain for each live question you carry. As videos enter, route them to the matching Brain. Videos that don't fit a question are probably not worth keeping.
Step 3 — Highlight ruthlessly
When you watch (or skim a transcript), highlight only the line that would change someone else's mind. Three highlights from a 40-minute video is plenty. The highlight, the timestamp and the channel are now a citation you can drop into any conversation.
Step 4 — Query weekly, prune monthly
Once a week ask your library a real working question. Once a month, delete the videos you never highlighted, never queried, and never shared. A second brain that doesn't shrink is a hoard.
Takeaways
- Your existing YouTube history is the dataset — start there.
- Organise by open question, not by topic taxonomy.
- Three good highlights beat a perfectly tagged transcript.
- Prune monthly or it becomes a hoard.
Try BrainTube on your own corpus
Free tier, no card. Export anytime.
More to read
- Second Brain vs AI Memory Layer: What Actually Changed — A second brain system organises what you write. An AI memory layer makes what you consume queryable by any model. The difference decides which one you should actually build.
- Stop watching videos. Start querying them. — The 60-minute video you bookmarked won't get watched. But the four answers buried in it will get used — if you can pull them on demand.
- MCP, and why your personal knowledge graph is suddenly worth something — Model Context Protocol turns your private corpus into a first-class citizen for Claude, Cursor and every agent shipping next year. Here's what that means for the way you save.