X Bookmarks — 2023 KW40: Precomputed keyword clustering at Ahrefs

October 5, 2023

|bookmarks

by Florian Narr

X Bookmarks — 2023 KW40: Precomputed keyword clustering at Ahrefs

@timsoulo — Ahrefs keyword clustering is now instant

Keyword clustering in @ahrefs is INSTANT! ⚡️

You don't need to upload the list of keywords and wait ⌛️ until they will be organised into clusters.

Here at Ahrefs we've already done all the "clustering" on the backend!

So you can put your "seed" keyword in and hundreds of related clusters appear immediately.

Makes sense as an infrastructure decision — precomputing the clusters at index time instead of on-demand means you trade storage and upfront compute for near-zero latency at query time. The tradeoff only works at Ahrefs' scale, where the keyword dataset is static enough that batch-processing it is cheaper than computing clusters per user request. For anyone building something similar at smaller scale, the on-demand approach is probably fine. But if you're crawling the entire web, you batch.