Which characters live between topics?

One of the 6.11 openers asks: find the pages with unusually mixed LDA topic proportions — do those characters really bridge themes, or is the model confused? We asked, we drew one figure, and we dragged the actual sentences in underneath as evidence.

The ask

↑

Representation: the week-6 names-removed LDA fit (8 topics, seed 0) — in that fit every page is a mixture of themes: mutant life, symbiotes & hosts, media boilerplate, and friends. A page that is 98% one theme is an easy label. A page at 47%/28% is the interesting one. We measured each page's mixture entropy (how evenly its topic shares are spread) and sorted all 303 pages by it.

The figure

↑

One row per character: the 8 topic shares as a stacked bar (topic colors below the panel), sorted most-ambiguous first; the number at the right is the entropy, of a maximum of 3.00. Pure pages are a single solid block. The colored dot is the week-4 community — watch what the straddlers' dots do. Click a row for the page's top topics and the actual sentences that carry its minority topic.

media boilerplate
mutant life
gods & vampires
…full topic names in each row's tooltip

What it said

↑

Limitation

↑

One frozen fit. Change the seed and the top-20 straddler list reshuffles; the boilerplate topic's grip on popular pages is the fit's signature, not the corpus's law. The ranking tells you where to look — the drawer's sentences are as far as it can take you, and the verdict stays human.

← Back to all weeks