long-ass exposition but the payoff is worth it