APPROACH TO CALCULATING DRAFT ALIGNMENT SCORE AND CREATING THE CONSENSUS
WE SCORE TWO TYPES OF FINAL PUBLIC LISTS:
WE SCORE THE BOARD, NOT THE LOGO. IF A PLAYER GOES 12TH, WE CARE WHETHER THE ANALYST HAD HIM AROUND 12 — NOT WHETHER HE GUESSED THE EXACT TEAM THAT ENDED UP MAKING THE PICK. PICK TRADES CAN SCRAMBLE THE TEAM SIDE OF A MOCK, SO THE CLEANEST APPLES-TO-APPLES TEST IS WHICH PLAYER CAME OFF THE BOARD AT EACH SLOT.
BUILT FROM 113 PUBLISHED LISTS — 67 PROSPECT RANKINGS AND 46 MOCK DRAFTS — ACROSS THE 2022–2026 DRAFT CYCLES. NOT EVERY ANALYST PUBLISHES EVERY YEAR OR IN BOTH FORMATS — ALL-TIME SCORES AVERAGE ONLY THE YEARS AN ANALYST WAS ACTUALLY SCORED.
2026 LISTS ARE TRACKED BUT AREN’T SCORED YET — SCORING WILL HAPPEN AFTER FINAL LISTS ARE PUBLISHED AND THE DRAFT IS COMPLETED.
SLOT ALIGNMENT ASKS: HOW FAR WAS EACH PLAYER FROM WHERE THE ANALYST HAD HIM? A SMALL MISS COSTS A LITTLE. A BIG MISS COSTS MORE. AND MISSES AT THE TOP OF THE DRAFT COUNT EXTRA, BECAUSE THE TOP PICKS CARRY THE MOST VALUE.
MISSING PLAYERS AND PLAYERS RANKED OUTSIDE THE FIRST ROUND ARE CAPPED AT SLOT 33. THAT KEEPS THE PENALTY BOUNDED — MISSING A FIRST-ROUNDER HURTS, BUT ANALYSTS WHO PUBLISH DEEPER LISTS ARE NOT PUNISHED MORE HARSHLY THAN ANALYSTS WHO STOP AT 32.
THE REVERSE COSTS TOO: PLAYERS AN ANALYST HAD IN THE FIRST ROUND WHO WEREN’T ACTUALLY PICKED THERE PUSH REAL FIRST-ROUNDERS OUT OF POSITION — SO THAT PENALTY SHOWS UP INDIRECTLY.
RELATIVE ORDER ASKS: DID THE ANALYST HAVE PLAYERS IN THE SAME ORDER THE DRAFT DID? A FIRST ROUND HAS 496 HEAD-TO-HEAD PLAYER PAIRS. WE CHECK EVERY ONE. IF PLAYER A WENT BEFORE PLAYER B, THE ANALYST GETS CREDIT IF HE ALSO HAD PLAYER A AHEAD OF PLAYER B. THIS REWARDS ANALYSTS WHO UNDERSTOOD THE ORDER OF THE CLASS, EVEN IF THE EXACT PICK NUMBERS WERE OFF. IF ONE PLAYER IS LISTED AND THE OTHER IS NOT, THE LISTED PLAYER IS TREATED AS BEING AHEAD. IF BOTH PLAYERS ARE UNLISTED, THE ANALYST GETS NO CREDIT FOR THAT PAIR.
RELATIVE ORDER USES THE ANALYST’S ORDERING WHEREVER AVAILABLE, INCLUDING PLAYERS RANKED BEYOND THE FIRST ROUND — THIS IS WHERE DEEPER LISTS STILL ADD SIGNAL. A FIRST-ROUND PLAYER AT #40 CAN STILL WIN HEAD-TO-HEAD COMPARISONS AGAINST PLAYERS RANKED LOWER OR LEFT OFF ENTIRELY.
TIER ALIGNMENT ASKS: DID THE ANALYST HAVE THE RIGHT NAMES IN THE RIGHT PART OF THE FIRST ROUND? WE CHECK EVERY CUTOFF FROM 1 TO 32. HOW MANY OF THE ACTUAL TOP 5 WERE IN THE ANALYST’S TOP 5? HOW MANY OF THE ACTUAL TOP 10 WERE IN THE ANALYST’S TOP 10? HOW MANY OF THE ACTUAL TOP 32 WERE IN THE ANALYST’S TOP 32? THEN WE AVERAGE ALL 32 CHECKS.
A REAL EXAMPLE: COREY PRONMAN’S 2023 MOCK DRAFT — THE HIGHEST SINGLE-YEAR MOCK SCORE IN THE 2022–2025 SAMPLE.
| DRAFT PICK | SLOT ALIGNMENT: 91.1% | RELATIVE ORDER: 88.1% | TIER ALIGNMENT: 90.7% |
|---|---|---|---|
THE CONSENSUS IS NOT AN ANALYST — IT’S THE PUBLIC-EXPERT BENCHMARK: THE STANDARD ANY INDIVIDUAL ANALYST HAS TO BEAT TO SHOW THEY ADD SIGNAL.
THE CONSENSUS USES A FIXED PANEL OF REPEAT, HIGH-SIGNAL SOURCES RATHER THAN EVERY LIST WE TRACK. THE GOAL IS TO CREATE A STABLE BENCHMARK THAT IS COMPARABLE ACROSS DRAFT YEARS, NOT A ONE-YEAR AVERAGE THAT CHANGES BASED ON WHO HAPPENED TO PUBLISH.
THE PANEL WAS CHOSEN ON THREE FACTORS:
RANKINGS PANEL: COREY PRONMAN, SAM COSENTINO, CHRIS PETERS, JASON BUKALA, CAM ROBINSON
MOCKS PANEL: COREY PRONMAN, SCOTT WHEELER, CHRIS PETERS, SAM COSENTINO
HERE’S HOW IT’S BUILT:
WHY NOT JUST AVERAGE RANKS? A SIMPLE AVERAGE TREATS EVERY GAP THE SAME — THE GAP BETWEEN #1 AND #5 COUNTS THE SAME AS THE GAP BETWEEN #16 AND #20. THE VALUE-WEIGHTED APPROACH GIVES MORE WEIGHT TO HIGH-END CONSENSUS.
THE CONSENSUS IS THEN SCORED WITH THE SAME DRAFT ALIGNMENT SCORE AS EVERY ANALYST.
THE PUNCHLINE: THE CONSENSUS WINS THE MULTI-YEAR RANKINGS LEADERBOARD. IN MOCK DRAFTS, COREY PRONMAN NARROWLY EDGES THE CONSENSUS — BY LESS THAN ONE-TENTH OF A PERCENTAGE POINT.
PUBLIC DRAFT ALIGNMENT HAS IMPROVED OVERALL FROM 2022 TO 2025. RANKING SCORES ROSE EACH YEAR IN THE SCORED SAMPLE. MOCK DRAFT SCORES ALSO IMPROVED FROM 2022 TO 2025, DESPITE A SMALL DIP ALONG THE WAY.
THE FIELD IS ALSO GETTING MORE CLUSTERED. THE CLEAREST SIGNAL IS THE RISING FLOOR: THE LOWER-SCORING LISTS HAVE MOVED UP MATERIALLY SINCE 2022, ESPECIALLY IN RANKINGS. AFTER A WIDE-OPEN 2023 DRAFT, BOTH RANKINGS AND MOCKS TIGHTENED IN 2024 AND 2025. BY 2025, THE BEST-TO-WORST GAP WAS SMALLER THAN IT WAS IN 2022 FOR BOTH RANKINGS AND MOCKS.
MOCK DRAFTS CLUSTER MORE TIGHTLY THAN RANKINGS. THAT MAKES SENSE: FINAL MOCKS ARE TRYING TO PREDICT THE SAME DRAFT-ORDER MARKET, WHILE RANKINGS LEAVE MORE ROOM FOR ANALYST-SPECIFIC PLAYER EVALUATION.
SEE THE LEADERBOARD >NHL and the NHL Shield are registered trademarks of the National Hockey League. All NHL logos and marks are property of the NHL and its teams. This site is not affiliated with or endorsed by the NHL.