Do stars become more valuable in the playoffs?

During my top-40 player series, there were a number of comments about the difference between regular season and playoff impact among all-time players. When calculating championship odds, do we underrate superstars by focusing on their regular season impact metrics? Is there evidence that stars are more even valuable when the chips are on the line?

The obvious way to answer this involves an examination of playoff-only adjusted plus-minus (APM) data. But since plus-minus metrics are noisy, we’d need multiple seasons to offset variance from the small samples. As far as I know, there isn’t a robust, publicly available APM across multiple postseasons. (Most APM studies incorporate the playoffs into the entire sample, sometimes giving it additional weight.) So instead, I turned to augmented plus-minus (AuPM), which blends the box score with unadjusted plus-minus data to spit out a pretty accurate estimate of APM.1

Since we’re talking about CORP values here, let’s compare AuPM on a per game basis. So a +6 AuPM player who plays half of the time (24 minutes per game) yields a per game AuPM of +3. Using this approach, the best regular-season AuPM mark on record (available league-wide since 1994) came from LeBron James in 2009, who was worth about 7 points per game. Since postseason samples are so small, I examined three-year stretches with a minimum of 1,000 minutes played (still a noisy cutoff) to see if anyone topped 7 per game in the playoffs. Nine players eclipsed 5 points per game, and two went over 7, including LeBron himself:

Tim Duncan is the pace-setter here, with his blistering combination of box-score dominance (10.3 Box Plus-Minus) and on-off impact (+26.8 net) in nearly 2,000 playoff minutes during this stretch. Of course, the off samples in these cases are almost always too small (335 minutes for Duncan), so it’s difficult to completely eliminate noise. Nonetheless, two results of moderate samples outpace the regular-season leaders, and a handful of others cluster behind the best non-LeBron seasons on record. Through this lens, elite regular-season and postseason impact looks quite similar.

I also ran four-year values to collect larger samples. In such cases, only LeBron was over 5 points per game (with an AuPm of +6.9 from 2014 to 2017). Heck, Draymond Green, Russell Westbrook, Manu Ginobili and Shaquille O’Neal were the only others to top 4 points per game across four-year stretches. Longer periods like this allow for more stable off-court samples, but they begin to smooth out peak performance that might only last for a year or two.

One final piece to consider: In order to amass a decent sample, players need to advance deep into the playoffs, which means the competition becomes harder. High seeds reaching the third or final round will typically face a schedule that is 3 or 4 points tougher than a regular season slate. I’m not sure there’s a perfect way to account for that using this method, but the ability to hold similar value is generally more impressive in this context.2

Given the increase in schedule strength, it’s possible these high-end seasons are a hair more valuable than the full-season number suggest. Otherwise, it appears that top-end value for superstars isn’t materially greater in the playoffs than in the regular season, and many superstars fail to match their regular season value.

IV. Historical Impact: The all-time MVPs from Multiple WOWYR studies

Triangulation is an important concept in the social sciences. It allows us to hone in on a result without having a singular, definitive measurement. In Part III of this historical impact series, I ran two huge regressions based on 60 years of game results to determine whose presence correlated the most with his team’s improvement. The differences in those WOWYR results — presented using a “prime” and career value — demonstrated some instability in the regression. So if we want to be confident about how valuable older players were, we’ll need snapshots from different perspectives. We could use a little triangulation.

How accurate is WOWYR?

Prime WOWYR can match a 17-year adjusted plus-minus (RAPM) study for predicting lineup results at the game level. WOWYR correlates well with players from that 17-year RAPM set (from 1997-2014, by Jerry Engelmann), with a correlation coefficient of 0.67 (for scaled results) and an average error (MAE) of 1.1 points. Every player was within 4.7 points of his RAPM value, although among higher-minute players the max error was 2.9 points.

In other words, over long periods of time, WOWYR data and RAPM are quite similar — all players will be within three points of each other and most will be within a point. We wouldn’t expect the values to be identical, because WOWYR and RAPM are measuring two similar, but slightly different, events. Still, despite the convergence, WOWYR is plagued by two major problems.

First, it’s sample size isn’t large enough for every player. Sometimes players log years with the same combination of teammates or even a single teammate (Stockton and Malone). Although they played hundreds of games, the play-by-play analogue would be Wilt Chamberlain logging 45 minutes a game, and then trying to infer his value based on 250 minutes of time off the court. It gives rise to the dreaded collinearity issue, and we’re less confident in those kinds of results.

Removing a season or three of data can alter a player’s values by a few points per game, which isn’t always a result of him playing differently in those seasons. In order to accurately solve for “what’s the most likely impact for Larry Bird on all of his lineups?” we need to know about the value of his teammates, like Reggie Lewis. And since Lewis only played a few years, his estimate is a bit fuzzy, and that in turn effects Bird’s estimate.

Second, like any RAPM study that’s too long, it smoothes over differences between peak years, ignoring aging and injury. There are some ways around this — one of which is to use smaller time periods — but other potential solutions are for another post.

10-Year GPM: Another perspective

WOWYR is one perspective; it’s a bunch of weighted WOWY data that is regressed. Building off of the the same idea, Backpicks reader Zachary Stone has tackled historical games with a slightly different approach that I’ll call GPM (Game-level adjusted Plus-Minus). GPM is more analogous to “pure” RAPM in that each game result is a row in the equation, whereas WOWYR combines games and weights the lineups. The details of Zach’s version of GPM:

  • It uses only players who played at least 25 minutes per game during a season, so those games where Draymond Green is ejected early still count as a game played for him.
  • It uses a “replacement” player cutoff of 260 games. (The other studies below use 82 games.)
  • It’s run on data from 1957-2017.
  • (Technical detail: This version of GPM chose a lambda using the computationally expensive generalized cross-validation, not the chunkier k-fold method used for WOWYR in Part III.)

But there’s still the issue of time to consider. We don’t want the model thinking that Michael Jordan in his Wizard years is actually the Michael Jordan. So Zach ran the regression in 10-year slices, from 1957-66, 1958-67, 1959-68 and so on, and then grabbed each player’s best 10-year run. Finally, he scaled the results to allow for apples to apples comparisons across eras.

In theory, this will yield a better ballpark of those players with relatively consistent 10-year primes. Combined with WOWYR, this will give us multiple snapshots of the past based on game-level results. Additionally, I’ve added an alternative version of WOWYR to the table below that uses 20 minutes per game as a cutoff for qualifying players — a version that was slightly worse at predicting lineup results than the prime WOWYR published in Part III, but contained enough variability to throw into the mix.

Together, this triangulation won’t produce retina display clarity of past players, but it’s not exactly fuzzy in most cases. Anyone who fares well in all three of these areas was likely impacting the scoreboard when they played. In the table below, I’ve averaged the three regressions and included the variability among the three as a measure of stability (smaller is better). The “GPM years” column is the period of time Zach’s model picked for each player – some of the lesser names like Don Buse have been excluded:

PlayerScaled WOWYRAlt Scaled10-yr Scaled GPMGPM YearsAvg.Variability
David.Robinson8.49.49.41990-999.10.5
Magic.Johnson9.39.38.31982-919.00.6
Steve.Nash8.19.29.42002-118.90.7
Michael.Jordan8.38.87.61987-968.20.6
John.Stockton9.07.38.11989-988.10.9
Oscar.Robertson7.88.47.71962-718.00.4
LeBron.James7.89.55.72007-167.71.9
Jerry.West6.97.17.81964-737.30.5
Dikembe.Mutombo7.98.25.51992-017.21.4
Paul.Pierce6.76.77.12000-096.80.2
Bill.Russell5.94.99.41960-696.72.3
Shaquille.O.Neal6.26.46.71993-036.40.3
Kevin.Garnett5.76.36.81997-066.30.5
John.Havlicek3.55.06.41964-736.10.3
Dirk.Nowitzki6.66.84.92002-116.11.1
K.Abdul.Jabbar5.75.76.21972-815.90.3
Gary.Payton6.35.15.91993-025.70.6
Tim.Duncan5.25.06.92001-105.71.0
Hakeem.Olajuwon5.36.54.71985-945.50.9
Kobe.Bryant6.05.15.42002-115.50.5
Larry.Bird3.86.55.81980-885.31.4
Wilt.Chamberlain5.65.94.21960-695.20.9
Charles.Barkley4.65.16.01985-945.20.7
Patrick.Ewing4.65.25.71986-955.20.5
Bob.Lanier5.05.25.11971-805.10.1
Rashard.Lewis4.55.35.52000-095.10.5
Clyde.Drexler5.85.14.31984-935.10.7
Rasheed.Wallace5.64.94.62000-095.00.5
Otis.Thorpe4.95.14.51985-944.90.3
Vlade.Divac5.35.24.01994-034.80.7
Jeff.Hornacek4.84.75.01991-004.80.2
Alonzo.Mourning4.05.04.81993-024.60.6
Chauncey.Billups5.34.14.42001-104.60.6
Nate.Thurmond4.64.54.71964-734.60.1
Eddie.Jones4.25.04.41995-044.50.4
Bruce.Bowen5.84.03.72000-094.51.1
Bill.Laimbeer5.64.23.51983-924.41.1
Rick.Barry5.65.81.81971-804.42.3
Julius.Erving5.74.62.71977-864.31.5
Dave.DeBusschere5.45.91.61965-744.32.3
Dennis.Rodman4.94.43.61988-974.30.7
Terry.Cummings4.74.23.91983-924.30.4
Chet.Walker1.85.84.81965-744.12.1
Tracy.McGrady4.14.23.91998-074.10.1
Isiah.Thomas4.23.74.11982-914.00.3
Robert.Parish4.03.14.71981-903.90.8
Dennis.Johnson4.04.73.11980-893.90.8
Karl.Malone3.63.84.21991-003.90.3
Clifford.Robinson3.74.43.41991-003.80.5
Hal.Greer3.24.04.41962-713.80.6
Scottie.Pippen3.93.93.51989-983.80.2
Artis.Gilmore3.93.04.11977-863.70.6
Detlef.Schrempf3.74.32.91986-953.60.7
Jason.Kidd3.23.83.92000-093.60.4
Dwight.Howard3.94.62.12005-143.51.3
Reggie.Miller3.13.73.71988-973.50.3
Chris.Paul5.43.81.32007-163.52.1
Jerome.Kersey3.44.42.51986-953.40.9
Greg.Ballard5.73.70.81978-873.42.5
Ben.Wallace3.43.83.02000-093.40.4
Horace.Grant3.43.33.41988-973.40.0
Shane.Battier3.83.42.72002-113.30.6
Jack.Sikma3.23.23.61978-873.30.2
Moses.Malone2.83.14.01977-863.30.6
Alex.English2.54.03.31982-913.30.8
Hersey.Hawkins4.52.92.31989-983.31.1
Alvan.Adams5.13.31.31978-873.21.9
Bob.Pettit3.53.52.41958-673.20.6
Vince.Carter3.22.93.32006-153.10.2
Elvin.Hayes3.03.62.71969-783.10.5
Rasho.Nesterovic5.24.4-0.22000-093.12.9
Elden.Campbell4.13.81.31993-023.11.5
Derek.Fisher3.43.52.32002-113.10.7
Sam.Jones3.14.02.01958-673.01.0
Cliff.Levingston2.93.03.11983-923.00.1
Mike.Bibby2.73.23.02000-093.00.3
Mitch.Richmond3.73.41.71989-982.91.1
Bobby.Jones3.22.92.61977-862.90.3
Andre.Iguodala3.23.22.32005-142.90.5
Charles.Oakley4.33.60.51986-952.82.0
Danny.Ainge3.63.21.41985-942.71.2
Tayshaun.Prince1.22.94.02004-132.71.4
Rolando.Blackman3.12.52.31984-932.60.4
Mark.Aguirre3.33.11.41983-922.61.0
Wes.Unseld1.72.04.11970-792.61.3
Pau.Gasol2.23.02.52006-152.60.4
Tom.Chambers1.93.32.31986-952.50.7
Mark.Olberding1.53.03.01978-872.50.8
Mark.Eaton1.12.34.01983-922.51.4
Ray.Allen1.02.14.41997-062.51.8
Dick.Barnett2.52.92.01963-722.50.5
Paul.Millsap2.42.62.12007-162.40.3
Joe.Johnson2.83.11.22003-122.41.0
Walt.Frazier4.22.00.81968-772.31.8
Manu.Ginobili2.72.41.92006-152.30.4
Tom.Meschery2.22.12.71962-712.30.4
Jason.Terry2.62.51.92002-112.30.4
Hedo.Turkoglu2.92.71.32002-112.30.9
Buck.Williams1.72.62.51985-942.30.5
Shawn.Marion2.72.51.52002-112.20.6
Kevin.McHale3.32.50.91981-902.21.2
Andre.Miller1.82.52.42005-142.20.3
Dwyane.Wade2.02.12.52005-142.20.3
James.Worthy3.32.30.81985-942.21.3
Mark.Jackson2.52.71.21993-022.20.8
Walt.Bellamy2.72.61.01965-742.11.0
Allen.Iverson1.61.82.61999-082.00.5
Mike.Gminski3.42.7-0.21983-921.91.9
Michael.Cooper0.20.74.81981-901.92.5
James.Donaldson2.82.30.31981-901.81.3
Cedric.Maxwell1.72.31.41978-871.80.4
Byron.Scott1.42.31.61985-941.80.4
Sam.Perkins1.01.23.21991-001.81.2
Bo.Outlaw1.82.41.11995-041.80.7
Rick.Mahorn1.22.21.71982-911.70.5
Dave.Cowens1.50.92.61971-801.70.9
George.Gervin1.92.90.01977-861.61.5
Dominique.Wilkins1.12.41.41984-931.60.7
Johnny.Davis2.00.72.11977-861.60.8
Boris.Diaw1.82.50.52005-141.61.0
Brad.Davis1.22.70.81982-911.61.0
Eddie.Johnson1.61.31.81983-921.60.3
Sam.Mitchell1.51.51.61990-991.50.0
Dave.Corzine1.70.52.11979-881.40.9
Johnny.Newman1.11.21.81988-971.40.4
Joe.Dumars1.20.91.81986-951.30.5
Terry.Porter2.31.20.51987-961.30.9
Jeff.Malone0.91.71.41985-941.30.4
Fred.Brown2.01.30.41974-831.30.8
Mychal.Thompson1.62.4-0.21982-911.21.4
Truck.Robinson2.12.3-0.71975-841.21.7
Nick.Collison1.51.60.62005-141.20.6
Armen.Gilliam2.71.2-0.21989-981.21.5
Mark.West2.11.8-0.21986-951.21.3
Maurice.Cheeks0.90.81.91980-891.20.6
Vinnie.Johnson-0.41.32.61982-911.21.5
Jason.Richardson0.81.61.02002-111.10.4
Dave.Bing1.71.6-0.21967-761.01.1
LaSalle.Thompson1.10.80.71983-920.90.2
Dale.Ellis1.60.80.01989-980.80.8
Xavier.McDaniel1.81.6-1.01986-950.81.6
Danny.Schayes0.90.60.71982-910.70.2
George.Johnson0.6-1.12.61973-820.71.9
Mike.Woodson0.05.7-3.71981-900.74.7
Antawn.Jamison1.00.50.32000-090.60.4
Josh.Smith0.50.80.32006-150.50.2
Jamaal.Wilkes0.72.7-2.21975-840.42.5
Sleepy.Floyd0.40.8-0.21983-920.30.5
Tyrone.Corbin0.40.8-0.51987-960.20.7
Jarrett.Jack1.20.3-1.02006-150.21.1
Thurl.Bailey-0.4-0.10.81984-930.10.6
Derek.Harper0.20.3-0.21988-970.10.3
Michael.Cage-1.00.40.71988-970.10.9
Jo.Jo.White2.31.5-3.91971-80-0.13.4
Mike.Mitchell-1.1-0.51.31979-88-0.11.3
Earl.Watson0.90.0-1.22002-11-0.11.0
Reggie.Theus-1.3-0.11.11981-90-0.11.2
Rodney.McCray0.5-0.1-1.01984-93-0.20.7
Lenny.Wilkens0.0-2.11.21963-72-0.31.7
Mickey.Johnson-0.8-1.60.01976-85-0.80.8
Jerry.Lucas-0.0-0.1-2.21965-74-0.81.2
Vern.Fleming-0.0-0.9-1.51985-94-0.80.7
Terry.Tyler0.60.5-3.71979-88-0.92.4
Rory.Sparrow-1.2-0.4-1.01982-91-0.90.4
Antoine.Walker-0.90.3-2.01998-07-0.91.1
Rickey.Green0.70.7-4.21982-91-0.92.8
Olden.Polynice-1.0-0.4-1.51988-97-1.00.5
Chuck.Person-0.7-0.3-2.21987-96-1.11.0
Junior.Bridgeman-0.2-0.7-3.21976-85-1.41.6
Jay.Humphries-2.2-1.7-1.51985-94-1.80.4
Allan.Houston-0.5-0.7-4.21994-03-1.82.1

Takeaways

Because this lacks the granularity of play-by-play data, more interpretation is required per player. For instance, guys like Stockton and Malone suffer from small-sampled collinearity; based largely on the 18 games Stockton missed to start the 1998 season, the models have no choice but to solve for the two of them by giving Stockton a larger share of credit. (Utah improved in its final 64 games that year.) Meanwhile, Bird has lots of instability in his result because of Reggie Lewis; in the 1955-84 set from Part II of this series, Bird was first among all players based on his first five seasons.

Next, although Zach’s GPM doesn’t have this problem — he scaled the results of each 10-year run — WOWYR does not account for varying point differentials over the years . So someone like Bill Russell requires an upward mental adjustment, while Wilt Chamberlain’s WOWYR scores are inflated a touch compared to Russell’s because of the early ’70s expansion. GPM is the only regression above that accounts for era differences, and it peaks Wilt from 1960-69, slotting him behind Jerry West and Oscar Robertson.

About half of the MVP Shares in history belong to the first 22 players in the above table. John Havlicek, one of a few non-MVPs in the top 20, is likely aided by the collapse of Charlie Scott and premature demise of Dave Cowens. Still, his results are impressive. Paul Pierce’s are too, although his number is likely inflated by the models having no way to account for the true “replacement level” quality of Kevin Garnett’s teammates in Minnesota. And — scoring blindness alert! — I think we’ve all underestimated Dikembe Mutombo, who looks quite good in non-box metrics.

Then there are the decorated players who struggle in these regressions. Dwyane Wade’s disappointing number is likely the result of two injury-plagued seasons dragging down his value, along with two more years in physical decline. Allen Iverson, echoing his play-by-play numbers,  shows no evidence of playing at an MVP level. George Gervin, dampened by a few post prime years, posts a small value given his five consecutive top-six MVP finishes.

There are still future tweaks that can be made to these models. However, they will always have certain limitations, and at this point I’m confident in saying that there’s not too much mileage left from them. These results paint a fuzzy picture for some players, and compelling arguments for others. Even for players with strong signals, the precision of the models should not be overlooked; they are not for declaring that a player was exactly 1.2 points more valuable than a contemporary. However, for most players across NBA history, they provide a fairly accurate approximation of value.