Last year, this predictor was more accurate than all but one of the constituent mock drafts. In this episode, I discuss where the top quarterbacks go in the first round, who will take Saquon Barkley and possible improvements to the model.
You can check out the complete predictions for the 2018 NFL Draft by wisdom of crowds.
To listen on iTunes, click here.
To listen here, click on the right pointing triangle.
Galton became interested in this crowd based estimate. Initially, he didn’t think taking an average guess would lead to an accurate estimate of weight. Galton didn’t have a high opinion of people, as he believed only certain people had the traits to keep societies healthy.
However, his curiosity got the best of him. Most likely by pencil and paper, he calculated the average guess of the crowd: the ox weighed 1197 pounds. The actual ox weighed 1198 pounds.
The wisdom of crowds is powerful. In sports, we see many examples of this, from the betting markets to the surprising accuracy of the preseason college basketball polls.
Here, we apply the wisdom of crowds to the 2018 NFL draft.
Aggregating data from mock drafts
A wisdom of crowds prediction for the NFL draft comes from combining the data from multiple mock drafts. For each mock draft, a player gets 32 points for being projected first, 31 points for second, and so on down to 1 point for the final pick of the first round.
Players get ranked based on total points, and this rank becames his predicted spot in the draft. In 2017, this wisdom of crowds model performed better than all but one of the constituent mock drafts.
The wisdom of crowds model isn’t perfect. It doesn’t consider the specific needs of a team, like a Denver franchise in need of a quarterback. I address this issue on a team by team basis in the predictions below.
However, the wisdom of crowds should be better than any mock draft at predicting a player’s relative draft position. For example, when will Louisville QB Lamar Jackson get picked compared to the 4 quarterbacks in front of him?
Let’s look at the wisdom of crowds predictions based on 25 mock drafts for 2018.
1. Cleveland, Sam Darnold, QB
After a harrowing year with Deshone Kizer at QB, the Browns will almost certainly take a QB with the top pick.
More mock drafts have Josh Allen at first (13) than Sam Darnold (11). However, Darnold didn’t slip below 5th in any mock draft, which makes him first by total points.
2. New York Giants, Saquon Barkley, RB
“This whole myth of devaluing running backs, I find it kind of comical.” said Giants GM Dave Gettleman recently. He hasn’t absorbed how data values passing significantly more than rushing in the NFL, which you can read about in my manifesto.
QB Eli Manning is old and not very good. However, 16 of 25 mock drafts have the Giants taking Barkley with the second pick.
3. New York Jets, Josh Allen, QB
In 2017, Josh Allen completed 56% of his passes compared to the 60% college football average. His Wyoming offense finished 127th out of 130 teams in my yards per play adjusted for strength of schedule. No matter where Allen gets drafted, I expect him to be the biggest QB bust since JaMarcus Russell.
This third spot is tricky one for wisdom of crowds. The 25 mock drafts all had the Jets taking a QB, but none of them predicted Allen. Baker Mayfield went to the Jets in 10 mock drafts, while Josh Rosen and Sam Darnold were taken in 9 and 6 mock drafts respectively.
4. Cleveland, Bradley Chubb, DE
Chubb has averaged 10 sacks and 22 tackles for loss the past two seasons at North Carolina State. He would be an excellent addition to any defense.
5. Denver, Quenton Nelson, G
Nelson was part of a Notre Dame offensive line that powered the second best rush offense by my yards per carry adjusted for schedule in 2017.
Denver may also go for a QB here, as projected starter Case Keenum might not be able to replicate his excellent 2017 season. 9 of 25 mock drafts had the Broncos taking Josh Allen at this spot.
6. Indianapolis, Baker Mayfield, QB
Five years from now, I expect Baker Mayfield to be the best QB from this draft. Over the past two seasons, he led Oklahoma to the best offense by my adjusted yards per play by a wide margin.
However, Indianapolis has Andrew Luck, so they won’t take Mayfield at this slot. Nelson (11) and Chubb (8) come up most for the Colts with the 6th pick.
7. Tampa Bay, Josh Rosen, QB
Rosen completed 63% of his passes in 2017 in leading the 12th ranked pass offense by my adjusted yards per attempt. In addition, he started every game for UCLA that he wasn’t hurt since the beginning of his freshman year. This gives me some confidence he can play in the NFL, much more so than Allen.
With Jameis Winston, Tampa Bay doesn’t need a QB. Derwin James (10) and Minkah Fitzpatrick (8) show up most at this spot in the mock drafts.
8. Chicago, Roquan Smith, LB
Smith accumulated 6.5 sacks and 14 tackles for loss on a Georgia defense that excelled in 2017. The Bulldogs ranked 3rd in my adjusted yards per play.
9. San Francisco, Denzel Ward, CB
5 cornerbacks were taken in the first round of last year’s draft. Only two are projected for this season, and the wisdom of crowds likes Ward the best.
San Francisco signed CB Richard Sherman this off season, so Roquan Smith and Tremaine Edmunds are other possibilities here.
10. Oakland, Minkah Fitzpatrick, S
Oakland’s pass defense has ranked 29th and 32nd the past two seasons in my adjusted yards per attempt. They can use any and all help, so expected Fitzpatrick or Ward to go here.
11. Miami, Tremaine Edmunds, LB
Edmunds had 10 sacks and 30.5 tackles for loss the past two seasons at Virginia Tech. Miami also might take a QB here if Mayfield or Rosen fall this far.
12. Buffalo, Derwin James, S
Florida State had an awful season after QB Deondre Francois went down. However, the defense was solid at 6th in my adjusted yards per play, and James played a key role.
Buffalo may also take a QB here if Rosen or Mayfield drop this far.
13. Washington, Vita Vea, DT
Vea is 6’5″, 340 pounds. That should help the Redskins defense, and 11 of 25 mock drafts have Vea in this spot.
14. Green Bay, Marcus Davenport, DE
At UTSA, Davenport had 8.5 sacks and 17.5 tackles for loss. The Packers need help on defense, so Davenport makes sense. However, just as many mock drafts had CB Joshua Jackson (6) at this spot as Davenport.
15. Arizona, Calvin Ridley, WR
Ridley caught fewer balls in each successive season at Alabama. However, he did average 15.3 yards per reception in 2017. While 6 mock drafts had Ridley to the Cardinals, the same number had QB Lamar Jackson at this spot.
16. Baltimore, Mike McGlinchey, OT
McGlinchey was part of a Notre Dame offensive line that powered the second best rush offense by my adjusted yards per carry in 2017. Baltimore might also go for Calvin Ridley here, as Joe Flacco led the worst pass offense by my adjusted yards per attempt in 2017.
17. Los Angeles Chargers, Joshua Jackson, CB
The Chargers had a surprisingly good pass defense in 2017 (5th in my adjusted yards per attempt), so they probably don’t take a cornerback. The mock drafts think the Chargers need help at defensive tackle, as 10 and 7 drafts picked Da’Ron Payne and Vita Vea respectively.
18. Seattle, Da’Ron Payne, DT
Alabama’s defense ranked 1st in my adjusted yards per play in the 3 years with Payne as the anchor on the line. He’s smaller than Vea (305 pounds), but still looks like a solid first round pick.
In the 25 mock drafts, 13 different players were picked here. Seattle may settle on any of a number of players at this 18th spot.
19. Dallas, Lamar Jackson, QB
Jackson increased his completion percentage the past two season, but it topped out at 59% in 2017 (60% college football average). We’ll see if he continues to develop in the NFL.
Dallas has their QB, at least for now, in Dak Prescott. The mock drafts like the Cowboys to pick a wide receiver at 19th. The primary candidates are DJ Moore (7), Courtland Sutton (7) and Calvin Ridley (6) if he drops this far.
20. Detroit, Harold Landry, DE
Landry posted an outstanding 16.5 sacks and 22 tackles for loss as a junior in 2016. He numbers slipped last season because of an ankle injury, but he could help the pass rush of the Lions.
8 of 25 mock drafts had Landry in this spot, well ahead of Davenport at 4.
21. Cincinnati, DJ Moore, WR
The Bengals need help on the offensive line. 9 mock drafts had Iowa’s James Daniels here, and another 11 had other offensive linemen.
22. Buffalo, Leighton Vander Esch, LB
Vander Esch had 141 tackles on a solid Boise State defense that ranked 21st in my adjusted yards per play. He seems like a good fit for Buffalo as 6 mock drafts picked him here.
23. New England, James Daniels, C
Daniels might not be here as Cincinnati picks two spots before New England. And it’s amusing that the 25 mock drafts has 12 different players in this spot, none of which were Daniels.
24. Carolina, Rashaan Evans, LB
Can’t go wrong with a Alabama player on defense, right? Evans had 6 sacks and an additional 7 tackles for loss in 2017.
The mocks drafts had 14 different players at this spot, none of which were Evans. Carolina won’t take a QB, but otherwise expect a surprise at 24th.
25. Tennessee, Courtland Sutton, WR
The mock drafts like the Titans to pick a pass rusher here. Harold Landry (6) and Sam Hubbard (5), a DE from Ohio State, had the most votes.
26. Atlanta, Will Hernandez, G
On a recent episode of The Football Analytics Show, NFL Network analytics expert Cynthia Frelund said to watch out for Hernandez, the lineman from an awful UTEP team. However, Atlanta most likely goes after Taven Bryan to bolster their defensive line (15 of 25 mock drafts).
27. New Orleans, Jaire Alexander, CB
The mock draft think the Saints draft a tight end. Hayden Hurst from South Carolina (7), Dallas Goedert from South Dakota State (5) and Mike Gesicki from Penn State (2) are the most likely picks.
28. Pittsburgh, Taven Bryan, DT
Bryan most likely goes to Atlanta two spots before Pittsburgh. But in this model, he slips to 28th since he’s not a first rounder in 5 of 25 mock drafts.
10 mock drafts like the Steelers to take Rashaan Evans, as they have a depleted linebacking corp without Ryan Shazier.
29. Jacksonville, Isaiah Wynn, G
In 2016, Georgia struggled under first year head coach Kirby Smart. They ranked 44th in rush offense by my adjusted yards per carry.
Something clicked in 2017, and Georgia shot up to 7th in rush offense. Wynn now most likely goes in the first round.
30. Minnesota, Kolton Miller, OT
The Vikings just spent a ton of money on QB Kirk Cousins, so it makes sense to protect that investment with a lineman. Wynn and Hernandez are also candidates here if they drop this far.
31. New England, Mike Hughes, CB
The Patriots could use a cornerback with the strange benching in the Super Bowl and subsequent departure of Malcolm Butler. 10 mock drafts also have tackle Kolton Miller here.
32. Philadelphia, Connor Williams, OT
The 25 mock drafts had 16 different players here. The defending Super Bowl champions take the best player available.
If a mock draft predicted a player to go first, the player earned 32 points. If a mock draft predicted a player to go second, the player earned 31 points, and so on down to 1 point for the last pick of the first round.
The players got ranked by points to make the wisdom of crowds prediction. You can get the full list of predictions here.
How did the wisdom of crowds predictor do compared to the individual mock drafts?
Error for each NFL draft prediction
To evaluate each draft predictor, I evaluated the distance from predicted to actual draft spot for each player. For example, Mitch Trubisky went 2nd in the draft, so the wisdom of crowds prediction of 8th has a distance of 6. Jonathan Allen went 17th despite a prediction of 3rd, which gives a still positive distance of 14. The total distance for all 32 predicted players gives an error for a draft prediction.
I tracked each player compared to his actual draft slot for the first two rounds. In a few cases, a predicted player got drafted outside these top two rounds. To evaluate the distance, I assigned draft slot of 65 (first pick of the third round), plus a penalty of 3. Only 7 of the mock drafts had a prediction outside the first two rounds, and they are denoted by a * in the list below.
Here are how the 15 mock drafts stacked up compared to wisdom of crowds.
1. Sporting News, 222
2. The Power Rank Wisdom of Crowds, 239
3. Todd McShay, 249
4. CBS, 259*
5. Daniel Jeremiah, 263
6. Mel Kiper, 265
7. Drafttek, 266*
8. Lance Zierlein, 277
9. Charlie Campbell, 290
10. Sports Illustrated, 291*
11. SB Nation, 295
12. Fox, 306
13. Newsday, 310*
14. Cris Collinsworth, 344*
15. Walter Cherepinsky, 405*
16. Pro Football Focus, 431*
I took this data on April 19, 2017. The predictions may have changed for some of these mock drafts as authors made updates before the first round of the NFL draft on April 27, 2017.
The wisdom of crowds predictor did better than any constituent mock draft except for one: Vinnie Iyer at Sporting News.
In future years, I plan to use the full draft to evaluate the mock drafts, not only the first two rounds with an arbitrary penalty for picking a player outside of these rounds. In most cases, this better method would make the error larger for the mock drafts with a *.
On this pre-draft episode, Chase Stuart, founder of Football Perspective and 2017 panelist at the Sloan Sports Analytics Conference, joins me to talk about the NFL draft. Among other topics, we discuss the following:
- The story behind his ubiquitous NFL draft trade value calculator
- How to use Approximate Value to access every player, even offensive linemen and defensive backs
- The reason an NFL GM might use the Jimmy Johnson draft value chart instead of his analytics based chart
- The surprising admission of the Patriots on why they traded for Brandin Cooks
- Why Chase writes every day at his site Football Perspective
After the interview, I talk about 3 highlights of my wisdom of crowds model for predicting the 2017 NFL Draft.
To listen on iTunes, click here.
To listen on the site, click on the right pointing triangle.