When Is The Best Time To Grade A Draft?

It’s no secret that the bulk of the rebuilding process by the Pittsburgh Pirates has been primarily focused on the MLB draft. The Pirates have spent more than any other team in the majors over the last four years, including a single season record in 2011. In the process of spending this money, they’ve gone with a lot of over-slot deals. To be exact, the Pirates have had 26 over-slot deals from 2008-2011, an average of almost seven per year.

There is an expected amount of pressure involved for the drafts to produce major league talent. Those expectations are raised when a team is using the draft as one of their primary means for rebuilding. Add in the fact that the Pirates have spent more than any other team in the draft, and expectations go through the roof.

Those expectations might be warranted, but they also bring impatience. People want to see immediate results. That makes sense, as they want to know that the draft is actually producing results. Charlie at Bucs Dugout pointed this out when talking about how 2012 should be a crucial year for Neal Huntington. Charlie called the drafts underwhelming so far, with the disclaimer that it is too early to judge the drafts conclusively.

So when is a good time to judge the drafts conclusively? I’ve always felt that grading a draft is an on-going process. Too often the tendency is to put a final grade on the draft, and that final grade is suggested way too soon. For example, many are calling the 2008 draft a bad one. That’s mostly due to the struggles from Pedro Alvarez in the majors. It’s also due to the fact that after three full seasons, the draft hasn’t produced anyone at the major league level.

These types of assessments are often thrown out with the assumption that this isn’t normal. The assumption is that the Pirates should have at least one player from the 2008 draft performing at the major league level by now, if not more. But that assumption isn’t correct. As of the end of the 2011 season, only eight players from the entire 2008 draft class have produced a career 2.0 WAR or better, according to Baseball-Reference. That just shows that it’s too early to be expecting any team to have a player in the majors at this point, especially guys after the first round.

Alvarez has been disappointing in his first year and a half in the majors.

You could make the argument that Pedro Alvarez should be one of those eight players, and I’d say you’re right. Alvarez was drafted with the expectations that he would be up by now, and would be producing at the same rate as someone like Buster Posey. But it’s even too early to give a final grade to Alvarez. All you have to do is look at the struggles of fellow first round picks like Brian Matusz, Justin Smoak, and Brett Wallace to see this. I’m sure there’s a lot of Pirates fans who would gladly have the upside and potential of these players, even with their initial struggles.

Grading a draft should be an on-going process, but how do you grade the draft throughout that process? At what point do you focus more on results, and less on tools and potential? How do you factor a bad year by an individual player in the equation? What are the expectations for players out of high school in their first few years? Most importantly to the above discussion, at what point can you grade the General Manager on the draft? Everyone has a different method of evaluating moves, so I wouldn’t expect any consensus on how to grade a draft. Here is how I look at things.

Grading Prep Players

Since the Pirates have focused so much on prep players, I figure this is a good place to start. I’ve mentioned my process for grading prep players a lot in the past. I don’t care what happens with prep players until their third year as a pro. With college players we don’t care what they did in their freshman and sophomore years. We only start paying attention when they’re about to be drafted. So why punish prep players for learning in the pros, rather than learning at college?

We saw this in 2011 with Robbie Grossman. Grossman was completely over-matched in 2009, which would have been his freshman year in Texas. He struck out 36% of the time at low-A in 451 at-bats. He improved on those strikeout numbers in 2010 at high-A, with a 25% strikeout rate in what would have been his sophomore year in college. Even with the improvement, the results weren’t encouraging. Then in 2011, in what would have been his junior year, he had a breakout season. That season likely would have made him a first round pick. He wouldn’t have played in high-A until the first half of the 2012 season. So in hindsight, it would have seemed silly to write him off after struggles in what would have been his freshman and sophomore years.

Now there are exceptions to this rule, as there are with any rule. If Jameson Taillon would have come out with a 5.00 ERA and a ton of control problems, that would have been a disappointment. Taillon was advertised as being more polished than the normal high school pitching prospect, so he can’t be graded like the other prep pitchers. Josh Bell was graded as a strong hitter, so if he struggles in 2012 like Grossman did in 2009, it would be disappointing. But for the average guy out of high school, I don’t focus on the results until year three.

Last year I focused on the 2008 draft class. We saw good things from Robbie Grossman. Wes Freeman had a great second half, although he needs to be on the fast track from this point forward. Jarek Cunningham continued to show power from the middle infield, although his strikeout and walk ratios are still a concern. Quinton Miller continued his trend of injuries and poor performance, and while he’s got a lively fastball, he’s to the point where we need to start taking his poor numbers seriously, rather than looking at his potential and dismissing the numbers.

On that same note, the 2012 season for me is all about the 2009 draft class. The key guys here are Zack Dodson, Zack Von Rosenberg, Colton Cain, and Trent Stevenson. We’ve seen mixed results from these guys. Dodson showed some nice improvements in 2011, but was injured for half the season. Von Rosenberg really struggled, then improved his numbers in the second half when he started using his curveball more often. Cain put up strong numbers in 2011, but lacked consistency with his stuff throughout the year, an issue that might be fatigue related. Stevenson has been very disappointing so far, and is far behind the other three.

The 2009 class might be more important than most because of the approach the Pirates took. The Pirates passed on the highly ranked prep pitchers in the first round to take Tony Sanchez, so that they could go over-slot in the later rounds. They ended up going over-slot on the above prep pitchers, as well as 10th round catcher Joey Schoenfeld (who has since been released), 12th round college junior Jeff Inman, and 34th round JuCo lefty Zac Fuesser.

The decision to go with Sanchez and the prep pitchers looks bad if you’re using the benefit of hindsight. People will point to Shelby Miller and Jacob Turner being at the top of the prospect rankings right now, although at the time there was no such clarity with the group of available prep pitchers. Miller and Turner didn’t stand out much from guys like Zack Wheeler, Tyler Matzek, or Matt Purke. Only Wheeler, Turner, and Miller ended up on MLB.com’s recent top 100 prospects ranking, with Miller and Turner ending up in the top 15. My choice prior to the draft was Turner, who was taken 9th overall by Detroit.

Sanchez had a down year in 2011, which makes the set of moves look worse. The lack of a breakout player from the prep group doesn’t help, although I’m not looking for that to happen until this year. The best of the group might be Cain, who looks like a strong number three who can pitch 200 innings a year. He also seems to be the safest bet, with a higher floor than the other guys in his class. Von Rosenberg and Dodson both have talent, but both have questions to answer before they can make that jump to top prospect status. Like Grossman and Miller in 2011, the 2012 season could be a make or break year for these three pitchers.

As for the prep players from the 2010 and 2011 classes, any early success is a bonus. I rated 2010 prep right hander Nick Kingham high, although that was more a result of his strong three pitch mix, rather than his good results in State College. Ryan Hafner had good results, but could run in to the same problems as Von Rosenberg in West Virginia if he doesn’t keep the ball down. But I’m not heavily grading the numbers of those guys until 2013 for the 2010 group, and 2014 for the 2011 group.

Grading the College Players

The Pirates, and most teams, tend to start their college players in A-ball. I don’t put much stock in the numbers until the AA level, unless the players are struggling. If a player comes out of college and struggles in high-A — which is similar, talent-wise, to division I baseball — then that doesn’t speak well of the player. Due to that similarity to college ball, strong results in high-A aren’t as impressive.

The jump to the AA level is the hardest for hitters, and is something I focus on for all players, not just those out of college. If a player struggles with that jump I won’t totally write him off, although he has to have something in his numbers or skill set to redeem himself. With Chase d’Arnaud in 2010 and Tony Sanchez in 2011, I looked at the strikeout to walk ratios. Both players had good ratios, which showed that they weren’t over-matched, despite the poor results. On the flip side, a player could put up good numbers, but I might not buy those numbers as legit. I tend to grade first basemen harder than any position, since so much of the value is based on offense. So if a first baseman isn’t putting up huge numbers, I’d be unlikely to grade him with high marks.

If a high school player struggles two years in a row, I’ll probably forgive it. If a college player struggles two years in a row, I’ll probably move closer to writing him off. I mentioned above that only eight players from the 2008 draft class have put up a 2.0 or better career WAR in the majors. However, by the end of the 2012 season I’d expect 2008 college guys like Chase d’Arnaud, Jordy Mercer, Matt Hague, and Justin Wilson to give some indication on whether they’ll be productive major leaguers. I don’t really care that d’Arnaud had a .528 OPS in 2011, but if he does the same in the majors in 2012 it will pretty much signal that he won’t be a productive major leaguer.

I give d’Arnaud the 2011 pass because guys like Wilson, Hague, and Mercer haven’t even reached the majors. Why punish d’Arnaud for struggling in the majors while rewarding the other guys for their AAA numbers at the same point in the timeline? The flip side is that I’d expect those three to reach the majors in 2012 and have immediate success. I don’t mind a college player going a level a year, as long as the trade off is immediate success in the majors. The guys from the 2008 class are entering ages 24-26. If they’re not going to do it now, they’re probably not going to do it.

Defense

I mentioned above that I grade the numbers for first basemen harder than I do with other players. On the flip side, if a player plays an important defensive position like catcher, shortstop, or center field, and plays the position well, I’ll give them a pass if they struggle on offense for a year. Of course the player has to be good on defense to get this pass. Basically, I look at both sides of the game, and not just what the limited numbers tell us.

Reasonable Expectations

A lot of expectations from the draft are based on what people feel should be happening, and not what is actually happening. Fans tend to only focus on one team. Maybe they’ll scratch the surface of other teams by looking at system rankings or a top ten list, but that still makes it hard to have reasonable expectations. I try to keep my expectations calculated. I’d rather do the research and see what other teams are doing, rather than assuming what other teams are doing and comparing the Pirates to those assumptions.

A big complaint about the draft is often in the form of “there have been four drafts, and what do the Pirates have to show for it?” The underlying expectation is that the Pirates should have at least one productive player in the majors, if not more. Given the high draft positions, the Pirates should have at least one by this point. One of Pedro Alvarez or Tony Sanchez should be in the majors, living up to expectations by now, since they were highly rated out of college. That’s not enough to write either player off, but it is disappointing. Outside of those two, there’s still the expectation that the Pirates should have someone from the middle rounds already in the majors, and already established.

As shown above, that’s not realistic. Only eight players from the 2008 draft class have made the majors and put up a 2.0 career WAR. There have only been five players from the 2009 draft class who have a career 2.0 WAR or better in the majors, and all of those players were taken in the first 12 picks of the draft. The 2010 draft class just finished their first full year in the pros. Only one player from that draft has a 2.0 WAR or better, and that’s reliever Chris Sale. And the 2011 guys were just drafted, so no one should expect major league results from them yet.

In the last four drafts, only 14 players have put up a career WAR of 2.0 or better. To expect the Pirates to have several players having success in the majors from their draft efforts isn’t reasonable when looking at the actual results.

When to Grade the Drafts?

As I mentioned earlier, I feel you can always grade drafts, from the moment the draft finishes to ten years down the line. Two years ago it looked like the 2007 Pirates draft wouldn’t have a single player making the majors outside of Daniel Moskos, who projected as a lefty reliever. Now we could be looking at two left handed relievers (Moskos, Tony Watson), a right handed reliever (Duke Welker), and a number three starter (Kyle McPherson). The 2004 draft looked like a total bust until Neil Walker broke out at the start of the 2010 season and made the successful switch to second base. These would still be disappointing drafts, but they go to show that a draft can’t be graded after 2-3 years.

So when is the right time to start grading the draft with the idea of also grading the people who are conducting the drafts? The biggest impact to Neal Huntington’s grade right now would be Alvarez and Sanchez, since they were both taken out of college and have spent more time in the system than guys like Gerrit Cole or Jameson Taillon.

The 2008 draft was heavy with college players, and like I mentioned above, the 2012 season will be make or break for those guys in the majors. However, the 2009 draft was heavy with high school players. I wouldn’t expect those guys to start cracking the majors until 2013-2014. There would be 2-3 drafts before we started seeing the major league impact from guys like Colton Cain, Zack Von Rosenberg, and Zack Dodson. That’s only the second draft Huntington performed, which is a big risk to take in the 2012-2014 drafts if you can’t have a definitive conclusion.

I think there’s definitely a time where it’s too early to grade a draft. I don’t think a true final grade could be established until years later. But that doesn’t mean there’s no middle ground. My approach is to combine the above factors. I hold off on the results from prep players until year three. I don’t put a lot of stock in to college numbers until they put those numbers up at the AA level or higher. I expect more from those where defense doesn’t matter, and I’m more likely to give a pass to someone who plays good defense at a hard position. Most importantly, I try to keep things in perspective with what other teams are actually doing.

So how do I feel the Pirates grade out? There’s definitely a lot of talent in the system, and the Pirates have a lot of guys who are in line with my expectations for a player out of high school or college. Right now I like the status of the system. That grade is very fluid though. If the 2012 season has guys like d’Arnaud, Mercer, Hague, and Wilson busting at the major league level, and 2009 prep guys like Von Rosenberg, Dodson, and Cain struggling, that wouldn’t speak well for the system. In fact, that scenario probably wouldn’t warrant any future drafts for the current group. The alternative wouldn’t provide any conclusive results, but if a few of the 2008 college guys have success in the majors and the 2009 prep guys have strong years in 2012, then it would speak well about the grades from the first two drafts. So in that sense, I think 2012 is a very important year for Neal Huntington’s future.

Tim Williams

Author: Tim Williams

Tim is the owner and editor in chief of Pirates Prospects. He started the site in January 2009, and turned it into his full time job during the 2011 season. Prior to starting Pirates Prospects, Tim worked with AccuScore.com, providing MLB, NHL, and NFL coverage to various national media outlets, including ESPN Insider, USA Today, Yahoo Sports, and the Wall Street Journal. He also writes the annual Prospect Guide, which is sold through the site. Tim lives in Bradenton, where he provides live coverage all year of Spring Training, mini camp, instructs, the Bradenton Marauders, and the GCL Pirates.

Share This Post On
  • Anonymous

    Good read and agree with most points.  I still don’t think it unreasonable to expect the Pirates to have a productive player in the majors from those four years.  Your analysis does not consider where the Pirates are selecting in the draft which is almost always the top third.  Maybe those 14 players didn’t come from the top third – that would surprise me.

    Just think for a FO that has made such a big deal about building through the draft, not sure it unreasonable to expect better.  Maybe we need to reevalute whether it makes sense to draft all those prep pitchers – the LEAST likely players to make it to the majors.

    • http://www.piratesprospects.com Tim Williams

      I pointed this out in the article when I mentioned that it would be reasonable to expect Alvarez or Sanchez to be productive, considering that they came out of college and were taken with high picks.

      • Anonymous

        You did. My bad.

        • http://pulse.yahoo.com/_AGRPLJJRC5GNBYXDY6LHF2U6DU white angus

          also, I believe the average time spent in the minors before a player “sticks” in the big leagues is around 5 to 6 years. 

          just thought I would throw that one in.

    • http://www.facebook.com/profile.php?id=1483937936 Alicia Rothermund

      In response to your comment about prep pitching,

      While it’s true they have the lowest succession rate, it’s necessary to invest in young arms like that when pitching is the real currency in the game.  It’s the most difficult thing to procure for a team like the Pirates.  Legitimate #1 or 2 starters are simply not an option in free agency for them.  So it’s necessary to cultivate these guys if they ever expect to have a front of the line rotation.  The dream rotation one of these days seems to be Cole, Taillon, and Heredia in the top 3 spots.  So realistically, all they’re looking for is just a handful of the other prep pitchers to work out in order to sure up the rotation or to serve as trade bait.  However, that’s not to say they wouldn’t just as soon have one or more of these guys taking a big step forward this year or next and show some real upside.

      • Lee Young

        I agree with everything you wrote, except for the word ‘succession’. Leave off the ‘ion’ and I am in TOTAL agreement. lol

    • Lee Young

      Alvarez, yes, Sanchez, no. Mainly because Sanchez was drafted way too high. But, that’s ok if those pitchers pan out.

      Overall, very well written article. Enjoyed it greatly.

  • http://www.facebook.com/people/Andrew-Smalley/100001279428589 Andrew Smalley

    Great article, TW.  I’m glad the voice of reason within the Pirate-blogging community spoke on such an important issue.  Bucs Dugout was Smikikian in its essential conclusion:  ”The Pirate drafts have been bad thus far…….even though it’s too early to say whether they’ve been bad thus far.”  The old, classic nonsensical position…..

    • http://www.piratesprospects.com Tim Williams

      I linked to Charlie’s post, but this wasn’t really a response to Charlie’s post. Charlie isn’t the only person who has suggested the drafts have been underwhelming thus far. In fact, the same thing was said last week in a conversation I was having about the state of the farm system. That’s when I started working on this article. I’ve actually heard the draft argument several times in the last week. Charlie just happened to be the latest to make the suggestion, which caused me to move this article up a day.

    • Lee Young

      I’m not sure it was Smizikian ( a new word?) and I actually enjoyed it. It is always good to get two, well thought out, opposing views to chew on. I happen to agree with Tim’s viewpoint, but I am not gonna diss Charlie’s.

  • Anonymous

    While all prospects don’t advance in a straight line, and it is too early to conclude the Pirate drafts have been bad, it isn’t too early to say they don’t look good.  A draft can be evaluated annually and the assessment of whether its good or bad can change based upon injuries and player performance.

    At one time it must have looked like Gary Redus was going to be better than Ted Williams (how many players hit 462?) but he can down to earth pretty quickly after that.  Still it would be nice if more of the players the Bucs are counting on put up better numbers in the minors in relation to the numbers being put up prospects on other teams.  The Pirates need to have prospects at all levels that are considered some of the best prospects in their leagues. IMO there haven’t been enough of them.

    • Lee Young

      I do agree with TIm in that it IS hard to get excited about them until they hit Altoona.

      • Anonymous

        
        I am out of the office Tuesday January 31. I’ll respond to your message when I return on February 1.

        Ron Leighton

  • Anonymous

    If Alvarez is mashing and Sanchez is in AAA doing ok this isnt even a topic. Great read tim

    • http://pulse.yahoo.com/_46YTB5OO4O7UM2OVB44UZSTXNA Nate

      Totally agree.  If those two even had average years last year, not nearly as many people would be having anxiety attacks over the state of the system.  Sooooo many fans have no patience/perspective with players in the minors.  They all forget it took ACutch 4 yrs and Walker 5+yrs.

      • http://pulse.yahoo.com/_AGRPLJJRC5GNBYXDY6LHF2U6DU white angus

        yep, I referenced the timeline in a post above.  the average players spends about 5 plus years in the minors before he “sticks”, and thats only the ones who actually stay up.  vast majority dont.

    • Anonymous

      +1.

      The most tiring aspect of this offseason has been the relentless “woe are us, we haven’t done enough and all the minor leaguers suck” talk.  

      If Pedro hits, the major league team will break .500.  If Sanchez plays like he did before breaking his jaw, he’ll be a top prospect again.

  • http://twitter.com/jlease717 John Lease

    Barry, what is the definition of Pedro ‘hitting’?  .280 with 25+ homers?  With the pitching staff as currently assembled, there isn’t any way the Pirates are going to be at .500 at the end of the year, no matter how well Pedro hits.  Of course we don’t know how the past 4 drafts will end up eventually, but as of now, they don’t look like a wise investment for all of the overslot players signed.

    • Lee Young

      John…….I may have been unrealistic at the time, but when Pedro was drafted, I envisioned a .280-.300, 25-40 masher, not unlike Aramis and maybe better. I got this from all the articles I read and then Manny S reinforced it with his ‘Stargell’ comment.

      Boy, was I fooled when he started striking out like crazy in the minors. I am now firmly entrenched in the ‘bust’ camp and will believe it when I see it. I compared him to Russell Branyan EARLY last year and will be ecstatic now if we even see that! I was not fooled when he bombed out last year, altho, I definitely didn’t expect that epic of a fail.

      • http://twitter.com/jlease717 John Lease

        No one doubts Alvarez’s power, he has it.  His judgement and commitment though are suspect.  He is supposed to be in ‘excellent’ shape this off season.  If he is, great, and if it helps, better.  But why the wait?  He seems like he’s content to be average.  We need guys who burn to be great, like McCutchen seems to be.  It all goes back to me with the ‘confusion’ when he first signed.  That one incident seems to tell a lot, he’s just in it for the cash he can scoop here until he leaves.

        • Lee Young

          Actually, I DON’T doubt his commitment (and other players have stated that as well). However, as you mention, his strike zone judgment combined with the holes in his swing are way below average.

          He gives flailing new meaning.

          • http://pulse.yahoo.com/_AGRPLJJRC5GNBYXDY6LHF2U6DU white angus

            even HOFers fail early in their careers.  Look at Mike Schmidt’s first season.  Roy Halladay.  Many, many more have sucked it up so badly that the brilliant fans labeled them as busts too.

            whoopsie.

            • Lee Young

              Oh God……….here we go with the HOFers who ‘blew up their first couple of years’ comparison.

              many, many, many, many, many, many more have sucked it up their first coupla years and gone on to oblivion.

              If you think Kdro is gonna be a HOFer, God Bless you. I don’t….he might be a HOF bust, but that’s about it.

              whoopsies???

  • Anonymous

    Good job Tim.

    On a related note, it’s been posted on Bucs Dugout that Sanchez has suffered another broken jaw.  Not encouraging at all.

    • Lee Young

      very suspect……..it is said he got it 2-3 mths PRIOR to mini-camp. I highly doubt that a) it would’ve fully healed by then and b) they would’ve let him on the field. Plus, he would’ve lost weight again on that liquid diet.

      • http://pulse.yahoo.com/_AGRPLJJRC5GNBYXDY6LHF2U6DU white angus

        obviously you dont know much about broken bones, do ya champ?  a cracked bone is a broken bone too.  plus remember that a 90mph fastball can do alot of damage compared to a fist thats not attached to a professional fighter.

        then again, if Spider Silva was the one that clocked Sanchez, then youre observation would be correct.

        • Lee Young

          I have absolutely NO idea what you’re driving at. What does the difference btwn a broken bone/cracked bone have to do with what I wrote?
          If he had a broken/cracked jaw (for the 3rd time!), he would NOT have put on 10 pounds of muscle! He would’ve lost weight, as he did before.

          Btw, ‘champ’, it is ‘your’ (possessive) not ‘youre’ (You are contraction). Don’t know much about English, do ya champ? :)

          And who is ‘Spider Silva’?