A few weeks ago, in a small-group session, the speaker put forward the idea that your staff doesn't need you to be nice; it needs you to be predictable. This is also SuperNanny's position, for the record, and just about every parenting textbook's central theme. Your staff aren't children, of course, but you're in a position of guidance.
The CrossFit 2011 Open is winding up. Most of the initial fears about scoring, testing, and preparation were cleared up as we went along (including a massive new leaderboard, which appears to work the way God and Glassman intended.)
The last subject, and the hardest to address, though, is consistency among judges. While the credentials required (Level 1 Cert) DID set a baseline qualification, the actual movements selected required experience beyond what was covered in the Big Weekend. For example, I was comfortable calling a strict depth on Overhead Squats, having competed and refereed Powerlifting events for several years pre-CrossFit. Some weren't comfortable. Some were too comfortable.
We were graced with several visiting CrossFitters over the last five weeks (think the Open setup isn't great this year? Imagine how many CrossFitters pass through your area and DON'T look you up until they're forced to by the Open...). We LOVE having these folks in; we don't charge them; we referee them as their schedule permits. Most have done their WODs at three or more Boxes, though, and so they have unique insight into the judging standards. We're not all the same.
I believe, firmly, that CrossFit Affiliate Owners are GFPs. I think that every single person who volunteered hours to judge competitors did so with honesty in their heart and rigid adherence in their brain. But if John's on his last rep with 25 seconds left, and he's really great at muscle-ups....or Linda's just completed her first jerk at 110lbs, but her left arm didn't quite lock out, and the crowd is going crazy....it's tough.
The threat of punishment isn't effective, because the honour shared among CrossFitters is high, and no one's going to willingly cheat. Intent is not the problem here; carrythrough IS. Threatening to remove an Affiliate's license is too tough a penalty, because HQ will be loathe to enforce their punishment.
What's the solution? A refereeing standard. I'm not talking about another Certification. The investment by the potential referee is their TIME - as always - but that investment could be required of all participating Affiliates.
Consider, if you will:
For an Affiliate to participate (host) an event, they must have at least one CF Referee on site for each competitor doing the WOD. No referee? No validation.
To become a Referee, a coach (minimum Level I Certified,) must complete a two-hour course (online video) on movement standards, and score a 90% on a video-based online quiz. A participant may retake the quiz, of course, as many times as they like.
Referees who are guilty of cheating, or allowing short reps, etc. just lose their permission to Referee. Why not have a ranking system for referees - 5 stars? - that participants can use when they submit their scores? If a referee averages less than three stars, well.....maybe they can compete next year instead. It's not possible for HQ to 'referee the referees,' so why not turn the system back on the user?
If the Referee course costs TIME instead of money, you won't have a shortage at your Box. With athlete-rating systems, you'll weed out the inconsistent. Eventually, the largest hurdle to an Online Open will decrease its effect.
The sport is evolving. With 30,000 people competing, we've become the largest tournament on Earth. It's time for the judging to rise to the level of our athleticism. Comments warmly welcomed.