In some choice quotes Eccles provides the background on PunditWatch:
“So about three months ago we were thinking about all the journalists and pundits out there and saying to ourselves, ‘I wonder how they would perform if they were on the site?’” Eccles said. “So we decided that instead of inviting them on, let’s follow their predictions and record it on Pundit Watch. We did that through stealth for a month, and then at the end of the month we launched it and said, ‘Hey, we’ve been following your predictions, and here is your performance.’”
...and also some thoughts on whether being accurate is a prerequisite for being a good pundit...
“My biggest fear is that I force a lot of entertaining journalists to turn into dull caveat-driven detail-oriented journalists who wouldn’t be that interesting, would make fewer predictions, and would only make predictions if they were 100% sure [of their outcomes],” he replied. “I think that would be a really unwanted result…To some extent I think of it as an experiment. What will happen? Will the journalists themselves change how they perceive things, or will it change how the readers perceive them? I don’t know what the answer is.”