American Film Institute

The Academy of Motion Picture Arts and Sciences is presented as both the source of Oscar voting information and an institution wary of that information becoming public before its ceremony. In March 2000, its members’ ballots became the basis for a striking test of how well direct insider polling compared with a prediction market: the Academy objected to the reporting, but the Hollywood Stock Exchange ultimately made the more accurate forecast.

The Academy and the ballot inquiry

A team of twelve reporters from The Wall Street Journal canvassed Academy members to learn how they had voted. The Academy opposed the effort. Its president publicly criticized the newspaper for trying to reveal the results before Oscar night, and the organization urged members not to speak with reporters.

The Journal promised anonymity, and 356 members—about 6 percent of the Academy’s total membership—nevertheless disclosed how they had filled out their ballots. The effort thus drew on a small, self-selected group of insiders rather than a complete accounting of the Academy’s vote.

The forecasts and their test

On the Friday before the ceremony, the Journal published predictions in six major categories: Best Picture, Best Director, Best Actor, Best Actress, Best Supporting Actor, and Best Supporting Actress. When the winners were announced, the newspaper had correctly picked five of the six. The Academy’s attempt to discourage members from talking had not prevented a substantial enough disclosure to produce a mostly accurate forecast.

The Hollywood Stock Exchange, which lets participants wager on Oscar outcomes as well as box-office performance, did better: it identified all six winners. In 2002, it also picked thirty-five of the forty eventual Oscar nominees, another result cited as evidence of the market’s forecasting strength.

What the episode demonstrated

The comparison did not establish that the Academy’s members as a whole had disclosed their votes, or that the Journal’s sample represented every voter. Instead, it showed that a limited set of disclosed ballots could yield a useful forecast, while an exchange aggregating participants’ judgments could do better still in this particular contest. The episode makes the Academy’s resistance part of the larger demonstration: information about members’ choices circulated despite the organization’s appeal for silence, and the market converted dispersed judgments into a complete set of correct winner predictions.

The book places the Hollywood Stock Exchange alongside election prediction markets as an example of collective forecasting. Its Oscar wagers used play money, yet the exchange’s performance suggests that financial stakes were not the only incentive capable of sustaining serious participation; status and reputation could also motivate active traders. The Academy’s ballot dispute therefore supplies both a concrete prediction test and a contrast between controlling information at its source and aggregating judgments once information has entered public circulation.