Why Does CinemaScore Leave Out So Many Good Movies When Issuing Grades?

The 2017 Academy Awards will be forever remembered as the year that La La Land was awarded Best Picture for about a minute before they discovered that Moonlight was the actual winner. Those two movies have something else in common. Neither movie received a CinemaScore grade despite, arguably, being the top two movies of 2016.

The 2017 Academy Awards will be forever remembered as the year that La La Land was awarded Best Picture for about a minute before they discovered that Moonlight was the actual winner. Those two movies have something else in common. Neither movie received a CinemaScore grade despite, arguably, being the top two movies of 2016.

I’m thinking about this issue this week because three movies with Oscar buzz, StrongerBattle of the Sexes, and Victoria and Abdul,  went into limited release last weekend. None of them were graded by Cinemascore. There is a valid reason for this but that doesn’t make it any less disappointing to movie pre-screeners like myself.

For me, Cinemascore is appealing because it measures only opening night reaction. Most people who go to the opening night of a movie are there because they really want to see that movie. The pre-release buzz has grabbed their attention to such an extent that they can’t wait to see it. They walk into an opening night movie expecting to love it. When they walk out of the movie and respond to CinemaScore’s survey they are probably grading based on expectations. So, when a movie receives an “A” from Cinemascore, it tells us that the movie lives up to the hype. Anything less than that suggests that the movie experience was less than they expected.

CinemaScore gets stuck when it comes to movies that are released in a limited number of theaters prior to them being released widely in most theaters. CinemaScore samples locations throughout the U.S. and Canada to establish a credible unbiased sample. When a movie goes into limited release, it is released in some of their sample locations but not in most of their sample locations. Last weekend, Stronger was released in 573 theaters, Battle of the Sexes was released in 21 theaters, and Victoria and Abdul was released in 4 theaters. To provide some perspective, Kingsman: The Golden Circle opened in 4,003 theaters last weekend and earned a “B+” grade from CinemaScore. When Stronger and Battle of the Sexes goes into wide release tomorrow, does word of mouth reaction from moviegoers who’ve seen the movie in the last week disturb the integrity of any sample taken this weekend? When Victoria and Abdul goes into wide release on October 6, is its release into just 4 theaters last weekend sufficiently small to not taint the sample? I don’t know the answers to these questions. I’ll be looking to see if these movies get graded when they go into wide release. In Box Office Mojo’s article on last weekend’s box office performance they indicate that CinemaScore graded Stronger an “A-” even though it hasn’t been officially posted on their website. Perhaps they are waiting to post it after wide release?

I understand why grades don’t exist on CinemaScore for many limited release movies. I understand the importance of data integrity in the creation of a credible survey. I will just observe, though, that in this age of social media, using limited movie releases to build pre-wide release momentum for quality movies is an increasingly viable strategy. Just this week, A24, the studio behind the rise of Moonlight last year, decided to put their dark horse candidate this year, Lady Bird, into limited release on November 3rd after it emerged from the Telluride and Toronto film festivals with a 100% Fresh grade from Rotten Tomatoes. CinemaScore may be facing the prospect of an even broader inventory of ungraded top tier movies than it does today. It will be interesting to see how they respond to this challenge, if at all.

 

September Kicks Off the Oscar Season…If You’re Looking for Buzz.

After a dismal summer box office performance, theater owners are only too happy to turn the calendar page and discover that Oscar season is upon us. September is the unofficial beginning of the six month journey for most movies seeking Oscar gold. As moviegoers, though, we need to cool our jets. It might not be until November before we get to contribute in a significant way to the discussion.

After a dismal summer box office performance, theater owners are only too happy to turn the calendar page and discover that Oscar season is upon us. September is the unofficial beginning of the six month journey for most movies seeking Oscar gold. As moviegoers, though, we need to cool our jets. It might not be until November before we get to contribute in a significant way to the discussion.

Over the last thirty years, only five movies widely released in September have been nominated for the Best Picture Academy Award. In other words, only once every six years has a September release been Best Picture worthy. In fact, Moneyball, which was released in 2011, is the only September release in the last twenty years to be nominated for Best Picture. Here’s the complete rundown by month of Best Picture nominations over the last thirty years:

# of Nominations
Jan 40
Feb 17
Mar 5
Apr 3
May 7
Jun 6
Jul 8
Aug 10
Sep 5
Oct 16
Nov 25
Dec 40

So, the peak period for Best Picture nominated movies to actually be seen by the broad public is from November to January.

Why, then, is September considered the “kick off” for the Oscar race? Well, even though the general public doesn’t get to see the Oscar contenders, attendees of film festivals do. The Venice Film Festival opened on August 30th. The Telluride Film Festival opened on September 5th. And, the Toronto Film Festival opens today, September 7th. It’s at these film festivals that Oscar hopefuls debut and try to generate buzz to launch their award campaign. For example, the early buzz coming out of Telluride is that Gary Oldman’s portrayal of Winston Churchill in Darkest Hour might already be a “lock” for the Best Actor award.

September is about generating “buzz” which creates pent up demand for a movie before it goes into wide release later in the season. Is there no hope then for this September? AwardsCircuit.com ranks the Oscar contenders by category based on buzz, box office, reviews, and awards during the season. As of September 5th, there are four September wide releases on their list of fifty Best Picture contenders. In fact, Battle of the Sexes, a September 22nd release which features Emma Stone as tennis great Billie Jean King, is ranked fifth on the list. It is coming out of Telluride with positive buzz and might buck the odds against September releases. mother!Victoria and Abdul, and Stronger are the other movies on the list. Those movies are more likely to be serious contenders for acting nominations than for Best Picture.

September is an interesting month. Going into the month there always seems to be a good supply of movies in the pipeline. Historically, many of these promising movies end up in disappointment. Studios possibly schedule them in September because they fear the movie can’t compete with heavy hitters released later in the season. Maybe this September it’s because Studios are getting smarter and see an opportunity for early momentum. Ah, hope springs eternal.

***

The early read on this weekend’s big new release, the movie adaption of Stephen King’s novel, It, is positive. It is Certified Fresh and has high early IMDB ratings.

And the 2018 Academy Award for Best Picture Goes To?

We are 11 days removed from the 2017 Best Picture award debacle and already Awards Circuit has projected its first list of nominees for the 2018 Best Picture race. Obviously it is way too early make predictions like this with a high degree of accuracy. Many of the movies are still being filmed and can’t be realistically evaluated. It does, though, give us an idea of the movies that evaluators believe have Oscar pedigree.

We are 11 days removed from the 2017 Best Picture award debacle and already Awards Circuit has projected its first list of nominees for the 2018 Best Picture race. Obviously it is way too early make predictions like this with a high degree of accuracy. Many of the movies are still being filmed and can’t be realistically evaluated. It does, though, give us an idea of the movies that evaluators believe have Oscar pedigree.

Here is the Awards Circuit list with its current production status:

2018 Projected Academy Award Nominees for Best Picture
Movie Release Status Short Description
Untitled Paul Thomas Anderson Project In Production 1950’s Drama set in London Fashion world.
Suburbicon Post-Production 1950’s Crime mystery set in small family town.
Darkest Hour Nov. 24 release Churchill biopic set in early days of WW II
The Kidnapping of Edgardo Mortara Pre-Production Historical Drama set in 19th century Italy
Battle of the Sexes Post-Production Billie Jean King-Bobby Riggs 1973 tennis match
The Current War In Production Edison-Westinghouse scientific competition.
Mudbound Post-Production Post-WW II drama set in rural Mississippi
Downsizing Dec. 22 release Social Satire about less is more.
Marshall Oct. 13 release Biopic about a young Thurgood Marshall
The Snowman Oct. 13 release Adaptation of Jo Nesbo crime thriller.

If this first list is representative of the entire year, 2018 is going to be a year of looking back in time. Only two of the ten movies listed here take place in a contemporary setting, Downsizing and The Snowman.

I’m probably most interested in Battle of the Sexes. Emma Stone plays Billie Jean King and is projected as a Best Actress nominee by Awards Circuit. Can she go back to back years as Best Actress?

I’m least interested in the Paul Thomas Anderson movie, even if it includes a rare star turn by Daniel Day Lewis. I hated There Will Be Blood and wasn’t a big fan of Boogie Nights.

In any event, that’s my gut reaction to the Best Picture projections. Is there any data to support my gut? I’m trying out a new data point called an Anticipation Score. The website Criticker provides averages of my ratings for movies involving specific Directors, Screenwriters, and Actors. By tabulating the scores for the film makers involved in each movie I can create an Anticipation Score based on my historical rating of their work. I’m including the two lead actors for each movie. For example, Battle of the Sexes is directed by Jonathon Dayton, screen written by Simon Beaufoy, and stars Emma Stone and Steve Carell. I’ve seen two of Jonathon Dayton’s movies and given them an average rating of 65.5 out of 100. I’ve seen five movies written by Simon Beaufoy for an average of 68.6. I’ve seen seven Emma Stone movies, averaging 81.57, and eight Steve Carell movies, averaging 73. When you add all four numbers together they total an Anticipation Score of 288.67. This represents my potential enjoyment of the movie if each artist entertains me at the average level that they have in the past.

Here’s the entire list ranked by Anticipation Score:

My Anticipation Score
Director Writer Lead Actor 1 Lead Actor 2 Score
The Kidnapping of Edgardo Mortara S. Spielberg T. Kushner M. Rylance O. Isaac 323.39
Downsizing A. Payne J. Taylor M. Damon K. Wiig 313.14
Darkest Hour J. Wright A. McCarten G. Oldman K. Scott-Thomas 293.39
Battle of the Sexes J. Dayton S. Beaufoy E. Stone S. Carell 288.67
Suburbicon G. Clooney E. Coen M. Damon O. Isaac 283.01
The Snowman T. Alfredson H. Amini M. Fassbender R. Ferguson 216.67
The Current War A. Gomez-Rejon M. Mitnick B. Cumberbatch M. Shannon 212.13
Untitled Paul Thomas Anderson Project P. T. Anderson P. T. Anderson D. D. Lewis L. Manville 159.13
Mudbound D. Rees D. Rees C. Mulligan J. Clarke 137.23
Marshall R. Hudlin J. Koskoff C. Boseman S. K. Brown 86.5

My gut reaction to Battle of the Sexes and the Paul Thomas Anderson movie are borne out in the data, although these movies are neither the best or worst of the rankings. The two movies at the bottom of the list are there because I have never seen movies directed or written by the two film makers involved. In the case of Marshall, although I’ve seen Sterling K. Brown on TV shows, I haven’t seen any movies that he has been in. As a result, the Anticipation Score for Marshall is based solely Chadwick Boseman’s movies that I’ve seen.

I think my Anticipation Score formula needs some tweaking to take into account the volume of movies seen for each artist. The fact that I’ve seen 21 Spielberg movies should be recognized in addition to the average rating I give each of his movies.

In any event, keep your eye out for these movies as we get back into Oscar season, beginning in October.