A team of researchers at the University of Virginia has recently carried out a large-scale analysis aimed at identifying features in film trailers that best predict a movie’s genre and estimated budget. In their study, outlined in a paper pre-published on arXiv, the researchers specifically compared the effectiveness of visual, audio, text, and metadata-based features.

“Video understanding is the next frontier after image understanding,” Vicente Ordonez, one of the researchers who carried out the study, told TechXplore. “However, much work on video understanding has so far focused on short clips with a human performing a single action. We wanted something longer, but there is also the issue of computational power. Video trailers seemed like an intermediate compromise, as they display a multitude of things, from scary to funny.”

Movie trailers are short and can easily be paired with movie descriptions. Ordonez and his colleagues realized that these characteristics make them ideal to investigate parallels between video and language.