Cultural Analytics

Cultural Analytics

Seeing things through new lenses.

Brief

It may seem redundant to create visual representations of media that are already visual, but we can do with computer is analyze those visual texts in a way or at a scale that reveals more about their composition, structure, origins, or meanings.

What do you learn about a film by viewing it as a barcode-style image? Or as a single composite frame? What can you learn from thousands of selfies?

In this module, apply one or more of these techniques to some visual text in order to provide new perspectives on its aesthetics.

Learning Objectives

  • Learn how abstract visualizations can be used to study and make arguments about visual media
  • Use software and tools to produce visualizations and compare the results of those different approaches
  • Learn to analyze specific, individual artifacts with reference to their stylistic contexts

Options and Variations

  • Read about one or more of the projects in the bibliography, and write in your blog about how those researchers used a visualization to make an argument that they couldn't otherwise make.
  • Create the same style of visualization for a number of works by the same author, director, studio, or artist. Compare the results to see how that work changes over time.
  • Create and compare several different visualizations of the same work to see what different views reveal about it.
  • Create a Kahoot quiz (or anything similar) that presents a barcode, summed frames, or other visualization of movies, TV episodes, or anything. See if users can correctly identify the source.

FFMPEG Mini-Tutorial

Whatever approach you take to this module, there's a good chance that FFMPEG will make your work easier and faster. This is a command-line application that can do many, many things, including extracting frames from video.

To install it on a Mac, use the Terminal:

  1. First install "[Homebrew"](http://brew.sh)
  2. Then use Homebrew to install ffmpeg with this command: brew install ffmpeg

FFmpeg also works on Windows, but installing it involves a few more steps.

Either way, let's say you have a movie saved as "the_godfather.mp4" (it can be called whatever you want, that's just what it is in this example) in a folder by itself with a subfolder called "frames". To extract 6 frames per second, the command would be:

ffmpeg -i the_godfather.mp4 -r 6 frames/img-%05d.jpg

Note: this will generate thousands of images, so make sure your hard drive can handle it. Once you've got all these, you can try processing them with IMJ or ImageJ.

Alternatives

FFMPEG is software that runs in a command line, but there are GUIs and web applications that let you use this tool without installing it directly. Those applications will be limited in various ways, but they can be an accessible option.

For extracting frames from a video file, frame-extractor.com seems to work well enough, though it processes more slowly than FFMPEG.

Resources and Tools

Bibliography

Ferguson, Kevin L. “Digital Surrealism: Visualizing Walt Disney Animation Studios.” Digital Humanities Quarterly 011, no. 1 (November 29, 2016).
filmvis. “Film Visualization.” Tumblr. Looking at films every which way but the right one. (c) Kevin L. Ferguson 2013-2022. Accessed April 5, 2023. https://filmvis.tumblr.com/.
Foo, Brian. “NYPL Public Domain Release 2016 - Visualization.” NYPL Public Domain Release 2016 - Visualization. Accessed April 5, 2023. http://publicdomain.nypl.org/pd-visualization/.
moviebarcode. “Moviebarcode.” Tumblr. Accessed April 5, 2023. https://moviebarcode.tumblr.com/.
“Software Studies Projects.” Accessed April 5, 2023. http://lab.softwarestudies.com/p/research_14.html.
Whalen, Zach. “Zen for JPG.” Zach Whalen (blog), February 12, 2015. https://www.zachwhalen.net/posts/zen-for-jpg.
“Yale DHLab - Robots Reading Vogue.” Accessed April 5, 2023. https://dhlab.yale.edu/projects/vogue/.