Skip to main content

Overview

Preface:

I published this guide in 2013 on Creative Applications and moved it to Github in 2016. I don't think the Kinect 2 was even out at the time of the original, and many other cameras have since come and gone. Camera technologies have obviously changed a lot in the 7 years since I published, so it is certainly time for a major update. The 2013 version is being kept in the repository for historical reference.


Major changes to this since 2013 are that a lot of technologies have come out, HDMI capture is a lot easier and cheaper than it was in 2013, and Machine Vision algorithms have been able to accomplish things with object and body recognition that didn't even seem casually possible 712 years ago. I'm also covering a slightly broader set of cameras than I did in 2013 for further completeness.


Introduction

Cameras are one of the most commonly used sensors for interactive installations. They are useful for a wide range of interactions - motion detection, motion visualization, image detection, video and still recording, and more advanced feature and object detection, just to name a few possible applications. Essentially every creative technology coding framework has the ability to take in a basic camera feed and many beginner examples use a laptop's build-in webcams as their input source. The camera's traits of accessibility, portability, and ubiquity make them an ideal sensor for both early prototypes and advanced applications.


As of this writing, I haven't found a comprehensive guide that covers all of the different types of image and light sensors, especially from the lens of interactive installations. Choosing the right type of camera for your interactive installation is one of the most important technical choices you can make in the initial planning phases of your project. You can always correct for certain things in software, but your hardware and camera choices are the first line of defense against undesired behavior. To be clear, I'm not intending to point out the ideal make and model of a particular camera that everyone should use - as we'll explore in the following chapters, there is absolutely not a one-size-fits-all solution when it comes to cameras. The choice depends on what you want to use it for.

As I've researched, I've found that drawing a line at what I'm defining as a "camera" is a bit challenging. There is a huge range of options available for observational tracking and light detection. In general for this writeup, we can think of a camera as an electronic device with a sensor that is capable of detecting different wavelengths of light that have been focused by a lens - but even that definition gets stretched in a few spots. In case you're curious for more detail - Here is a great guide by Bartosz Ciechanowski on the different physics involved in cameras and lenses.
In the other pages of this section, there is a sort of multi-part grouping that is described below
In the sections below, Part 1 covers several common camera types and their strengths and weaknesses. Following that, Part 2 will cover some less common cameras and other topics like camera systems that use hybrid approaches. Part 3 will cover some supplementary information like camera measurements, latency, and other brief software topics. Here is an outline of what we'll be covering.

    Part 0 - Questions to consider when choosing a camera Part 1 - The Basics
      The Basic RGB Webcam Other RGB Cameras Infrared Cameras Depth Cameras LIDAR Part 2 - The Exotic
        Thermal Cameras High-end Machine Vision Cameras Multi-camera and on-board compute systems High-speed or Slow Motion Cameras Wireless Cameras Motion Capture systems Volumetric Capture 360 Cameras and Filming Other Cameras and Systems (Robotic/Moving, and other "observational tracking devices") Older Camera/Video Technologies (Analog, Old RCA Cams) Experimental Technologies Part 3 - Supplemental Information
          Camera interfaces (USB 2 and 3, HDMI, NDI, IP, GigE, etc) Outdoor considerations Notes on Lenses Notes on Latency Notes on image touch-up and noise reduction Brief software discussions Other References and Acknowledgments
          Back to top