SYLLABUS SPRING 2017
ARCH 5424: DIRECT CINEMA MEDIA FABRICS *

INSTRUCTOR: Earl Mark ejmark@virginia.edu

TEACHING ASSISTANTS: EJ Elliott eje7fh@virginia.edu, Zachery Danz zsd4yr@virginia.edu

COURSE DESCRIPTION

Direct Cinema Media Fabrics is an interdisciplinary workshop and seminar. The cinema has expanded to encompass a greater range of media and methods, transcending architecture, sculpture, theater, animation, scientific discovery and environmental art. We explore methods of capturing moving images, sound and potentially other sensory input through video, computervision and microcontroller sensors. We explore ways to discern key patterns and shapes through coding computer graphics procedures. We then speculatively and creatively transform the input into 2D or 3D virtual or physical forms. A significant part of the class will be devoted to learning to write code in the processing graphics programming language that was developed at the MIT Media lab (see processing.org). The software runs natively on both the Apple and Windows operating systems. The final project may be in the form of video, computer animaiton or a physical interactive medium.

A curated exhibition work created with Processing at http://processing.org/exhibition demonstrates methods of filtering captured data, video and images, facitating  its analysis and interpretation, and creatively harnessing it to produce motion pictures and other media fabrications. For example, a video recording, sound recording or a motion sensor may be used to collect initial data. The data is processed to discern patterns, forms or movements. In turn, the movements and other observations are creatively translated into some other media such as a 3D virtual model or animation, a movie, a video installation, or a moving fabric wall. 

Processing is used in two distinct implementations1) as the platform for interactive conmputer graphics, and 2) as the IDE (intregrated development environment) for working with Arduino microcontollers). Both implementations are are availble no cost as will be described in class.

The course engages three overlapping phases of a data collection to creative process. The phases are 1. Direct Cinema, 2. Computervision and Processing, and 3. Media as Fabric. Some of the specific methods used in each phase are:

Phase 1: Direct Cinema: Workshops explore a documentary moviemaking style conducive to spontaneous discovery and observation. Subjects may include people and their environments, phenomenal studies of light, air, and water changing over time, or other elements of story and place.

Phase 2: Computervision and Processing: Tools are used to accentuate, abstract, analyze and expand upon the captured data and to set the stage for creative interpretation. This phase will be developed hand-in-hand with learning to program in Processing.

Phase 3: Media as Fabric: The processed input data is creatively translated into either physical or virtual media. This may include a movie, an alternative virtual form (e.g., a choreographed animated human figure), of some other type of virtual or physical element that moves (e.g., a building skin).

The three phases are incorporated a series of seven exercises that explores technology towards a final cumulative project. The final project and type outcome is developed on an individual basis. It is anticipated that an interdisciplinary group of students will enroll in the class, such as from design, studio art, media studies, digital music, and computer science, and that the kinds of final projects will vary.

REQUIREMENTS

Six exercises for the term lead towards a final project. The first five exercises count for roughly 50% of the grade, the final project (exercises 6 and 7) counts for 40% of the grade. Class participation through attendance in workshops will count towards 10% of the grade. Full attendance is expected.

The technologies of 2D and 3D computer graphics animation, digital video production, motion capture and video processing, and computer graphics programming are the primary technologies used. Digital sound and recording systems will be introduced.  The degree to which each area technology is used will vary according to individual student interests. These include character based visual narratives, explicit reconstructions of buildings and landscapes, or more abstract compositions exploring materiality, light, formal or spatial elements, or a responsive physical object.  

To gain a critical perspective, we will discuss feature and independent movies, animation, interactive projects and student work. There will be a few readings in film theory, design theory, and cognitive science. We will also discuss interactive physical installations, their history of use in film and their potential application to architecture and other fields. The text by Reas, Casey and Fry, Ben, Getting Started with Processing is requiremed (see bibliography below), and can be obtained electronic book form through UVA's Library System, or for purchase via nook or iBook (recommended) or paper. The primary software for the course, Processing, is available at no cost from Processing.Org. Some students may also elect to take advantage of also free under and under academic licensing from Autodesk. Details will be provided during the first week of class. Finally, the course will introduce Arduino hardware in conjunction with the Processing IDE (Integrated Development environment), and students may elect to purchase their own Arduino board for approximately $25.00 or a complete starter pack incluidng sensors and motors, although neither will be required.

In week three we will begin a gradual step-by-step sequence of learning to program with Processing in parallel to working with other digital media. While students with prior experience may be capable of advancing more quickly, the basic plan for the semester is to work at a relatively modest pace to ensure that there's ample opportunity to learn both the techniques involved and that assumes no prior background.

Note that some of the outside works that we screen or review, as outlined below,  may change depending upon the direction of student work in the course.

SCHEDULE

Selected Bibliography (links underlined below are to UVA VIrgo Electronic Subscription, free on grounds or through VPN access from off grounds)

Animation:
Introducing Autodesk Maya 2015  (NOTE: This link is temporaily missing) by Dariush Derakhsshani, Autodesk Official Press, 2014° §
Mastering Autodesk Maya 2015 (NOTE: This link is temporaily missing) by John Palamar, Wiley Publishing, Inc., 2014 (2016 edition expected August 1, 2015) A° §
Maya Visual Effects: The Innovators Guide by Eric Keller, Autodesk Official Press, 2013 +  §
MEL Scripting for Maya Animations, Second Edition,  by Mark R. Wilkins and Chris Kazmier, Morgan Kaufmann Publishers, 2005 + §
Maya Secrets of the Pros 2nd ed. / John Kundert-Gibbs, Dariush Derakhshani et. al. Sybex Inc., 2005. +  §
Maya 8 for WIndows & Macintosh (Visual QuickStart Guide) by Morgan Robinson, and Nathaniel Stein, Peachpit Press, 2007 §
lynda.com tutorials activated for internal use at UVA are available through this link on netbadge

Graphics Programming:

Reas, Casey, and Fry, Ben, Getting Started with Processing, 2015, Media Maker Inc.Ø § (Java edition, shared licenses, limited number of copies statewide available at one time)
Reas, Casey, and Fry, Ben, Getting Started with Processing, 2015, Media Maker Inc. Ø § (Java edition, supplementary licenses, access expires upon limited number of uses, use sparingly)
Reas, Casey, Fry, Ben, and Parrish, Allison Getting Started with Processing, 2016, Media Maker Inc. Ø § (Python edition, shared licenses, limited number of copies statewide available at one time)
Reas, Casey and Fry, Ben, Processing: A Programming Handbook for Visual Designers and Artists, August 2007, MIT Press. ±
Reas, Casey, McWilliams, Chandler, and Barendse, Jeroen, Form+code in Design, Art and Architecture, August 2010, Princeton Architectural Press. §
Shiffman, Daniel, Learning Processing: A Beginner's Guide to Programming, Images, Animation and Interaction, 2008, Morgan Kaufman.§
Processing Software Download (Max OS and Windows Compatible)  processing.org. Ø

Microcontrollers:
Banzi, Massimo, Getting Started with Arduino, 2008, O'Reilly
Margolis, Michael, Arduino Cookbook, 2011, O'Reilly Media Inc. §
Sparkfun Inventors Guide, Creative Commons, San Francisco, CA (earlier version of tutorial available as PDF download)
Sparkfun Tutorial for Arduino 101, Sparkfun Web Site (see bottom of web page, we will be using this tutorial).Ø
Sparkfun Inventors Guide Companion Programs

Moviemaking:
Arnheim, Rudolf, Film as Art. Los Angeles: University of California Press, 1957.*
Bazin, Andre, What is Cinema: Vol. I. Los Angeles: University of California Press, 1967.
Bazin, Andre, What is Cinema: Vol. II. Los Angeles: University of California Press, 1972.
Cocteau, Jean, Beauty and the Beast: Diary of a Film. New York: Dover Publications, 1972. **
Greene, Graham, The Third Man and The Fallen Idol, Penguin Books Ltd., 1977.
Murch, Walter, In the Blink of An Eye, A Perspective on Film Editing, Silman-James Press, 1995. **
Nichols, Bill, Movies and Methods. Los Angeles: University of California Press, 1976.
Nizny, Vladimir, Lessons With Eisenstein. New York: Da Capo Press, Inc., 1979. (trans. and ed. by Ivor Montagu and Jay Leyda)
Sarris, Andrew, The American Cinema: Directors and Directions 1929 - 1968. Chicago: University of Chicago Press, 1968.

Philosophy and Psychology of Perception:
Arnheim, Rudolf, Art and Visual Perception. Los Angeles: University of California Press, 1974.
Goodman, Nelson, Languages of Art. Indianapolis, Indiana: Hackett Publishing Company Inc., 1976.
Sacks, Oliver, The Man Who Mistook His Wife for a Hat. New York: Harper & Row Publishers, 1987.
Langer, Susanne K., Philosophy in a New Key. Cambridge, MA: Harvard University Press, 1957.
Putnam, Hillary, Representation and Reality. Cambridge, MA: M.I.T. Press, 1988.
Existentialism from Dostoevsky to Sarte, Edited by Walter Kaufmann, The World Publishing Company, 1956 (Rainer Maria Rilke, "The Notes of Malte Laurids Brigge", 1910)

Sample Vendors for MIcrocontrollers, Instructables, Microcontroller Software, Sensors, Motors and Gears
Arduino.cc - with or without purchase includes free Processing IDE (Integrated Development Environment) for Arduino platform Ø
Adafruit.com
Sparkfun.com
amazon.com -third party clones of arduino boards and other components (check reviewer comments carefully before purchasing)
Robotshop.com
scientificsonline.com
stevenshobby.com

Ø - Required (free resources, see Reas and Fry, Processing and Aduino IDE above)
§ - These texts are availble from UVA Virgo for on-line viewing. For a more complete listing of on-line materials see links.
± - Highly Recommended Tutorial/Textbook
°  - Recommended Tutorial/Textbook
*  - Highly Recommended Book
**  - Recommended Book