Not everyone can be a genius, because then no one would.

Regarding my previous post, which is by far the most “rant-ish” and emotionally charged post on this blog so far, it turns out that brutalizing Maya into doing your bidding is a challenging and time-intensive occupation. Sortof like this graph:

Apple and Red Cinema have been hyping the new Apple ProRes 4:2:2 codec for a while. “Perhaps I should use that!’ I thought. “If this codec can compress 4k video from the Red camera down to 200mbits/sec, then surely it could help me with my mere 1080p workflow problems!” And so then I decided to do some research about just what technology the ProRes 422 codec used and how it compared to others of similar variety.

During that process, I came across this comparison of the ProRes 422 codec and the Avid DNxHD codec, which is apparently one with a similar intended specialty of “Why yes! I can compress your HD footage so you can actually work with it, while preserving detail!” Apparently, the ProRes 422 codec is a bit more lossy at similar bitrates than Avid’s codec. After a little bit of searching, I discovered that not only are Avid’s codecs freely available, they are cross-platform between Windows and OSX. This issue was lending me trepidation earlier on as well, myself considering what would happen if I had a bunch of scenes rendered out in Apple ProRes 422, and then needed to reboot into Windows to do some specialized work on something, only to be unable to read my files!

Anyway, barring complete disaster, I will be using the Avid codecs for some of my needs.

Here is a full resolution frame-capture of a video stream shot with the HV20 (the image is a link to the full resolution image). All of the images posted here are compressed with jpeg 80% quality, and should have most of their original attributes preserved. Note that the pulldown has been removed with After Effects, and that this was originally a frame comprised of two interlaced fields. Note that this picture is HUGE (1920×1080), so if you have a regular sized monitor, expect to scroll around to look at it completely.

If you look closely at the image, you can discern fragments of interlacing artifacts left behind from the pulldown removal. This happens because the mpeg2 compression of the interlaced image results in fields that are imperfect with macroblocks and other imperfections. This confuses After Effects’ algorithms, leaving behind chunks of image that still have interlaced areas. Effectively this just looks like bits of the image have weird blocks of ‘liney’ areas. Below is a 4:1 crop of the above original frame, doubled in size.

You can notice these artifacts on the edge of the finger. In After Effects, there are plugins to process a frame to remove interlacing artifacts. With one of those applied, the image looks a little cleaner.

There are still noticeable artifacts from the mpeg2 compression. You can make out macroblocking and chroma abnormalities on the thumb and surrounding areas. If you were to look at the individual color channels, this would be more noticeable. Usually the compression artifacts are worse in the blue channel. There is a plugin that comes with the Magic Bullet Suite called the “Deartifactor” that takes a whack at removing compression artifacts such at as these.

Deartifacted:

Non-Deartifacted – Blue Channel Only:

Deartifacted – Blue Channel Only:

Sometimes it is hard to see what the deartifactor is doing in areas of detail. Here is another comparison in another less detailed area of the image.

Non-Deartifacted – Blue Channel Only:

Deartifacted – Blue Channel Only:

There is also a filter in After Effects called Remove Grain that was once sold as Grain Surgery by Visual Infinity, but is now included for free with After Effects. This plugin is quite amazingly good at removing grain while preserving detail in the image. While the compression artifacting is not quite grain, it does do a fair amount to improve the apparent image clarity, and while it does soften the image some, it can be adjusted for good results.

Remove Grain filter applied:

Here is the final processed image, in full resolution.

Most likely the effective qualitative differences in the image when viewed full-resolution are relatively minor. However, when you get into things like doing dramatic color correction or other processing, or attempting to extract a matte from an image using color keying, it is absolutely essential to have the best quality image that you can to work with. Of course it is not really a great idea to try to use HDV for something requiring excellent chroma key matte extraction, but for 800 dollars, this camera produces some amazing images, and you would be hard pressed to find a better solution for less than several thousand. There is also the possibility of capturing 4:2:2 uncompressed video before the MPEG2 compression stage from the HDMI output of this camera, if you have a Black Magic Intensity card, or an equivalent HDMI capture device, which could theoretically be plugged into a laptop. There has been some experimentation in this area, but little noticeable benefit is likely to be achieved.

As free alternatives for the post-processing of HDV, there is a plethora of possibility with AviSynth and various other freeware windows applications. There is quite a bit of activity around the area of using AviSynth for post-processing of HV20 footage.
The Farnsworth plus Sillyman Process
Automated 24p pulldown workflow using DGIndex and VirtualDubMod
Morgan MJPEG2000 as an alternative HD Intermediate Codec
AVISynth and VDub Templates / Code

To end this post, here are some other full-frame image-captures from the HV20, with no processing applied to them other than pulldown removal and deinterlacing.

An indoor image recorded in low light, showing the characteristic of the camera in high-gain mode, which can be avoided if operated properly.

An outdoor image from the camera on a relatively bright day.

I have been going through the manual and tutorials on Nuke, and am quite struck by its differences from After Effects. Nuke is less friendly in the construction of the user interface, and yet very powerful. Like many compositing applications, it features a node-based interface. A node-based interface is basically a different way of combining different elements into a final image. An image or moving image is loaded in, and then multiple nodes are linked together in a stream, each applying some process to the image. This combination of nodes forms a ’script’, which is much the same as a project in After Effects. After Effects features a layer-based interface, where different elements are stacked on top of each other in layers, and the layers are arranged in time. This is what I am used to, but a node-based interface is beginning to make sense for some more complex projects using many image elements.

I have also been working through some more advanced tutorials on texturing and modeling in Maya, attempting to build on what I learned this summer, and gain the knowledge I will need to actually create some of the crazy things I have in mind for this project.

Close to the end of Week 06, I received a new HD video camera, the Canon HV20. Purchased from Newegg.com for $799, it is capable of shooting 1080p24 in the HDV format. I will be using this to acquire textures and live action image elements for my project at a high enough resolution to successfully work at 1080p24 for the final output. Of course with a new acquisition format, there is a great deal of testing and learning to do in order to become comfortable with a post-production workflow.

Because the HV20 is capable of recording in 23.976 progressive frames per second, and the HDV format specification calls for interlaced 29.97 frames per second material, the HV20 has to do some processing to record its beautiful progressive data to an HDV tape. Similar to the Panasonic DVX100, which records 23.976 progressive fps standard definition material in a 29.97 interlaced fps video stream by applying a pulldown to the footage, the HV20 records a 1080p24 stream of video, but packaged in a 1080i30 video stream in order to conform to the HDV standard. The fact that editing system support for the HV20’s footage is somewhat spotty that a process of removing the pulldown outputting to an intermediate codec is a necessary step. Adding additional complication is the image quality of the HDV format itself. Since the format uses mpeg2 compression, there is a relatively significant amount of image artifacting compared to DV. A step that many experimenters with this camera have been using to improve this situation is to add an artifact-removal step to the process. This way, the original footage from the camera can be processed from it’s original mpeg2 format, having its pulldown removed to achieve progressive frames at 23.976 fps, having compression artifacts filtered to improve the image quality, and then outputting the footage to a relatively lossless intermediate codec for editing and post production work (such as mjpeg2000, apple intermediate, pro res 422, or uncompressed). Of course with the adoption of HD intermediate codecs, more difficulties arise with storage space because of the extremely large size of uncompressed HD video, playback issues because of the extremely large data throughput needed to play uncompressed HD video (and the relatively limited transfer rates of hard drives), and so forth. For a large documentary, it would likely make the most sense to edit the footage in the acquired format of HDV and trust your editing system to deal with mid-GOP cutting recompression issues in an intelligent fashion. For this type of project however, because it is more animation and effects oriented, it makes more sense to have uncompressed files to work with… or at least I think it does.

On the bright side, the images from this camera look simply amazing, and I am very excited to incorporate this technology into my project, and figure out what will be the least painful method of working with the footage. Of course my primary goal is to make a good work of media, not to get caught up in the technology to the exclusion of all else, but I don’t think I am falling off of that cliff quite entirely yet.

This summer was exceedingly much more busy than last summer, during which time I was unemployed and did not accomplish a great deal. This summer, I was fortunate enough to acquire workstudy, and because of that I was able to get a job working for the Electronic Media department of Evergreen. This job paid $10.78 per hour, and was for 40 hours per week. I was able to do a great deal of fun and interesting tasks, including learning intermediate functionality of Autodesk Maya 8.5, creating some enticing motion graphics in After Effects for a corporate video and some other projects, teaching a workshop on basic audio sweetening for a radio show, assisting with workshops on how to use Digital Performer and giving audio technology students proficiencies in the music technology studios, editing some exciting lectures and other events, and also doing some advanced maintenance work on the advanced music technology studio which involved rewiring the studio for installation of a 5.1 surround receiver system.

Also during the summer, I did some various work for Inventive Pictures, doing freelance grip and camera operator work. If intrigued to see visual documentation of this, look at the pictures for Pool Whore, a short shot in 720p HD about a monetarily poor girl who wants to swim in her rich neighbor’s pool.

Also this summer, I was able to go on a few adventures during spare moments. To get a feeling for what these might have been, look at the photographic documentation of them as well.

Interface
xplorer2 – The single best file manager I have ever used, and I have used alot. I wish there were anything that remotely approached an equivalent on the osX side of things. (lite version = freeware, more advanced version is shareware)
Launchy / Colibri – Keyboard launching utilities are the single greatest enhancement in interface technology since … (freeware)
TaskSwitchXP – A superior replacement for the Alt-Tab task switcher built into windows
Stickies – Sticky note program, freeware
EssentialPIM – Calendar / ToDo / Personal Organization utility, freeware

MultiMedia
Foobar2000 – Audio player, encoder, ripper, tagger, cataloger, with many more advanced features (freeware)
VLC – Monolithic multimedia player with Matroska support (freeware)
Mediaplayer Classic – DirectShow multimedia player. Best when combined with the Combined Community Codec Pack (freeware)
XnView – Photo viewer / editor (freeware)
wScite / Notepad++ – Text editors for programming and just plain text editing (freeware)

Network
Firefox / Opera – Web browsers (freeware)
Pidgin (formerly Gaim) / Miranda – Instant messaging multi-protocol clients (freeware)
X-Chat 2 – IRC client (freeware)
uTorrent – Torrent client (freeware)
StrongDC++ – Direct Connect client (freeware)
eMule – eDonkey client (freeware)

Security/System
Sygate Personal Firewall Pro – Firewall
NOD32 Antivirus – Antivirus software

[See post to watch Flash video]

Currently (Week 9), I am working on Unicorns stuff. We had a pixilation shoot in the sheep meadow behind Morgan’s house on Thursday, and we have been working on the new edit. The new edit is a revised version of the Trouble With Unicorns script that we all wrote during Winter quarter. The storyline has been altered to accommodate the footage that we have. The total length will ideally be somewhere around 20-25 minutes now, and the message that we originally intended to come across, will hopefully now come across in a more condensed but equally powerful way.

I have been working today on the Dan special effects shot, and in the TUTORIAL SCREENCAST below, there is commencement with a detailing of a novel technique of rotoscoping, and some other various happy things regarding my workflow.

(via vfxtalk.com)

This past week was an interesting one. Somehow I managed to read the entire 2000+ page Akira manga during spare time I had. It was an amazing epic journey and a far better way to escape and procrastinate school work than bad TV (though I haven’t been down that road in awhile). I couldn’t put it down. Well, I read the entire thing on my computer, so I guess I couldn’t really “put it down” in the physical sense. Sometimes I feel like everything exciting in my life is mediated by this computer. I spend most of my spare time here, sitting in this chair, interfacing with information.

Of course I start off this post saying I am behind. Then I say “well, … yeah… I read 2000 pages of manga instead of working.” Let me follow that up with some reassuring statements of what I actually did accomplish this last week.

I made some good progress on my Hybrid Music project. In Hybrid everyone in the class is working on a live performance of electro-acoustic music to be performed at a public concert during week 9. I learned how to program the drumKAT midi drum triggering device. I have created a rather decent Kontakt percussion instrument from Buchla 200 samples, and am thinking about how to actually create the rhythmic elements of my project in a live setting. Most likely it will end up being a primary bed of pre-sequenced polyrhythmic drum programming, with an additional flare of articulative live-triggered fills.

I did some great reading of theory for my New Media class, accidentally typing a 1000 word comment about the nature of language and the representation of ideas, and its relationship to the ill-defined concept of artificial intelligence. Through this discussion I was turned on to the fascinating theory of the Linguistic Relativity (Sapir-Whorf) Hypothesis, and was inspired to search for some better definitions of just what the definition of artificial intelligence really is.
On Friday, in the morning I did the aforementioned drumKAT experimentation, and in the afternoon I taught a section of about 10-15 Mediaworks students Adobe After Effects. Yes, I did stay up about 4.5 hours into the morning, that time directly cutting into my healthy 8 hours of sleep that I seldom get, revisiting previous After Effects handouts, and creating a new outline, and even attempting to bypass the necessity of live improvisation of verbiage by recording video tutorials of everything I was intending to say. Unfortunately, 4 hours wasn’t quite enough time to both figure out how to do this, and successfully pull it off, so I ended up being all with the talking. This actually went surprisingly well. I am wondering just how much the formation of concepts are tied to verbal language. I get this huge increase in my ability to think cogently and express myself successfully after every time I do one of these verbal-heavy presentations. And also, to a lesser extent, after I write an intensive paper. Needless to say, the workshop went the best of any that I have done so far, and I am really glad I had such an opportunity to share my knowledge with a group of people who might very well benefit from using it.

At 6:45am the next day (Saturday), I woke up and drove with Brad Hutchinson and Katie Gregg to Portland, OR. Here I was headed to help Brad set up for the most recent performance of his 3-projector 16mm direct animation film epic about the fracturing of family, “My Primary Colors”, accepted to be a part of the PDX Invitational, a competitive competition of the best experimental work of those accepted. After setting up in the morning, we had all afternoon to Jock around the land of Ports, so we drove to downtown and ate Greek food, and then went to the underside of the Burnside bridge, where we documented the glorious examples of dystopian ruin found right here in our very own country. These documentation included a 3-channel multi-perspectional recording from the edge of a freeway, and footage of a moving freight train from nearly under its wheels, as well as a multitude of photographs.

That night, Brad and me and Morgan Dusatko projected “My Primary Colors”. It went alright, except that the main film loop broke a little more than halfway through. This was somewhat disastrous, as you might imagine, but we managed to get it rethreaded and projecting again. Unfortunately the film decided it didn’t like the improvised takeup reel either, and so it spewed the film all over the floor… but it went across to the audience well enough to tie with 13 other people for 2nd place. The winner was a 70+ year-old man who made a psychedelic film visualizing microscopically the shifting and warping multi-colored patterns on the surface of soap-bubbles. He deserved it.

On the way home on I-5, I shot a great deal (about 40 minutes) of slow-shutter mode motion blurred video of lights with my Panasonic GS-150. I actually have a specific purpose for this footage. I am going to be doing a live performance of visual material to complement a live performance of audio material with my friend and classmate from Hybrid Music, Nic Zwart, this Saturday at 5:30pm at the Eagle’s Hall in Olympia. This is a concert series in benefit of the excellent Free Radio Olympia. I am working on compiling a “sample library” of good clips from this in After Effects, not just cutting things out, but adding effects and layering to make things more visually interesting. I have been wanting to do live musical performance for a long time. This is my chance, and I’m not going to pass it up.

Next week is my first work in progress presentation. Like I said at the beginning of this post, I have a lot of work to do. But there are 6 days between now and then. That is 144 hours. if I spend 30 of those hours sleeping, that is 114 hours of time to do things. If 12 hours of those are spent eating, showering, procrastinating, and transporting myself around, that is still 102 hours to accomplish things. That is 17 hours per day. A lot can happen between now and next tuesday. I will update on the journey if there is time, and let you all know how the impossible task of WRITING my AI project goes. And, subsequently, the ANIMATING of the first couple of scenes.

What impacts will technological advancements like this have on filmmaking? An increase in the visual quality of lower budget films? An increase in the conceptual quality of lower budget films? A decrease in the cost of higher budget films?

My guess is that as technology improves the resolution and perceptual quality of digital representations of moving images, we will become just as accustomed to it as we have grown accustomed to the amazing (as seen from a perspective of someone in the 1970s) quality of DV. Cost will drop, and quality will increase, and creating quality films will be just as much of a challenge as before. Fancy technology doesn’t make you a better filmmaker, even though it’s tempting to think so sometimes. Of course, that doesn’t make emerging technology any less exciting.