|
Manifest Technology Making Sense of Digital Media Technology By Douglas Dixon |
|
|
Articles: | PC Video | Web Media | DVD & CD | Portable Media | Digital Imaging | Wireless Media | Home Media | Tech & Society | Home Media: | Home Media Articles | Home Networked Media Gallery | 3D - The Next Dimension (11/2010)
by Douglas Dixon Are you ready for 3D? Have you enjoyed 3D movies? Interested in enjoying 3D movies or games at home? Or intrigued by the possibilities of shooting, creating, and sharing your own 3D pictures and videos? The consumer electronics industry is ready to help out, with 3D HDTVs, 3D Blu-ray Disc players, and 3D video games -- Plus early cameras, camcorders, and lenses for shooting your own 3D material. Even better, software tools are becoming available to create your own 3D images and video -- and you can get started at minimal cost with your existing equipment. This article and associated presentation explores these possibilities from two viewpoints:
-> Part 1 - Seeing 3D: Market, Technology, Formats
3D TV - In the Living Room3D TV and Content Delivery for the HomeThese new 3D TV systems typically use active shutter glasses, battery-powered units with LCDs that open and block each eye in sync with the display as triggered by the emitter box. These are rather expensive (around $100 or more), in comparison to the simple cardboard polarized 3D glasses typically used for movies. Or you can do even simpler 3D on existing displays with the familiar red/blue (Anaglyph) 3D glasses, in which the stereo images are overlaid in the two colors. Then to deliver the 3D content, the Blu-ray Disc Association has defined the Blu-ray 3D format for Full HD 3D, and the updated HDMI 1.4 cable format supports 3D video for home movies and gaming.
And where's the 3D content? Interestingly, packaged media is leading the way, as the Blu-ray Disc Association released the “Blu-ray 3D” specification in December. This provides for Full HD 1080p high definition resolution for each eye, and supports graphics features including 3D menus and subtitles. Next, there's cable and satellite distribution. The DirecTV service announced plans for several new 3D channels, as have providers including the Discovery Networks and ESPN. However, it's not clear what associated set-top boxes will be required for delivering these new satellite or cable signals. References:
Sony BRAVIA 3D HDTVsAs an example, the Sony holiday line of BRAVIA 3D HDTVs range from 40 to 60 inch displays, priced from $2099 to $4999 (reduced to $1349 to $4499). These are both Full HD 1080p models. The 60" set includes 3D glasses, while the 40" set is "3D ready," requiring separate glasses ($399) and wireless transmitter ($49). Sony is also selling the 3D accessories in bundles with a 3D Blu-ray movie.
Blu-ray 3DNew (or upgraded) Blu-ray 3D players then are required to play movies on 3D discs. Not surprisingly, this capability is being introduced in top-of-the-line players, and should then migrate across the product lines as a standard feature. It is also possible to upgrade the firmware of at least some recent Blu-ray players to support the new format.
Multiview Video Coding (MVC), the new encoding format used for Blu-ray 3D, is an extension of the familiar AVC / H.264 format already used in Blu-ray, and typically adds around 50 percent overhead for a second stereo frame. References:
Sony PlayStation 3For example, the Sony PlayStation 3 now supports Blu-ray 3D through system software update 3.50, as of September 2010. The PS3 supports Full HD 3D televisions with compatible 3D active glasses and Highspeed HDMI cable. The PS 3 is now available with PS3 320 GB hard drive for $349 and 160 GB for $299. Known limitations include different display of 3D elements such as menus and subtitle, and playback issues with some BD-J (Blu-ray Disc Java) features such as BONUSVIEW and BD-Live.
HDMI 1.4 CablesThen how do you connect these sources to a 3D display? The Blu-ray 3D format is "display agnostic," in that it does not define the technology used to display the video. The HDMI (High-Definition Multimedia Interface) cable interface was designed to replace the tangle of video and audio cables between TVs and player devices with single digital cable, which can carry uncompressed digital audio and video. The new HDMI 1.4 interface specification then adds support for transmitting common 3D formats and resolutions. (Some interim connections also support pushing the new signals though older HDMI 1.3 interfaces.)
The updated HDMI 1.4 cable format supports 3D video for home movies and gaming. Even better, some 3D video formats can be piggybacked on existing devices like set-top boxes and existing cabling without requiring changing the entire infrastructure.
HDMI Cable TypesHDMI 1.3 included Standard and High Speed cables, 1.4 adds Ethernet versions and Automotive for a total of five HDMI cable types.
References:
3D on PCs - On the DesktopBeyond the TV, you also can enjoy 3D on the PC, for 3D games, and for movies on Blu-ray though updates to DVD player software from companies including CyberLink and Corel. Adding 3D to a PC requires a 3D-compatible display, compatible graphics card, and 3D glasses, such as the 3D Vision system from NVIDIA, starting at $199 for a pair of active LCD shutter glasses plus wireless emitter.
NVIDIA 3D VisionAdding 3D to a PC requires a compatible graphics card with (GPU) chips, plus compatible 3D display or projector and associated 3D glasses. For example, the NVIDIA 3D Vision system uses NVIDIA GeForce GPUs (Graphics Processor Units) for consumer 3D systems, and NVIDIA Quadro systems for design and animation professionals.
Compatible desktop monitors, notebooks, all-in-ones and projectors for NVIDIA 3D Vision include:
YouTube 3D Channel - 3D on the WebThe YouTube 3D Channel features videos stored in a side-by-side video format, which the YouTube player can then play back in a variety of display formats. For 3D video, set the display format using the drop-down 3D menu below the video player (next to the resolution menu). Aquarium 3D Video on YouTube
View with Anaglyph / Colored Glasses YouTube can present 3D videos for several different colors of Anaglyph glasses. Try the black and white (B&W) or optimized options for videos containing strong primary colors. The optimized option balances between color fidelity and a good viewing experience.
View with No Glasses You can also view 3D videos with no glasses by adjusting the focus of your eyes. Relax your gaze or cross your eyes until the two images merge. YouTube warns that this technique takes a little while to get right and isn't recommended for long viewing sessions as it may cause eye strain. You can also view 3D movies in 2D, by simply watching the video for one of the eyes.
Preparing 3D Videos for Uploading to YouTubeTo prepare 3D videos for uploading to YouTube, use a video editing tool to import the left and right videos and combine them together side-by-side into a single frame. For best results, the combined image from the two videos should be 16:9 resolution. This will distort the original frames, but the aspect ratio will be corrected for playback.
References:
Shooting 3D - CamerasCreating 3D ContentSo how do you create your own 3D content? The obvious answer is to use a 3D imaging device -- a 3D digital camera or 3D video camcorder, as shown below. But you can actually get started without needing any new equipment. One nice shortcut is to generate 3D material from your existing 2D media, just as movie studios are converting existing 2D movies into 3D, and some 3D TVs can convert from 2D on the fly.
Or, with some extra work you can shoot 3D with your existing equipment, either by using one camera to do double duty, or by using two cameras. Of course, this requires experimentation with both the setup and kinds of scenes for the best 3D results.
References:
Fujifilm FinePix Real 3D W3 -- 3D Digital CameraThe Fujifilm FinePix Real 3D W3 is a 3D digital camera with two separate 10-megapixel CCD sensors and dual FUJINON 3x optical zoom lenses (35-105mm) that are spaced 75 mm apart to create realistic images that are similar to how human eyes see them. It shoots photos and video in traditional 2D mode, and stereo imagery in 3D mode, up to 720p widescreen HD video. It also uses the two imagers for dual shooting modes, capturing two variants of the same scene, with different colors, zoom, or sensitivities. The W3 is an upgrade to the original W1 3D camera, released in September 2009, adding a larger display, higher-res photos and videos, and Mini-HDMI output. You can preview your shots and review stored photos in 3D directly on the 3.5 inch lenticular LCD display, with no glasses required. The camera stores 3D images in MPO (dual JPEG) format files, and 3D video in 3D-AVI.
Sony 3D Sweep PanoramasSony offers an interesting 3D Sweep Panorama feature for digital still cameras, which automatically stitches together frames in one sweeping motion. It's available as a firmware upgrade to the Sony NEX interchangeable lens cameras, and in the Sony DSC-WX5 and DSC-TX9 CyberShot digital cameras for around $299 and $399 respectively.
Top Panasonic Interchangeable 3D Lens (9/10)Panasonic also has introduced interchangeable lenses for its Mirror-Free DSL Micro Cameras. Instead of requiring a separate 3D camera, this includes two lenses within the screw-in lens mount as an adapter to convert a standard camera into a stereo imager.
Panasonic HDC-SDT750K - 3D CamcorderThe Fujifilm FinePix Real 3D W3 can shoot 3D videos, but the lens adapter approach can be used to adapt a 2D camcorder to 3D. For example, the Panasonic HDC-SDT750 is a 3MOS camcorder with a 3D conversion lens that simultaneously records right- and left-eye images in side-by-side format. It's due in October for $1399.
Professional 3D Production Equipment3D production gear also is becoming available for higher-end professional use. Sony 3D Production SystemsFor example, Sony is offering end-to-end 3D production systems based on professional cameras (with dual-camera rigs), recorders, processors, and monitors.
Panasonic AG-3DA1 Professional Full HD 3D CamcorderAnd the Panasonic AG-3DA1 is the first professional fully-integrated Full HD 3D camcorder, for around $21,000. Related gear includes the BT-3DL2550 3D LCD monitor for field use, and the AG-HMX100, a professional HD digital AV mixer for live 3D event production.
Professional 3D EditingProfessional editing tools are starting to support 3D editing, both directly and though third-party plug-ins. These already have deep support for multi-track and multi-view editing (for example, when merging shots from multiple cameras at an event), and they tend to have architectures that support extension through add-ins, especially for importing and editing new camera and video data formats CineForm Neo3DToday's professional video editing tools already are flexible enough to work with matched pairs of images, especially with the support of third-party add-ins. CineForm NeoHD and Neo3D enable 3D workflows for Adobe, Apple, Avid, and Sony tools on Windows and Macintosh, for around $499 and $2995 respectively. These provide features including stereo convergence and adjustment, 3D display in a variety of formats (anaglyph, frame side-by-side, over-under, line-interleave, and NVIDIA 3D), plus 3D overlays for titles and graphics.
Simple 3D Editing - Sony VegasYou actually can do simple 3D editing without any special support, as described in an earlier Sony whitepaper on Editing 3D in Sony Vegas 9. This shows to edit can edit 3D footage as a grouped pair of tracks with blended anaglyphic color filters.
Sony Vegas 10 - 3D WorkflowSony Vegas 10, released in October 2010, has a well-known legacy as a 32- and 64-bit professional video editor with deep audio support. This new release features full native stereoscopic 3D workflow, to import, adjust, edit, preview and export in 3D without requiring any additional tools or plug-ins. The idea is that working in 3D is as seamless as working in 2D.
Stereoscopic 3D Editing in Sony Vegas Pro 10
Adobe Premiere Pro CS5For more detail, Dave Helmly of Adobe has posted extensive notes on 3D Stereoscopic editing in Adobe Premiere Pro CS5, with a 60 minute video tour of the complete 3D workflow. He shows how to build a stereo rig with two matching cameras, and then import, edit, and export 3D using the 64-bit CineForm plug-ins. The video also covers various ways to view your 3D productions, including directly to consumer 3D TV displays and authoring to Blu-ray Disc.
NVIDIA 3D VisionThe editing setup that Helmly recommends uses the NVIDIA 3D Vision system (see above) with 3D graphics and a compatible NVIDIA GeForce or Quadro graphics card. You then can use a 3D monitor as your primary editing display, plus an optional consumer 3D TV as a secondary output.
Personal 3D Creation SoftwareYes, 3D is coming, However, this will be a gradual process of getting 3D into consumer households, limited by factors including the need for new displays, the dorky glasses, incompatible technologies and products, and competitive approaches to retrofitting 3D into existing delivery paths including broadcast digital television and cable systems. So while 3D won't be a big part of video production in the near term, it can be interesting to experiment with, especially to think about new rules for framing, shooting, cutting, and editing with the added dimension. The good news is that you can find relatively inexpensive approaches for shooting, editing, and even displaying 3D based on your existing gear, by using red/blue anaglyph glasses. And you can think about experimenting with presenting 3D productions to small groups though Blu-ray to a consumer 3D TV, or on a PC display using inexpensive polarized 3D glasses. You can get started with free and low-cost consumer 3D software to view, edit, enhance, and convert your own 3D material. Free 3D ToolsYou can get started working with 3D using free software downloads, including some tools from hardware manufacturers.
Fujifilm MyFinePix Studio (MFPS)Fujifilm offers its MyFinePix Studio software for working with the 3D photos and videos shot with the Fujifilm FinePix Real 3D W3 digital camera (see above). In particular, you can split the combined left and right frames into two separate files.
Stereo Maker - Free 3D ApplicationsThe Stereo Maker site offers an impressive collection of free 3D applications for viewing and editing stereo photos and videos. These support an extensive range of 3D file formats, and 3D display formats for viewing your 3D material. In particular, StereoPhoto Maker offers auto alignment and color correction in addition to manual enhancement tools. And these are also available in batch mode to process, auto align, auto correct, and convert entire folders of files.
StereoPhoto Maker - 3D image editor and viewer
StereoMovie Player - 3D video player
Roxio Creator 2011Roxio Creator 2011, released in August starting at $99, provides a full digital media suite for capturing, editing, creating, and sharing personal 3D photos and videos. The big new addition for 2011 is support for creating 3D productions -- you capture from stereoscopic cameras, import and export 3D videos and photo creations in a wide range of 3D file formats, perform storyboard and timeline editing of 3D material, view then on your computer and online,as well as author 3D-enabled DVDs and Blu-ray Discs. Creator also solves the chicken-and-egg problem of getting content for new technology formats by allowing you to get started without requiring any new hardware displays or cameras -- you can convert existing 2D photos and videos to 3D to add dimension to your existing flat content, and even view 2D videos in 3D in real time, and then view 3D on standard displays with red/blue anaglyph glasses. And to view 3D video, CinePlayer not only plays 3D videos, but it also converts 2D standard-def video to 3D -- in real time. It supports a variety of display formats, including active shutter, line polarized, and anaglyph. You even can adjust the 3D format during playback, including the 3D depth and position.
Roxio Creator 2011 - Create 3D Photos applicationThe Create 3D Photos application, new in Roxio Creator 2011, is designed to import, adjust, and save 3D images in a wide variety of formats. You can create 3D photos from two 3D photos, or convert
Roxio Creator 2011 - VideoWave 3D Video EditingTo work with 3D video, both VideoWave and MyDVD can import video in a variety of 3D formats, as well as convert 2D video to 3D -- to preview, edit, enhance, and author in 3D. However, not all editing options are available in 3D, including stabilization and rotation effects. With MyDVD, you can author 3D DVDs in anaglyph or RealD format, albeit without menus (but with chapters). You even can author 3D in high definition, and burn in HD AVCHD format to a standard DVD, which will play in HD on Blu-ray players. Or upload to YouTube to view online in 3D.
3D Shooting Tips3D Shooting Tips for Photos and VideoShooting in 3D does require different approaches to positing subjects and framing the scene. The idea is to take advantage of the 3D depth, but without over-doing the effect.
3D Shooting Tips for Motion VideoFor shooting video, the camera should be more of an observer in the scene than an active participant moving though the environment.
References:
Sample 3D MaterialsSample 3D materials -- 3D image files and video files -- that you can download and experiment with.
|
|
Panasonic Full HD 3D System 
Find the 
Combining 3D frames for YouTube upload
Sony 3D Sweep Panoramas
Panasonic AG-3DA1
