Empirical Rate-Distortion Analysis of JPEG2000 3D and H.264/AVC Coded Integral-Imaging-Based 3D Images

Roger Olsson

Abstract

Novel camera systems producing 3D-images containing light direction in addition to light intensity is emerging. Integral imaging (II) is a technique on which many of these systems rely. The pictures produced by these cameras (II-pictures) are space-requiring in terms of data storage compared to their 2D counterparts. This paper investigates how coding the II-pictures using H.264/AVC and JPEG 2000 Part 10 (JP3D) affect the images in terms of rate-distortion as well as introduced coding artifacts. A set of four reference images are coded using a number of pre-processing and encoding variants, so called coding schemes. For low bitrates (<0.5bpp) the H.264/AVC-based coding schemes have higher coding efficiency, which asymptotically level of at higher bitrates in favor of JP3D. The JP3D coded 3D-images show less spread in quality than H.264/AVC, when quality is evaluated using PSNR as a function of viewing angle. However, the distortion induced by H.264/AVC is primarily localized to object boarders within the 3D-image, which in initial tests appear less visible than the JP3D coding artifacts that spread out evenly over the image. Extensive subjective tests will be performed in future work to further support the presented results.

Supplemental results

RD-graphs

(a) Apples	(b) Cuboid
(c) Twins	(d) Car
Figure 1.   Rate-distortion graphs for all coding schemes applied to (a) Apples, (b) Cuboid, (c) Twins, and (d) Car.

Stereoscopic views (for cross-eyed viewing) corresponding to a global PSNR = 28 dB

(a) AVC (EI) @ 0.08bpp	(b) AVC (SI) @ 0.13 bpp
(c) JP3D (EI) @ 0.17 bpp	(d) JPEG 2000 @ 0.35 bpp
Figure 2. Stereoscopy view pairs from II-picture Apples (right and left eye image)

(a) AVC (EI) @ 0.11 bpp	(b) AVC (SI) @ 0.30 bpp
(c) JP3D (EI) @ 0.27 bpp	(d) JPEG 2000 @ 0.39 bpp
Figure 3.  Stereoscopy view pairs from II-pictures Twins (right and left eye image)

(a) AVC (EI) @ 0.56 bpp	(b) AVC (SI) @ 0.49 bpp
(c) JP3D (EI) @ 0.80 bpp	(d) JPEG 2000 @ 1.63 bpp
Figure 4.  Stereoscopy view pairs from II-pictures Car (right and left eye image)

(a) AVC (EI) @ 8.00 bpp	(b) ACV (SI) @ 3.00 bpp
(c) JP3D (EI) @ 3.83 bpp	(d) JPEG 2000 @ 4.03 bpp
Figure 5.  Stereoscopy view pairs from II-pictures Cuboid (right and left eye image)

Publication