Decoding and calibration method on focused plenoptic camera

Chunping Zhang; Zhe Ji; Qing Wang

doi:10.1007/s41095-016-0040-x

| Sign up

PDF (12 MB)

Cite

EndNote(RIS) BibTeX

Collect

Submit Manuscript

Show Outline

Figures (17)

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Fig. 9

Tables (4)

Table 1

Table 2

Table 3

Table 4

Research Article | Open Access

Decoding and calibration method on focused plenoptic camera

Chunping Zhang^¹(), Zhe Ji^¹, Qing Wang^¹

1 School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China.

Show Author Information

Abstract

The ability of light gathering of plenoptic camera opens up new opportunities for a wide range of computer vision applications. An efficient and accurate method to calibrate plenoptic camera is crucial for its development. This paper describes a 10-intrinsic-parameter model for focused plenoptic camera with misalignment. By exploiting the relationship between the raw image features and the depth-scale information in the scene, we propose to estimate the intrinsic parameters from raw images directly, with a parallel biplanar board which provides depth prior. The proposed method enables an accurate decoding of light field on both angular and positional information, and guarantees a unique solution for the 10 intrinsic parameters in geometry. Experiments on both simulation and real scene data validate the performance of the proposed calibration method.

Keywords

calibration focused plenoptic camera depth prior intrinsic parameters

References

[1]

Ng,

Digital light field photography. Ph.D. Thesis. Stanford University, 2006.

[2]

Ng,

; Levoy,

; Bredif,

; Duval,

; Horowitz,

; Hanrahan,

Light field photography with a hand-held plenoptic camera. Stanford University Computer Science Tech Report CSTR 2005-02, 2005.

[3]

Georgiev,

T. G.

; Lumsdaine,

Focused plenoptic camera and rendering. Journal of Electronic Imaging Vol. 19, No. 2, 021106, 2010.

Crossref Google Scholar

[4]

Lumsdaine,

; Georgiev,

Full resolution lightfield rendering. Technical Report. Indiana University and Adobe Systems, 2008.

[5]

Lumsdaine,

; Georgiev,

The focused plenoptic camera. In: Proceedings of IEEE International Conference on Computational Photography, 1-8, 2009.

Crossref

[6]

Dansereau,

D. G.

; Pizarro,

; Williams,

S. B.

Decoding, calibration and rectification for lenselet-based plenoptic cameras. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1027-1034, 2013.

Crossref

[7]

Perwaß,

; Wietzke,

Single lens 3D-camera with extended depth-of-field. In: Proceedings of SPIE 8291, Human Vision and Electronic Imaging XVII, 829108, 2012.

Crossref

[8]

Bishop,

T. E.

; Favaro,

Plenoptic depth estimation from multiple aliased views. In: Proceedings of IEEE 12th International Conference on Computer Vision Workshops, 1622-1629, 2009.

Crossref

[9]

Levoy,

; Hanrahan,

Light field rendering. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, 31-42, 1996.

Crossref

[10]

Wanner,

; Fehr,

; Jähne,

Generating EPI representations of 4D light fields with a single lens focused plenoptic camera. In: Lecture Notes in Computer Science, Vol. 6938. Bebis,

; Boyle,

; Parvin,

B. et al.

Eds. Springer Berlin Heidelberg, 90-101, 2011.

[11]

Hahne,

; Aggoun,

; Haxha,

; Velisavljevic,

; Fernández,

J. C. J.

Light field geometry of a standard plenoptic camera. Optics Express Vol. 22, No. 22, 26659-26673, 2014.

Crossref Google Scholar

[12]

Johannsen,

; Heinze,

; Goldluecke,

; Perwaß,

On the calibration of focused plenoptic cameras. In: Lecture Notes in Computer Science, Vol. 8200. Grzegorzek,

; Theobalt,

; Koch,

; Kolb,

Eds. Springer Berlin Heidelberg, 302-317, 2013.

Crossref

[13]

Georgiev,

; Lumsdaine,

; Goma,

Plenoptic principal planes. Imaging Systems and Applications, OSA Technical Digest (CD), paper JTuD3, 2011.

[14]

Hahne,

; Aggoun,

; Velisavljevic,

The refocusing distance of a standard plenoptic photograph. In: Proceedings of 3DTV-Conference: The True Vision—Capture, Transmission and Display of 3D Video, 1-4, 2015.

Crossref

[15]

Birklbauer,

; Bimber,

Panorama light-field imaging. Computer Graphics Forum Vol. 33, No. 2, 43-52, 2014.

Crossref Google Scholar

[16]

Bok,

; Jeon,

H.-G.

; Kweon,

I. S.

Geometric calibration of micro-lens-based light-field cameras using line features. In: Lecture Notes in Computer Science, Vol. 8694. Fleet,

; Pajdla,

; Schiele,

; Tuytelaars,

Eds. Springer International Publishing, 47-61, 2014.

[17]

Thomason,

C. M.

; Thurow,

B. S.

; Fahringer,

T. W.

Calibration of a microlens array for a plenoptic camera. In: Proceedings of the 52nd Aerospace Sciences Meeting, AIAA SciTech, AIAA 2014-0396, 2014.

Crossref

[18]

Zhang,

A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 22, No. 11, 1330-1334, 2000.

Crossref Google Scholar

[19]

Cho,

; Lee,

; Kim,

; Tai,

Y.-W.

Modeling the calibration pipeline of the Lytro camera for high quality light-field image reconstruction. In: Proceedings of IEEE International Conference on Computer Vision, 3280-3287, 2013.

Crossref

[20]

Sabater,

; Drazic,

; Seifi,

; Sandri,

; Perez,

Light-field demultiplexing and disparity estimation. 2014. Available at https://hal.archives-ouvertes.fr/hal-00925652/document.

Computational Visual Media

Volume 2 Issue 1,
March 2016

Pages 57-69

DOI: 10.1007/s41095-016-0040-x

Cite this article:

Zhang C, Ji Z, Wang Q. Decoding and calibration method on focused plenoptic camera. Computational Visual Media, 2016, 2(1): 57-69. https://doi.org/10.1007/s41095-016-0040-x

Parameter	Ground truth	Calibration
$θ (^{\circ})$	0.3000	0.2998
$β (^{\circ})$	0.1500	0.1493
$γ (^{\circ})$	0.1000	0.0997
$(x_{m}, y_{m}) (mm)$	0.7200, 0.6300	1.5030, $- 4.5009$
$(L, l) (mm)$	67.3168, 3.3162	67.1861, 3.3096
$(u_{0}, v_{0}) (pixel)$	$- 1326.0, - 2000.0$	$- 1337.4, - 1999.7$
$F (mm)$	50.0000	50.02558

Parameter	Dataset 1	Dataset 2	Dataset 3
$P r_{dp} (mm)$	80.80	80.80	80.80
$P r_{sc} (mm)$	28.57	28.57	28.57
$A n g l e$ ( $^{\circ}$ )	175.8386	151.9994	139.5982
$θ (^{\circ}$ )	0.3978	0.3978	0.3978
$β$ ( $^{\circ}$ )	$- 0.0616$	$- 0.0615$	$- 0.0616$
$γ$ ( $^{\circ}$ )	0.1377	0.1377	0.1378
$x_{m}$ (mm)	0.0300	0.0299	0.0302
$y_{m}$ (mm)	$- 0.0341$	$- 0.0344$	$- 0.0343$
$L$ (mm)	67.8059	67.7860	67.8109
$l$ (mm)	2.1215	2.1209	2.1217
$u_{0}$ (pixel)	$- 12.0622$	$- 12.0623$	$- 12.0620$
$v_{0}$ (pixel)	$- 17.9686$	$- 17.9689$	$- 17.9688$
$F$ (mm)	54.1801	53.9759	54.1841

State	Std (pixel)	Range (pixel)
No deviation	0.053281	0.38697
Calibrated	0.040079	0.25109

State	Std (pixel)	Range (pixel)
No deviation	1.1145	0.042755
Calibrated	0.87151	0.034322