Workstation on SourceForge under a BSD license (available
from SourceForge,
/
)
to encourage other stereo researchers to use and modify our
system for their own evaluation.
The experiments reported in this paper focused on plan-
etary images. It would be straightforward to apply this method
and our StereoWS to any future stereo research projects when
any quantitative evaluation is required, wherever it is on Mars
or the Earth or anywhere else for that matter. In the future, we
hope our efforts could also benefit the stereo correspondence
evaluation work and include more datasets, in particular the
results from a wider variety of general stereo. Also, we expect
that the same idea behind StereoWS could be applied to de-
velop a more intuitive and immersive stereo measurement sys-
tem using recent virtual reality technologies. In conjunction
with the stereo measurement workshop held in 2011, we can
provide the possibility of evaluation of these stereo matching
results including more methods from our collaborators.
As for future work, it is also interesting to investigate the
performance of manual measurements from different lighting
conditions (Kirk
et al
., 2016). We could measure the varia-
tion of human depth perception under different illumination
effects and reflect this in Equation 5 to define more accurate
metrics. However, this is currently beyond our research scope
and left for the future work.
Acknowledgments
Many thanks to our collaborators, Gerhard Paar and Ben
Huber from
JR
, and Bob Deen from
JPL
for their provision of
their disparity results. Thanks also to Oleg Pariser and Bob
Deen for sharing their opensource JADIS library which helped
jump-start our work. This research was supported as part of
the EU FP-7 PRoVisG project (218814). Partial support was
provided to JPM under the STFC Consolidated grant to
MSSL
,
ST/K000977/1.
References
Azari, H., I. Cheng, and A. Basu, 2009. Stereo 3D mouse (S3D-
mouse): Measuring ground truth for medical data in a virtual 3D
space,
Proceedings of the Engineering in Medicine and Biology
Society, EMBC
, Annual International Conference of the IEEE, pp.
5744–5747.
Birchfield, S., and C. Tomasi, 1998. Depth discontinuities by pixel-to-
pixel stereo,
Proceedings of the Sixth International Conference
on Computer Vision, 1998
, pp. 1073–1080.
Boykov, Y., O. Veksler, and R. Zabih, 2001. Fast approximate energy
minimization via graph cuts,
IEEE Transactions on Pattern
Analysis and Machine Intelligence
, 23, pp. 1222–1239.
Chan, H.-P., M.M. Goodsitt, L.M. Hadjiiski, J.E. Bailey, K. Klein, K.L.
Darner, and B. Sahiner, 2003. Effects of magnification and zooming
on depth perception in digital stereomammography: An observer
performance study,
Physics in Medicine and Biology
, 48:3721.
Day, T., and J.-P. Muller, 1989. Digital elevation model production by
stereo-matching spot image-pairs: A comparison of algorithms,
Image and Vision Computing
, 7:95–101.
Deen, R.G., and J.J. Lorre, 2005. Seeing in three dimensions:
Correlation and triangulation of Mars exploration rover imagery,
Systems,
Proceedings of the IEEE International Conference on
Man and Cybernetics
, 2005, pp. 911–916).
Di, K., and R. Li, 2004.. CAHVOR camera model and its
photogrammetric conversion for planetary applications, 109.
Fleet, D.J., H. Wagner, and D.J. Heeger, 1996. Neural encoding of
binocular disparity: Energy models, position shifts and phase
shifts,
Vision Research
, 36:1839–1857.
Geiger, A., P. Lenz, and R. Urtasun, 2012. Are we ready for
autonomous driving?, The KITTI vision benchmark suite,
IEEE
Conference on Computer Vision and Pattern Recognition (CVPR),
2012
, pp. 3354–3361.
Geman, S., and D. Geman, 1984. Stochastic relaxation, Gibbs
distributions, and the Bayesian restoration of images,
IEEE
Transactions on Pattern Analysis and Machine Intelligence
,
6:721–741.
Gruen, A., 1985. Adaptive least squares correlation: A powerful image
matching technique,
South African Journal of Photogrammetry,
Remote Sensing and Cartography
, 14:175–187.
Hannah, M.J., 1974.
Computer Matching of Areas in Stereo Images
,
Ph.D. thesis, Stanford University, California, 13
Hirschmuller, H.,2008. Stereo processing by semiglobal matching and
mutual information, IEEE
Transactions on Pattern Analysis and
Machine Intelligence
, 30:328–341.
Jaumann, R., G. Neukum, T. Behnke, T.C. Duxbury, K. Eichentopf, J.
Flohrer, S. Gasselt, B. Giese, K. Gwinner,E. Hauber, H. Hoffmann,
A.Hoffmeister, U.Köhler, K. D.Matz, T.B.McCord, V.Mertens,
J.Oberst, R.Pischel, and M.Wählisch,2007. The high-resolution
stereo camera (HRSC) experiment on mars express: Instrument
aspects and experiment conduct from interplanetary cruise through
the nominal mission,
Planetary and Space Science
, 55:928–952.
Jensen, R., A. Dahl, G. Vogiatzis, E. Tola, E., and H. Aanæs, 2014. Large
scale multi-view stereopsis evaluation,
2014 IEEE Conference on
Computer Vision and Pattern Recognition
, pp. 406–413.
Kirk, R., E. Howington-Kraus, T. Hare, and L. Jorda, 2016. The effect
of illumination on stereo DTM quality: Simulations in support of
Europa exploration, I
SPRS Annals of Photogrammetry, Remote
Sensing and Spatial Information Sciences
, 3.
Lhuillier, M., and L. Quan, 2002. Match propagation for image-based
modeling and rendering,
IEEE Transactions on Pattern Analysis
and Machine Intelligence
, 24:1140–1146.
Lowe, D.G., 2004. Distinctive image features from scale-invariant
keypoints,
International Journal of Computer Vision
, 60:91–110.
Morales, S., and R. Klette, 2011). Ground truth evaluation of stereo
algorithms for real world applications,
Computer Vision-ACCV
2010 Workshops
, Springer, pp. 152–162).
Nakamura, Y., T. Matsuura, K. Satoh, and Y. Ohta, 1996). Occlusion
detectable stereo-occlusion patterns in camera matrix,
Proceedings
of CVPR’96, IEEE Computer Society Conference on Computer
Vision and Pattern Recognition
, 1996. Proceedings CVPR’.
Otto, G.P., and T.K. Chau, 1989. ‘Region-growing’ algorithm for
matching of terrain images,
Image and Vision Computing
,
7:83–94.
Pariser, O., and R.G. Deen, 2009. A common interface for stereo
viewing in various environments,
IS&T SPIE Electronic
Imaging
, International Society for Optics and Photonics, pp.
72371R–72371R.
Scharstein, D., and R. Szeliski, 2002. A taxonomy and evaluation of
dense two-frame stereo correspondence algorithms,
International
Journal of Computer Vision
, 47:7–42.
Scharstein, D., and R. Szeliski, 2003. High-accuracy stereo depth
maps using structured light,
Proceedings of the 2003 IEEE
Computer Society Conference on Computer Vision and Pattern
Recognition
, 2003, IEEE, Volume 1.
Scharstein, D., R. Szeliski, and R. Zabih, 2001. A taxonomy and
evaluation of dense two-frame stereo correspondence algorithms,
Proceedings of the IEEE Workshop on Stereo and Multi-Baseline
Vision
, pp. 131–140).
Seitz, S.M., B. Curless, J. Diebel, D. Scharstein, and R. Szeliski,
2006. A comparison and evaluation of multi-view stereo
reconstruction algorithms,
Proceedings of the IEEE Computer
Society Conference on Computer Vision and Pattern Recognition
,
2006, 1:519–528).
Shin, D., J. Muller, and W. Poole, 2011. Open source software tools
for joint ESA-NASA Mars exploration developed in the EU-FP7
PRoVisG project,
Proceedings of the Royal Astronomical Society
,
Aurora Meeting.
Simioni, E., V. Da Deppo, G. Naletto, G. Cremonese, and C. Re, 2014.
Stereo camera for satellite application: A new testing method,
Metrology for Aerospace (MetroAeroSpace)
, IEEE, pp. 582–587).
Sun, J., N.-N. Zheng, and H.-Y. Shum, 2003. Stereo matching using
belief propagation,
IEEE Transactions on Pattern Analysis and
Machine Intelligence
, 25:787–800.
PHOTOGRAMMETRIC ENGINEERING & REMOTE SENSING
March 2018
167
