Color enhanced pipelines for reality-based 3D modeling of on site medium sized archeological artifacts

Fabrizio I. Apollonio, Massimo Ballabeni, Marco Gaiani

Abstract

The paper describes a color enhanced processing system - applied as case study on an artifact of the Pompeii archaeological area - developed in order to enhance different techniques for reality-based 3D models construction and visualization of archaeological artifacts. This processing allows rendering reflectance properties with perceptual fidelity on a consumer display and presents two main improvements over existing techniques: a. the color definition of the archaeological artifacts; b. the comparison between the range-based and photogrammetry-based pipelines to understand the limits of use and suitability to specific objects.

Keywords

3D modeling; Photogrammetry; Laser scanner; Dense stereo matching; Color processing; Color definition

Full Text:

PDF

References

AGISOFT PHOTOSCAN (2014), http://www.agisoft.ru.

ALLEN P., FEINER S., et al. (2004): “Seeing into the past: Creating a 3D modeling pipeline for archaeological visualization”, in Proceedings of 3DPVT ‘04, 2004, pp. 751-758.

BERALDIN J.-A., PICARD M., et al. (2002): “Virtualizing a byzantine crypt by combining high-resolution textures with laser scanner 3D data”, in Proceedings of VSMM 2002, pp. 3-14.

BERNARDINI F., RUSHMEIER H. (2000): “The 3D model acquisition pipeline”, in Eurographics 2000 State of the Art Reports.

BLAIS F. (2004): “A review of 20 years of Range Sensors Development”, in Journal of Electronic Imaging, Vol. 13, N. 1, pp. 231–40. http://dx.doi.org/10.1117/1.1631921

BLAIS F., BERALDIN J.A. (2006): “Recent Developments in 3D Multi-modal Laser Imaging Applied to Cultural Heritage, in Machine Vision and Applications, Vol. 17, N. 6, pp. 395-409. http://dx.doi.org/10.1007/s00138-006-0025-3

BOEHLER W. (2005): “Comparison of 3D scanning and other 3D measurement techniques”, in Baltsavias E., Gruen, A., et al. (eds), Recording, Modeling and Visualization of Cultural Heritage, Taylor & Francis.

BOOCHS F., BENTKOWSKA-KAFEL A., et al. (2013): “Towards optimal spectral and spatial documentation of Cultural Heritage. COSCH – an interdisciplinary action in the COST framework”, in ISPRS Arch., Vol. XL-5/W2, 2013, pp. 109-113. https://doi.org/10.5194/isprsarchives-XL-5-W2-109-2013

CALLIERI M., CIGNONI P., et al. (2008): “Masked photo blending: mapping dense photographic dataset on high-resolution 3D models”, in Computer & Graphics, Vol. 32, N. 4, 2008, pp. 464 - 473. https://doi.org/10.1016/j.cag.2008.05.004

CALLIERI M., DELLEPIANE M., et al. (2011): “Processing Sampled 3D Data: Reconstruction and Visualization Technologies”, in F. Stanco, S. Battiato, G. Gallo (eds.), Digital Imaging for Cultural Heritage Preservation: Analysis, Restoration and Reconstruction of Ancient Artworks, Taylor and Francis, pp. 105-136.

CORSINI M., DELLEPIANE M., et al. (2009):“Image-to-geometry registration: a mutual information method exploiting illumination-related geometric properties”, in Computer Graphics Forum, Vol. 28, N. 7, 2009, pp. 1755–1764. http://dx.doi.org/10.1111/j.1467-8659.2009.01552.x

DANA K.J., VAN GINNEKEN B., et al.. (1999): “Reflectance and texture of real-world surfaces”, in ACM Transaction on Graphics, Vol. 18, N. 1, 1999, pp. 1-34. http://dx.doi.org/10.1145/300776.300778

DE LUCA L., VERON P., FLORENZANO M. (2006): “Reverse engineering of architectural buildings based on a hybrid modeling approach”, Computer & Graphics, Vol. 30, N. 2, pp. 160–76. http://dx.doi.org/10.1016/j.cag.2006.01.020

DEBEVEC P. et al. (2004): “Estimating surface reflectance properties of a complex scene under captured natural illumination”, in USC ICT Technical Report ICT-TR, 06/2004.

DELLEPIANE M., MARROQUIM R., et al. (2012): “Flow-Based Local Optimization for Image-to-Geometry Projection”, in IEEE Transactions on Visualization and Computer Graphics, Vol. 18, N. 3, 2012, pp. 463-474. http://dx.doi.org/10.1109/TVCG.2011.75

DELLEPIANE M., DELL’UNTO N., et al. (2013a): “Archeological excavation monitoring using dense stereo matching techniques”, in Journal of Cultural Heritage, Vol. 14, N. 3, 2013, pp. 201-210. http://dx.doi.org/10.1016/j.culher.2012.01.011

DELLEPIANE M., SCOPIGNO R. (2013b): “Global refinement of image-to-geometry registration for color projection”, in DigitalHeritage 2013 Proceedings, 2013, Vol. 1, pp. 39-46. https://doi.org/10.1109/DigitalHeritage.2013.6743711

DXO (2014), http://www.dxo.com/intl/photography/dxo-optics-pro/

EL-HAKIM S.F., BRENNER C., ROTH G. (1998): “A multi-sensor approach to creating accurate virtual environments”, in ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 53, N. 6, pp. 379–391. http://dx.doi.org/10.1016/S0924-2716(98)00021-5

EL-HAKIM S.F., BERALDIN J.-A., et al. (2004): “Detailed 3D reconstruction of large-scale heritage sites with integrated techniques”, in Computer Graphics and Applications, Vol. 24, N. 3, 2004, pp. 21-29. http://dx.doi.org/10.1109/MCG.2004.1318815

EL-HAKIM S.F., BERALDIN J.-A. (2007): “Sensor integration and visualization”, in Fryer, Mitchell & Chandler (eds.), Applications of 3D Measurement from Images, Whittles Publishing, pp. 259–298.

ENGLISH HERITAGE (2005): Metric Survey Specifications for English Heritage. English Heritage Report.

ENGLISH HERITAGE (2011), 3D Laser Scanning for Heritage (second edition), English Heritage Publishing.

FURUKAWA Y., PONCE J. (2010): “Accurate, dense, and robust multi-view stereopsis”, in IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 32, N. 8, pp. 1362–1376. http://dx.doi.org/10.1109/TPAMI.2009.161

GAIANI M., MICOLI L.L. (2005): “A framework to build and visualize 3D models from real world data for historical architecture and archaeology as a base for a 3D information system”, in Forte M. (a cura di), The reconstruction of Archaeological Landscapes through Digital Technologies, BAR International series, 1379, pp. 103-125.

GAIANI M., ROSSI M., RIZZI A. (2003): “Percezione delle immagini virtuali”, in M. Gaiani (ed.), Metodi di Prototipazione Digitale e Visualizzazione per il Disegno Industriale, l’Architettura degli Interni e i Beni Culturali, Polidesign, Milano, 2003.

GAIANI M., BENEDETTI B., REMONDINO F. (eds) (2010): Modelli digitali 3D in archeologia: il caso di Pompei, Edizioni della Normale, Pisa, 2010.

GAŠPAROVIC M., MALARIC I. (2012): “Increase of readability and accuracy of 3D models using fusion of Close Range Photogrammetry and Laser Scanning”, in ISPRS Arch. Photogramm. Remote Sens., Vol. XXXIX-B5, pp. 93-98. https://doi.org/10.5194/isprsarchives-XXXIX-B5-93-2012

GODIN G., BORGEAT L., et al. (2010): “Issues in Acquiring, Processing and Visualizing Large and Detailed 3D Models”, in Information Sciences and Systems (CISS), 44th Annual Conference on, pp.1-6. http://dx.doi.org/10.1109/ciss.2010.5464966

GONIZZI BARSANTI S., MICOLI L.L., GUIDI G. (2013a): “Quick textured mesh generation for massive 3D digitization of museum artifacts”, in DigitalHeritage 2013, Vol. 1, pp. 197-200. https://doi.org/10.1109/DigitalHeritage.2013.6743732

GONIZZI BARSANTI S., REMONDINO F., VISINTINI D. (2013b): “3D surveying and modeling of archaeological sites – some critical issues”, in ISPRS Ann. Photogramm. Remote Sens., Vol. II-5/W1, 2013, pp. 145-150. https://doi.org/10.5194/isprsannals-II-5-W1-145-2013

GRUSSENMEYER P., LANDES T., et al. (2008): “Comparison methods of terrestrial laser scanning, photogrammetry and tacheometry data for recording of cultural heritage buildings”, in ISPRS Arch. Photogramm. Remote Sens., Vol. XXXVII/W5, pp. 213-218.

GUARNIERI A., REMONDINO F., VETTORE A. (2006): “Digital photogrammetry and TLS data fusion applied to Cultural Heritage 3D modeling”, in ISPRS Arch., Vol. XXXVI/W6, pp. 6.

HAPPA J., BASHFORD-ROGERS T., et al. (2012): “Cultural Heritage Predictive Rendering”, in Computer Graphics Forum, Vol. 31, N. 6, 2012, pp. 1823–1836. http://dx.doi.org/10.1111/j.1467-8659.2012.02098.x

HIRSCHMÜLLER H. (2005): “Accurate and efficient stereo processing by semi-global matching and mututal information”, in CVPR 2005 proceedings, Vol. 2, pp. 807-814.

HIRSCHMUELLER H. (2008): “Stereo processing by semi- global matching and mutual information”, in IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, N. 2, pp. 328-41. http://dx.doi.org/10.1109/TPAMI.2007.1166

KARSIDAG G., ALKAN R.M. (2012): “Analysis of The Accuracy of Terrestrial Laser Scanning Measurements”, in FIG Working Week 2012 - Knowing to manage the territory, protect the environment, evaluate the cultural heritage proceedings, TS07A - Laser Scanners I, 6097.

KAWAKAMI R., IKEUCHI K., TAN R.T. (2005): “Consistent surface color for texturing large objects in outdoor scenes”, in ICCV 2005 proceedings, Vol. 2, 2005, pp. 1200-1207.

IMATEST (2014), http://www.imatest.com/home

IMAGENOMIC LLC (2012): Noiseware 5 Plug-In User's Guide, 2012

INNOVMETRIC POLYWORKS (2014): http://www.innovmetric.com/polyworks/Surveying/

LENSCH H.P.A., KAUTZ J., et al. (2003): “Image-based reconstruction of spatial appearance and geometric detail”, in ACM Trans. Graph., Vol. 22, N. 2, 2003, pp. 234–257. http://dx.doi.org/10.1145/636886.636891

LOWE D. (2004): “Distinctive image features from scale-invariant keypoints”, in IJCV, Vol. 60, N. 2, 2004, pp. 91-110. https://doi.org/10.1023/B:VISI.0000029664.99615.94

MESHLAB (2014): http://meshlab.sourceforge.net/

MUDGE M., SCHROER C., et al. (2010): “Principles and Practices of Robust, Photography based Digital Imaging Techniques for Museums”, in VAST 2010 Proceedings, 2010, pp. 111-137.

NICODEMUS F. (1965): “Directional reflectance and emissivity of an opaque surface”, in Applied Optics, Vol. 4, N. 7, 1965, pp. 767–775. http://dx.doi.org/10.1364/AO.4.000767

OPENGL (2014): http://www.opengl.org

PASCALE D. (2006): “RGB coordinates of the Macbeth ColorChecker”, in Technical report, The BabelColor Company, Jun 2006.

PETROSYAN A., GHAZARYAN A. (2006): “Method and System for Digital Image Enhancement”, in US Patent Application, #11/116, 408, 2006.

PIERROT-DESEILLIGNY M., PAPARODITIS N. (2006): A multiresolution and optimization-based image matching approach: an application to surface reconstruction from SPOT5-HRS stereo imagery, in ISPRS Arch., Vol. XXXVI-1/W41.

PIETRONI N., TARINI M., CIGNONI P. (2010): “Almost isometric mesh parameterization through abstract domains”, in IEEE Trans. on Visualization and Computer Graphics, Vol. 16, N. 4, 2010, pp. 621-635. http://dx.doi.org/10.1109/TVCG.2009.96

REINHARD E., ARIF KHAN E., OGUZ AKYÜZ A., JOHNSON G. (2008): Color Imaging Fundamentals and Applications, A. K. Peters, Wellesley. https://doi.org/10.1201/b10637

REMONDINO F., EL-HAKIM S. (2006): “Image-based 3D modelling: a review”, in The Photogrammetric Record, Vol. 21, N.115, 2006, pp. 269–291. http://dx.doi.org/10.1111/j.1477-9730.2006.00383.x

REMONDINO F., CAMPANA S., (eds.) (2014): 3D Recording and Modelling in Archaeology and Cultural Heritage, BAR International Series 2598, Archaeopress.

REMONDINO F., GUARNIERI A., VETTORE A. (2005): “3D modeling of close-range objects: photogrammetry or laser scanning?”, in Procceedings of Videometrics VIII, SPIE-IS&T Electronic Imaging, Vol. 5665, pp. 216-225. http://dx.doi.org/10.1117/12.586294

REMONDINO F., EL-HAKIM S., et al. (2008a): “Development and performance analysis of image matching for detailed surface reconstruction of heritage objects”, in IEEE Signal Processing Magazine, Vol. 25, N.4, pp. 55-65. http://dx.doi.org/10.1109/MSP.2008.923093

REMONDINO F., EL-HAKIM S., GRUEN A., ZHANG L. (2008b): “ Turning images into 3D models - Development and performance analysis of image matching for detailed surface reconstruction of heritage objects”, in IEEE Signal Processing Magazine, Vol. 25, N.4, 2008, pp. 55-65. http://dx.doi.org/10.1109/MSP.2008.923093

REMONDINO F., et al. (2012): “Low-Cost and Open-Source Solutions for Automated Image Orientation - A Critical Overview”, in Euromed 2012 Proceedings, pp. 40-54. http://dx.doi.org/10.1007/978-3-642-34234-9_5

RUSHMEIER H., BERNARDINI F. (1999): “Computing consistent normals and colors from photometric data,” in 3DIM 1999 proceedings, pp. 99–108. http://dx.doi.org/10.1109/im.1999.805339

SANTOPUOLI N., SECCIA L. (2008): “Il rilievo del colore nel campo dei beni culturali”, in Trattato di Restauro Architettonico, UTET, 2008, Vol. X, pp. 141-163.

SCOPIGNO R., CALLIERI M., et al. (2011): “3D Models for Cultural Heritage: Beyond Plain Visualization”, in Computer , Vol. 44, N. 7, pp. 48-55. https://doi.org/10.1109/MC.2011.196

SCHWARTZ C., WEINMANN M., RUITERS R., KLEIN R. (2011): “Integrated High-Quality Acquisition of Geometry and Appearance for Cultural Heritage”, in VAST 2011 Proceedings, 2011, pp. 25-32.

SEITZ S.M., et al. (2006): “A comparison and evaluation of multi-view stereo reconstruction algorithms”, in CVPR Proceedings, Vol. 1, 2006, pp. 519–528. http://dx.doi.org/10.1109/cvpr.2006.19

SINHA S.N., POLLEFEYS M. (2005): “Multi-view reconstruction using photo-consistency and exact silhouette constraints: a maximum-flow formulation”, in Proc. 10th ICCV, pp. 349-356. http://dx.doi.org/10.1109/iccv.2005.159

STAMOS I., LIU L., et al. (2008): “Integrating automated range registration with multiview geometry for the photorealistic modelling of large-scale scenes”, in International Journal of Computer Vision Vol. 78, N. 2-3, pp. 237-60. http://dx.doi.org/10.1007/s11263-007-0089-1

STUMPFEL J., TCHOU C., et al. (2003): “Digital reunification of the Parthenon and its sculptures”, in Proceedings of Virtual Reality, Archaeology and Cultural Heritage (VAST) 2003, pp. 41–50.

TOMASI C., KANADE T. (1992): “Shape and motion from image streams under orthography - a factorization method”, in IJCV, Vol. 9, N. 2, 1992, pp. 137-154. https://doi.org/10.1007/BF00129684

TROCCOLI A., ALLEN P.K. (2005): “Relighting acquired models of outdoor scenes”, in 3DIM 2005 proceedings, pp. 245-252. http://dx.doi.org/10.1109/3dim.2005.69

VOSSELMAN G., MAAS H. (2010): Airborne and Terrestrial Laser Scanning, CRC Press.

VOGIATZIS G., HERNANDEZ C., et al. (2007): “Multi-view stereo via volumetric graph-cuts and occlusion robust photo-consistency”, in IEEE Trans. PAMI, Vol. 29, N. 12, pp. 2241-2246. http://dx.doi.org/10.1109/TPAMI.2007.70712

VU H.H., LABATUT P., et al. (2012): “High accuracy and visibility-consistent dense multiview stereo”, in IEEE Trans. PAMI, Vol. 34, N. 5, pp. 889-901. http://dx.doi.org/10.1109/TPAMI.2011.172

WENZEL K., ABDEL-WAHAB M., et al., (2012): “High-Resolution Surface Reconstruction from Imagery for Close Range Cultural Heritage Applications”, in ISPRS Arch., Vol. XXXIX-B5, pp. 133-138. https://doi.org/10.5194/isprsarchives-XXXIX-B5-133-2012

WU C. (2013): “Towards Linear-Time Incremental Structure from Motion”, in 3D Vision, 2013 International Conference on, 2013, pp.127-134. http://dx.doi.org/10.1109/3dv.2013.25

XU C., A. GEORGHIADES S., et al. (2006): “A System for Reconstructing Integrated Texture Maps for Large Structures”, in 3DPVT'06 proceedings, 2006, pp.822-829. https://doi.org/10.1109/3DPVT.2006.22

YU Y., MALIK J. (1998): “Recovering photometric properties of architectural scenes from photographs”, in SIGGRAPH ‘98 proceedings, 1998, pp. 207–217. https://doi.org/10.1145/280814.280874

ZHANG L. (2005): “Automatic Digital Surface Model (DSM) generation from linear array images”, Ph.D. Thesis, Institute of Geodesy and Photogrammetry, ETH Zurich, Switzerland.

ZHAO X., ZHOU Z., WU W. (2012): “Radiance-based color calibration for image-based modeling with multiple cameras”, in Science China Information Sciences, Vol. 55, N. 7, 2012, pp. 1509-1519. https://doi.org/10.1007/s11432-011-4467-5

Abstract Views

1318
Metrics Loading ...

Metrics powered by PLOS ALM

Refbacks

  • There are currently no refbacks.




Creative Commons License

This journal is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Universitat Politècnica de València

Official journal of Spanish Society of Virtual Archaeology

e-ISSN: 1989-9947   https://dx.doi.org/10.4995/var