3D RECONSTRUCTION OF A SCENE FROM MULTIPLE 2D IMAGES
Keywords:
Multiple Views, Structure From Motion, Augmented RealityAbstract
Computer vision and augmented reality industry focus on reconstructing 3D view of an object for the purpose of improvising the visual effect. There are various applications which are in need of 3D Models like street views, film industry, game industry etc. The 3D Models cannot be directly captured using video or still cameras. The cameras have the capability to acquire high quality 2D images at various angles. Our paper focuses on identifying the feature points from 2D image acquired from calibrated camera and reconstructing those features using depth analysis to obtain the 3D view of the object or image. The final obtained 3D view would be a dense reconstruction of the input 2D Image. This reconstruction methodology is less complex when compared to traditional mathematical modelling techniques. The methodology could be easily incorporated into any application domain like surveillance in the form of facial reconstruction of 3D.
References
Bregler, Christoph, Aaron Hertzmann, and Henning Biermann. "Recovering non-rigid 3D shape from image streams." Computer Vision and Pattern Recognition, 2000. Proceedings. IEEE Conference on. Vol. 2. IEEE, 2000.
Brand, Matthew. "Morphable 3D models from video." Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on. Vol. 2. IEEE, 2001.
Xiao, Jing, Jin-xiang Chai, and Takeo Kanade. "A closed-form solution to non-rigid shape and motion recovery." Computer Vision-ECCV 2004. Springer Berlin Heidelberg, 2004. 573-587.
Brand, Matthew. "A direct method for 3D factorization of nonrigid motion observed in 2D." Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on. Vol. 2. IEEE, 2005.
Maruyama, Minoru, and Satoshi Kurumi. "Bidirectional optimization for reconstructing 3D shape from an image sequence with missing data." Image Processing, 1999. ICIP 99. Proceedings. 1999 International Conference on. Vol. 3. IEEE, 1999.
Torresani, Lorenzo, et al. "Tracking and modeling non-rigid objects with rank constraints." Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on. Vol. 1. IEEE, 2001.
Julià, Carme, et al. "Factorization with missing and noisy data." Computational Science– ICCS 2006. Springer Berlin Heidelberg, 2006. 555-562.
Guerreiro, Rui FC, and Pedro MQ Aguiar. "3D structure from video streams with partially overlapping images." Image Processing. 2002. Proceedings. 2002 International Conference on. Vol. 3. IEEE, 2002.
Torresani, Lorenzo, Aaron Hertzmann, and Christoph Bregler. "Learning non-rigid 3d shape from 2d motion." Advances in Neural Information Processing Systems. 2003.
Torresani, Lorenzo, Aaron Hertzmann, and Christoph Bregler. "Nonrigid structure-frommotion: Estimating shape and motion with hierarchical priors." Pattern Analysis and Machine Intelligence, IEEE Transactions on 30.5 (2008): 878-892.
Buchanan, Aeron M., and Andrew W. Fitzgibbon. "Damped newton algorithms for matrix factorization with missing data." Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on. Vol. 2. IEEE, 2005.
Morgan, Aeron Buchanan. Investigation into matrix factorization when elements are unknown. Technical report, Visual Geometry Group, Department of Engineering Science, University of Oxford, 2004.
Del Bue, Alessio, Fabrizio Smeraldi, and Lourdes Agapito. "Non-rigid structure from motion using non-parametric tracking and non-linear optimization." Computer Vision and Pattern Recognition Workshop, 2004. CVPRW'04. Conference on. IEEE, 2004.
Olsen, Søren I., and Adrien Bartoli. "Using Priors for Improving Generalization in NonRigid Structure-from-Motion." BMVC. 2007.
Del Bue, Alessio. "A factorization approach to structure from motion with shape priors." Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on. IEEE, 2008.
Akhter, Ijaz, et al. "Trajectory space: A dual representation for nonrigid structure from motion." Pattern Analysis and Machine Intelligence, IEEE Transactions on 33.7 (2011): 1442-1456.
Fortuna, Jeff, and Aleix M. Martinez. "Rigid structure from motion from a blind source separation perspective." International journal of computer vision 88.3 (2010): 404-424.
Koo, Hei-Sheung, and Kin-Man Lam. "Recovering the 3D shape and poses of face images based on the similarity transform." Pattern Recognition Letters 29.6 (2008): 712-723.
Sun, Zhan-Li, Kin-Man Lam, and Qing-Wei Gao. "Depth estimation of face images using the nonlinear least-squares model." Image Processing, IEEE Transactions on 22.1 (2013): 17-30.
Shashikant S. Patil, Sachin A Sonawane, Nischay Upadhyay and Aanchal Srivastava, Compressive Assessment of Bioinformatics In Biomedical Imaging and Image Processing, Volume 5, Issue 4, April (2014), pp. 175-185, International Journal of Computer Engineering and Technology (IJCET).
Sorna Percy. G and Dr. T. Arumuga Maria Devi, An Efficiently Identify The Diabetic Foot Ulcer Based On Foot Anthropometry Using Hyper Spectral Imaging. International Journal of Information Technology & Management Information System, 7(2), 2016, pp. 36–44.
Ashvini Bhamare, Prof. Sachin Sonawane and Prof. ShashikantPatil, Comprehensive Assessment, Performance Overview And Review of All Existing Techniques of Reversible Image Watermarking For Medical Imaging, Volume 4, Issue 6, November - December (2013), pp. 95-102, International Journal of Computer Engineering and Technology.
Malik, Jitendra, and Dror Maydan. "Recovering three-dimensional shape from a single image of curved objects." Pattern Analysis and Machine Intelligence, IEEE Transactions on 11.6 (1989): 555-566.
Downloads
Published
Issue
Section
License
Copyright (c) 2020 Swarna Priya RM, Aarthy S L, Gunavathi C, Venkatesh P, Srinivas Koppu, Xiao-Zhi Gao (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
