A Computational Model for Shape from Texture

2007; Wiley; Linguagem: Inglês

10.1002/9780470514610.ch14

ISSN

1935-4657

Autores

Jitendra Malik, Ruth Rosenholtz,

Tópico(s)

Optical measurement and interference techniques

Resumo

A Computational Model for Shape from Texture Jitendra Malik, Jitendra Malik Department of Electrical Engineering and Computer Science, University of California at Berkeley, Berkeley, CA 94720, USA Isaac Newton Institute of Mathematical Sciences, Cambridge University, 20 Clarkson Road, Cambridge CB3 0EH, UKSearch for more papers by this authorRuth Rosenholtz, Ruth Rosenholtz Isaac Newton Institute of Mathematical Sciences, Cambridge University, 20 Clarkson Road, Cambridge CB3 0EH, UKSearch for more papers by this author Jitendra Malik, Jitendra Malik Department of Electrical Engineering and Computer Science, University of California at Berkeley, Berkeley, CA 94720, USA Isaac Newton Institute of Mathematical Sciences, Cambridge University, 20 Clarkson Road, Cambridge CB3 0EH, UKSearch for more papers by this authorRuth Rosenholtz, Ruth Rosenholtz Isaac Newton Institute of Mathematical Sciences, Cambridge University, 20 Clarkson Road, Cambridge CB3 0EH, UKSearch for more papers by this author Book Editor(s):Gregory R. Bock, Gregory R. Bock OrganizerSearch for more papers by this authorJamie A. Goode, Jamie A. GoodeSearch for more papers by this author First published: 28 September 2007 https://doi.org/10.1002/9780470514610.ch14Citations: 1Book Series:Novartis Foundation Symposia AboutPDFPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShareShare a linkShare onEmailFacebookTwitterLinkedInRedditWechat Summary Shape from texture is best analysed in a two-stage framework analogous to stereopsis and structure from motion: (a) computing the 'texture distortion' from the image; and (b) interpreting the 'texture distortion' to infer the orientation and shape of the scene surface in 3D. We model the texture distortion at a point in any particular direction on the image plane as an affine transformation and derive the relationship between the parameters of the affine transformation and the surface shape and orientation. We have developed a technique for estimating affine transforms between nearby image patches which is based on solving a system of linear constraints derived from a differential analysis. It is not necessary explicitly to identify texels or make restrictive assumptions about the nature of the image texture like isotropy. We have developed two different models for recovering surface orientation (slant and tilt) and shape (principal curvatures and directions) based on the estimated affine transforms in a number of directions. Experimental results are presented on images of planar and curved surfaces under perspective projection. Refernces Aloimonos J 1988 Shape from texture. Biol Cybern 58: 345–360 10.1007/BF00363944 CASPubMedWeb of Science®Google Scholar Bajcsy R, Lieberman L 1976 Texture gradient as a depth cue. Comput Graph & Image Processing 5: 52–67 10.1016/S0146-664X(76)80005-6 PubMedGoogle Scholar Blake A, Marinos C 1990 Shape from texture: estimation, isotropy and moments. J Artif Intell 45: 323–380 10.1016/0004-3702(90)90011-N Web of Science®Google Scholar Blostein D, Ahuja N 1989 Shape from texture: integrating texture-element extraction and surface estimation. IEEE (Inst Electr Electron Eng) Trans Pattern Anal Mach Intell 11: 1233–1251 10.1109/34.41363 Web of Science®Google Scholar Brown LG, Shvaytser H 1990 Surface orientation from projective foreshortening of isotropic texture autocorrelation. IEEE (Inst Electr Electron Eng) Trans Pattern Anal Mach Intell 12: 584–588 10.1109/34.56194 Web of Science®Google Scholar Cutting J, Millard R 1984 Three gradients and the perception of flat and curved surfaces. J Exp Psychol Gen 113: 198–216 10.1037/0096-3445.113.2.198 CASPubMedWeb of Science®Google Scholar Garding J 1992 Shape from texture for smooth curved surfaces in perspective projection. J Math Image Vision 2: 327–350 10.1007/BF00121877 Google Scholar Gibson J 1950 The perception of the visual world. Houghton Mifflin, Boston, MA Ikeuchi K 1984 Shape from regular patterns. J Artif Intell 22: 49–75 Google Scholar Krumm J, Shafer S 1992 Shape from periodic texture using the spectrogram. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Champaign-Urbana, IL, 1992. Institute of Electrical and Electronics Engineers, New York, p 284–301 Google Scholar Malik J, Rosenholtz R 1993a A differential method for computing local shape-from-texture for planar and curved surfaces. In: Proceedings of the IEEE conference on computer vision and pattern research, New York, 1993. Institute of Electrical and Electronics Engineers, New York, p 267–273 Google Scholar Malik J, Rosenholtz R 1993b A differential method for computing local shape-from-texture for planar and curved surfaces. University of California at Berkeley, Berkeley, CA (Tech Rep UCB/CSD-93–775, Comp Sci Div) Google Scholar Marinos C, Blake A 1990 Shape from texture: the homogeneity hypothesis. In Proceedings of the international conference on computer vision, Osaka, Japan, 1990. Institute of Electrical and Electronics Engineers, New York, p 350–353 Google Scholar Press WH, Flannery BP, Teukolski SA, Vetterling WT 1988 Numerical recipes in C. Cambridge University Press, Cambridge Web of Science®Google Scholar Stevens KA 1981 The information content of texture gradients. Biol Cybern 42: 95–105 10.1007/BF00336727 CASPubMedWeb of Science®Google Scholar Super B, Bovik A 1992 Shape-from-texture by wavelet-based measurement of local spectral moments. In: Proceedings of the IEEE conference on computer vision and pattern research, Champaign-Urbana, IL, 1992. Institute of Electrical and Electronics Engineers, New York, p 296–301 Google Scholar Witkin AP 1981 Recovering surface shape and orientation from texture. J Artif Intell 17: 17–45 10.1016/0004-3702(81)90019-9 Web of Science®Google Scholar Georgeson MA, Meese TS 1992 The tilt after-effect in a 2-D stimulus: image reconstruction takes place before edge extraction. Perception (suppl) 2: 6 (abstr) Google Scholar Citing Literature Ciba Foundation Symposium 184 ‐ Higher‐Order Processing in the Visual System: Higher‐Order Processing in the Visual System: Ciba Foundation Symposium 184 ReferencesRelatedInformation

Referência(s)