Zinovi Tauber, Ze-Nian Li, Mark S. Drew,
Image-based rendering takes as input multiple images of an object and generates photorealistic images from novel viewpoints. This approach avoids explicitly modeling scenes by replacing the modeling phase with an object reconstruction phase. Reconstruction is achieved in two possible ways: recovering 3-D point locations using multiview stereo techniques, or reasoning about consistency of each voxel in a discretized object volume space. The most challenging problem for image-based reconstruction ...
Tópico(s): Generative Adversarial
2007 - Institute of Electrical and Electronics Engineers | IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews)
Peihao Zhu, Rameen Abdal, John Femiani, Peter Wonka,
Seamlessly blending features from multiple images is extremely challenging because of complex relationships in lighting, geometry, and partial occlusion which cause coupling between different parts of the image. Even though recent work on GANs enables synthesis of realistic hair or faces, it remains difficult to combine them into a single, coherent, and plausible image rather than a disjointed set of image patches. We present a novel solution to image blending, particularly for the problem of hairstyle ...
Tópico(s): Image Enhancement Techniques
2021 - Association for Computing Machinery | ACM Transactions on Graphics
Yakun Ju, Junyu Dong, Sheng Chen,
Photometric stereo recovers three-dimensional (3D) object surface normal from multiple images under different illumination directions. Traditional photometric stereo methods suffer from the problem of non-Lambertian surfaces with general reflectance. By leveraging deep neural networks, learning-based methods are capable of improving the surface normal estimation under general non-Lambertian surfaces. These state-of-the-art learning-based methods however do not associate surface normal with reconstructed ...
Tópico(s): 3D Shape Modeling and Analysis
2021 - Institute of Electrical and Electronics Engineers | IEEE Transactions on Image Processing
Akshat Dave, Yongyi Zhao, Ashok Veeraraghavan,
Reconstructing an object’s geometry and appearance from multiple images, also known as inverse rendering, is a fundamental problem in computer graphics and vision. Inverse rendering is inherently ill-posed because the captured image is an intricate function of unknown lighting, material properties and scene geometry. Recent progress in representing scene through coordinate-based neural networks has facilitated inverse rendering resulting in impressive geometry ...
Tópico(s): Advanced Vision and Imaging
2022 - Springer Science+Business Media | Lecture notes in computer science
Seungoh Han, Jinsun Park, Donghyeon Cho,
Photometric stereo (PS) estimates the surface normals of an object by utilizing multiple images captured under different light conditions. To obtain accurate surface normals, a large number of input images is often required. Therefore, a huge effort is needed to capture images and calibrate light directions together with a heavy computational cost. Therefore, in this paper, we propose a robust photometric stereo method even when the number of input images is very small. To this end, we design a feature ...
Tópico(s): Image Enhancement Techniques
2022 - Optica Publishing Group | Optics Express
... and exposure compensation, alphanumeric and graphic frame identification, graphic image recording (EKG, EEG, EMG), color capability, data format conversion, multi-format multi-modality sequences, print spooling from multiple image sources and direct connection to a PACS network.
Tópico(s): Medical Imaging Techniques and Applications
1984 - SPIE | Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
Gang-Joon Yoon, Geunho Jung, Jinjoo Song, Sang Min Yoon,
Image based view synthesis using deep neural networks provide novel scene views from a set of captured single or multiple images. Multiplane images (MPI) represent scene content as set of RGBα planes within a reference view frustum and render novel views by projecting the content into the target viewpoints. Image based view synthesis with multiple images is very popularly deployed in various areas because it effectively represents geometric uncertainty in ambiguous regions and can convincingly simulate ...
Tópico(s): Computer
2024 - Elsevier BV | Engineering Applications of Artificial Intelligence
Pai Peng, Zhongliang Jing, Han Pan, 阳 刘, Buer Song,
Multi-exposure image fusion (MEF) aims to combine multiple images with different exposures into a single image to improve visual quality and preserve details. This paper proposes a curve embedding network for MEF (CurveMEF), which formulates the MEF task as estimating optimal fusion curves based on state feedback using pixel intensities as state variables. The fusion curve is embedded into CurveNet, a lightweight deep network, as a physical prior constraint. Leveraging the proposed physical informed ...
Tópico(s): 3D Shape Modeling and Analysis
2024 - Elsevier BV | Neurocomputing
Urmila Pilania, Manoj Kumar, Vivaan Mittal,
... is applicable for the image formats: PNG (Portable Network Graphics), TIFF (Tagged Image File Format), JPEG (Joint Photograph Expert Group), and BMP (Bitmap). A single algorithm for almost all types of image formats provides many advantages. Depending upon the size of the secret message, network bandwidth, and allowable distortion we can choose the ...
Tópico(s): Vehicle License Plate Recognition
2023 - Taylor & Francis | Journal of Discrete Mathematical Sciences and Cryptography
Yakun Ju, Kin‐Man Lam, Wuyuan Xie, Huiyu Zhou, Junyu Dong, Boxin Shi,
Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues, i.e. , modeling the relationship between surface orientation and intensity at each pixel. Photometric stereo prevails in superior per-pixel resolution and fine reconstruction details. However, it is a complicated problem because of the non-linear relationship caused by non-Lambertian surface reflectance. Recently, various deep learning methods have shown a powerful ability in the context of ...
Tópico(s): 3D Shape Modeling and Analysis
2024 - IEEE Computer Society | IEEE Transactions on Pattern Analysis and Machine Intelligence
Takashi Nomoto, Wanlong Li, Hao-Lun Peng, Yoshihiro Watanabe,
Projection mapping using multiple projectors is promising for spatial augmented reality; however, it is difficult to apply it to dynamic scenes. This is because the conventional method decides all pixel intensities of multiple images simultaneously based on the global optimization method, and it is hard to reduce the latency from motion to projection. To mitigate this, we propose a novel method of controlling the intensity based on a pixel-parallel calculation for each projector in real-time with ...
Tópico(s): Computer
2022 - Institute of Electrical and Electronics Engineers | IEEE Transactions on Visualization and Computer Graphics
Rakhi Bhardwaj, Tanmay Kadam, Shubham Waghule, Sahil Shendurkar, Bhakti Sarag,
... result, the variety and originality of the developed graphics may be constrained. To get around this problem, DeepDream algorithm was trained to use multiple images or a combination of images and noise, resulting ...
Tópico(s): Creativity in Education and Neuroscience
2023 - Springer International Publishing | Lecture notes in networks and systems
Shreedhar I. Muttagi, Vaishnavi Patil, Pooja P. Babar, Ritvik Chunamari, Uday Kulkarni, Satish Chikkamath, S M Meena,
... for enhanced output. Through the use of neural networks and an end-to-end training strategy, our approach achieves accurate and precise reconstructions without requiring multiple images or complex camera setups. The potential applications of ...
Tópico(s): Advanced Vision and Imaging
2024 - Springer International Publishing | Lecture notes in networks and systems
Minxuan Lin, Fan Tang, Weiming Dong, Xiao Li, Changsheng Xu, Chongyang Ma,
... multimodal diversity is ensured by either guidance from multiple images or random style codes, while the multi-domain ...
Tópico(s): Image Enhancement Techniques
2021 - Association for Computing Machinery | ACM Transactions on Multimedia Computing Communications and Applications
Zhongwei Lv, X. Bao, Yong Tang, Jing Zhao,
Abstract Neural surface reconstruction methods have demonstrated their ability to recover 3D surfaces from multiple images. However, current approaches struggle to rapidly achieve high‐fidelity surface reconstructions. In this work, we propose TaNSR, which inherits the speed advantages of multi‐resolution hash encodings and extends its representation capabilities. To reduce training time, we propose an efficient numerical gradient computation method that significantly reduces additional memory access ...
Tópico(s): Computer
2024 - Wiley | Computer Graphics Forum
... of age in adult Caucasian male faces: computer graphic manipulation of shape and colour informationProc. R. Soc. ... of age in adult Caucasian male faces: computer graphic manipulation of shape and colour information D. Michael ...
Tópico(s): Aesthetic Perception and Analysis
1995 - Royal Society | Proceedings of the Royal Society B Biological Sciences
Julien Philip, Sébastien Morgenthaler, Michaël Gharbi, George Drettakis,
We introduce a neural relighting algorithm for captured indoors scenes, that allows interactive free-viewpoint navigation. Our method allows illumination to be changed synthetically, while coherently rendering cast shadows and complex glossy materials. We start with multiple images of the scene and a three-dimensional mesh obtained by multi-view stereo (MVS) reconstruction. We assume that lighting is well explained as the sum of a view-independent diffuse component and a view-dependent glossy term ...
Tópico(s): Remote Sensing and LiDAR Applications
2021 - Association for Computing Machinery | ACM Transactions on Graphics
Jonghee Back, Binh‐Son Hua, Toshiya Hachisuka, Bochang Moon,
Monte Carlo integration is an efficient method to solve a high-dimensional integral in light transport simulation, but it typically produces noisy images due to its stochastic nature. Many existing methods, such as image denoising and gradient-domain reconstruction, aim to mitigate this noise by introducing some form of correlation among pixels. While those existing methods reduce noise, they are known to still suffer from method-specific residual noise or systematic errors. We propose a unified ...
Tópico(s): Image Enhancement Techniques
2020 - Association for Computing Machinery | ACM Transactions on Graphics
Cyril Pernet, Christopher R. Madan,
... 2015b). At the intersection of psychology, computer vision, graphic design and statistics, there is a field of ... neurovault.org/collections/4319/). The second principle for graphic design is the assemblage of visual information. The ...
Tópico(s): Advanced Neuroimaging Techniques and Applications
2019 - Wiley | European Journal of Neuroscience
Wenbin He, Junpeng Wang, Hanqi Guo, Ko-Chih Wang, Han‐Wei Shen, Mukund Raj, Youssef S. G. Nashed, Tom Peterka,
We propose InSituNet, a deep learning based surrogate model to support parameter space exploration for ensemble simulations that are visualized in situ. In situ visualization, generating visualizations at simulation time, is becoming prevalent in handling large-scale simulations because of the I/O and storage constraints. However, in situ visualization approaches limit the flexibility of post-hoc exploration because the raw simulation data are no longer available. Although multiple image-based approaches ...
Tópico(s): Generative Adversarial
2019 - Institute of Electrical and Electronics Engineers | IEEE Transactions on Visualization and Computer Graphics
Kaan Yücer, Alec Jacobson, Andreas Hornung, Olga Sorkine,
We present a method for consistent automatic transfer of edits applied to one image to many other images of the same object or scene. By introducing novel, content-adaptive weight functions we enhance the non-rigid alignment framework of Lucas-Kanade to robustly handle changes of view point, illumination and non-rigid deformations of the subjects. Our weight functions are content-aware and possess high-order smoothness, enabling to define high-quality image warping with a low number of parameters ...
Tópico(s): Computer
2012 - Association for Computing Machinery | ACM Transactions on Graphics
Three-dimensional (3D) content generation has become a popular topic in recent years. It can be widely used in movie scene generation, video games 3D modeling, industrial design, and even pharmaceutical 3D structure characterization. Before artificial intelligence (AI), it can be difficult. People need to be trained to use various industrial 3D model applications and spend plenty of time building and refining a model. With the development of virtual reality and artificial reality, the demand for 3D ...
Tópico(s): Generative Adversarial
2024 - | Highlights in Science Engineering and Technology
Asma Al‐Saidi, David Walker, Omer Rana,
... they are based on the traditional polygonal processing graphics pipeline. In contrast, image-based rendering uses multiple ...
Tópico(s): Image and Video Quality Assessment
2012 - Wiley | Concurrency and Computation Practice and Experience
Yakun Ju, Yuxin Peng, Muwei Jian, Feng Gao, Junyu Dong,
Abstract Photometric stereo aims to reconstruct 3D geometry by recovering the dense surface orientation of a 3D object from multiple images under differing illumination. Traditional methods normally adopt simplified reflectance models to make the surface orientation computable. However, the real reflectances of surfaces greatly limit applicability of such methods to real-world objects. While deep neural networks have been employed to handle non-Lambertian surfaces, these methods are subject to blurring ...
Tópico(s): 3D Shape Modeling and Analysis
2021 - Springer Nature | Computational Visual Media
Daria Fokina, Ekaterina Muravleva, George Ovchinnikov, Ivan Oseledets,
This work considers the usage of StyleGAN architecture for the task of microstructure synthesis. The task is the following: Given number of samples of structure we try to generate similar samples at the same time preserving its properties. Since the considered architecture is not able to produce samples of sizes larger than the training images, we propose to use image quilting to merge fixed-sized samples. One of the key features of the considered architecture is that it uses multiple image resolutions. ...
Tópico(s): Computer
2020 - American Physical Society | Physical review. E
Guanying Chen, Kai Han, Boxin Shi, Yasuyuki Matsushita, Kenneth K. Wong,
This paper addresses the problem of photometric stereo, in both calibrated and uncalibrated scenarios, for non-Lambertian surfaces based on deep learning. We first introduce a fully convolutional deep network for calibrated photometric stereo, which we call PS-FCN. Unlike traditional approaches that adopt simplified reflectance models to make the problem tractable, our method directly learns the mapping from reflectance observations to surface normal, and is able to handle surfaces with general ...
Tópico(s): 3D Shape Modeling and Analysis
2020 - IEEE Computer Society | IEEE Transactions on Pattern Analysis and Machine Intelligence
Tiancheng Sun, Jonathan T. Barron, Yun‐Ta Tsai, Zexiang Xu, Xueming Yu, Graham Fyffe, Christoph Rhemann, Jay Busch, Paul Debevec, Ravi Ramamoorthi,
Lighting plays a central role in conveying the essence and depth of the subject in a portrait photograph. Professional photographers will carefully control the lighting in their studio to manipulate the appearance of their subject, while consumer photographers are usually constrained to the illumination of their environment. Though prior works have explored techniques for relighting an image, their utility is usually limited due to requirements of specialized hardware, multiple images of the subject ...
Tópico(s): Visual Attention and Saliency Detection
2019 - Association for Computing Machinery | ACM Transactions on Graphics
Sander G. van Dijk, Marcus M. Scheunemann,
Deep learning has revolutionised many fields, but it is still challenging to transfer its success to small mobile robots with minimal hardware. Specifically, some work has been done to this effect in the RoboCup humanoid football domain, but results that are performant and efficient and still generally applicable outside of this domain are lacking. We propose an approach conceptually different from those taken previously. It is based on semantic segmentation and does achieve these desired properties. ...
Tópico(s): Adversarial Robustness in Machine Learning
2019 - Springer Science+Business Media | Lecture notes in computer science
Shidan Wang, Donghan M. Yang, Ruichen Rong, Xiaowei Zhan, Guanghua Xiao,
... with a central processing unit (CPU) or a graphic processing unit (GPU) is often limited, the pathology ...
Tópico(s): Medical Imaging and Analysis
2019 - Elsevier BV | American Journal Of Pathology
José Dolz, Christian Desrosiers, Li Wang, Jing Yuan, Dinggang Shen, Ismail Ben Ayed,
Precise 3D segmentation of infant brain tissues is an essential step towards comprehensive volumetric studies and quantitative analysis of early brain development. However, computing such segmentations is very challenging, especially for 6-month infant brain, due to the poor image quality, among other difficulties inherent to infant brain MRI, e.g., the isointense contrast between white and gray matter and the severe partial volume effect due to small brain sizes. This study investigates the problem ...
Tópico(s): Domain Adaptation and Few-Shot Learning
2019 - Elsevier BV | Computerized Medical Imaging and Graphics