2.1 General Introduction

Computer generated images are ubiquitous in our everyday life. Such images are the result of a process that has seldom changed over the years: the optical phenomena due to the propagation of light in a 3D environment are simulated taking into account how light is scattered  63, 39 according to shape and material characteristics of objects. The intersection of optics (for the underlying laws of physics) and computer science (for its modeling and computational efficiency aspects) provides a unique opportunity to tighten the links between these domains in order to first improve the image generation process (computer graphics, optics and virtual reality) and next to develop new acquisition and display technologies (optics, mixed reality and machine vision).

Most of the time, light, shape, and matter properties are studied, acquired, and modeled separately, relying on realistic or stylized rendering processes to combine them in order to create final pixel colors. Such modularity, inherited from classical physics, has the practical advantage of permitting to reuse the same models in various contexts. However, independent developments lead to un-optimized pipelines and difficult-to-control solutions since it is often not clear which part of the expected result is caused by which property. Indeed, the most efficient solutions are most often the ones that blur the frontiers between light, shape, and matter to lead to specialized and optimized pipelines, as in real-time applications (like Bidirectional Texture Functions  74 and Light-Field rendering  37). Keeping these three properties separated may lead to other problems. For instance:

• Measured materials are too detailed to be usable in rendering systems and data reduction techniques have to be developed  73, 75, leading to an inefficient transfer between real and digital worlds;
• It is currently extremely challenging (if not impossible) to directly control or manipulate the interactions between light, shape, and matter. Accurate lighting processes may create solutions that do not fulfill users' expectations;
• Artists can spend hours and days in modeling highly complex surfaces whose details will not be visible  95 due to inappropriate use of certain light sources or reflection properties.

Most traditional applications target human observers. Depending on how deep we take into account the specificity of each user, the requirement of representations, and algorithms may differ.

Auto-stereoscopy display	HDR display	Printing both geometry and material
©Nintendo	©Dolby Digital	55

Show image description

Examples of new display technologies

With the evolution of measurement and display technologies that go beyond conventional images (e.g., as illustrated in Figure 1, High-Dynamic Range Imaging  85, stereo displays or new display technologies  59, and physical fabrication  29, 46, 55) the frontiers between real and virtual worlds are vanishing  42. In this context, a sensor combined with computational capabilities may also be considered as another kind of observer. Creating separate models for light, shape, and matter for such an extended range of applications and observers is often inefficient and sometimes provides unexpected results. Pertinent solutions must be able to take into account properties of the observer (human or machine) and application goals.

2.2 Methodology

Show image description

Interactions/Transfers between real and virtual worlds.

3.1 Related Scientific Domains

Show image description

Related scientific domains of the MANAO project

The MANAO project aims at studying, acquiring, modeling, and rendering the interactions between the three components that are light, shape, and matter from the viewpoint of an observer. As detailed more lengthily in the next section, such a work will be done using the following approach: first, we will tend to consider that these three components do not have strict frontiers when considering their impacts on the final observers; then, we will not only work in computer graphics, but also at the intersection of computer graphics and optics, exploring the mutual benefits that the two domains may provide. It is thus intrinsically a transdisciplinary project (as illustrated in Figure 3) and we expect results in both domains.

Thus, the proposed team-project aims at establishing a close collaboration between computer graphics (e.g., 3D modeling, geometry processing, shading techniques, vector graphics, and GPU programming) and optics (e.g., design of optical instruments, and theories of light propagation). The following examples illustrate the strengths of such a partnership. First, in addition to simpler radiative transfer equations  47 commonly used in computer graphics, research in the later will be based on state-of-the-art understanding of light propagation and scattering in real environments. Furthermore, research will rely on appropriate instrumentation expertise for the measurement  60, 61 and display  59 of the different phenomena. Reciprocally, optics researches may benefit from the expertise of computer graphics scientists on efficient processing to investigate interactive simulation, visualization, and design. Furthermore, new systems may be developed by unifying optical and digital processing capabilities. Currently, the scientific background of most of the team members is related to computer graphics and computer vision. A large part of their work have been focused on simulating and analyzing optical phenomena as well as in acquiring and visualizing them. Combined with the close collaboration with the optics laboratory LP2N and with the students issued from the “Institut d'Optique”, this background ensures that we can expect the following results from the project: the construction of a common vocabulary for tightening the collaboration between the two scientific domains and creating new research topics. By creating this context, we expect to attract (and even train) more trans-disciplinary researchers.

At the boundaries of the MANAO project lie issues in human and machine vision. We have to deal with the former whenever a human observer is taken into account. On one side, computational models of human vision are likely to guide the design of our algorithms. On the other side, the study of interactions between light, shape, and matter may shed some light on the understanding of visual perception. The same kind of connections are expected with machine vision. On the one hand, traditional computational methods for acquisition (such as photogrammetry) are going to be part of our toolbox. On the other hand, new display technologies (such as the ones used for augmented reality) are likely to benefit from our integrated approach and systems. In the MANAO project we are mostly users of results from human vision. When required, some experimentation might be done in collaboration with experts from this domain, like with the European PRISM project. For machine vision, provided the tight collaboration between optical and digital systems, research will be carried out inside the MANAO project.

Analysis and modeling rely on tools from applied mathematics such as differential and projective geometry, multi-scale models, frequency analysis  49 or differential analysis  83, linear and non-linear approximation techniques, stochastic and deterministic integrations, and linear algebra. We not only rely on classical tools, but also investigate and adapt recent techniques (e.g., improvements in approximation techniques), focusing on their ability to run on modern hardware: the development of our own tools (such as Eigen) is essential to control their performances and their abilities to be integrated into real-time solutions or into new instruments.

3.2 Research axes

The MANAO project is organized around four research axes that cover the large range of expertise of its members and associated members. We briefly introduce these four axes in this section. More details and their inter-influences that are illustrated in the Figure 2 will be given in the following sections.

Axis 1 is the theoretical foundation of the project. Its main goal is to increase the understanding of light, shape, and matter interactions by combining expertise from different domains: optics and human/machine vision for the analysis and computer graphics for the simulation aspect. The goal of our analyses is to identify the different layers/phenomena that compose the observed signal. In a second step, the development of physical simulations and numerical models of these identified phenomena is a way to validate the pertinence of the proposed decompositions.

In Axis 2, the final observers are mainly physical captors. Our goal is thus the development of new acquisition and display technologies that combine optical and digital processes in order to reach fast transfers between real and digital worlds, in order to increase the convergence of these two worlds.

Axes 3 and 4 focus on two aspects of computer graphics: rendering, visualization and illustration in Axis 3, and editing and modeling (content creation) in Axis 4. In these two axes, the final observers are mainly human users, either generic users or expert ones (e.g., archaeologist  87, computer graphics artists).

3.3 Axis 1: Analysis and Simulation

Challenge: Definition and understanding of phenomena resulting from interactions between light, shape, and matter as seen from an observer point of view.

Results: Theoretical tools and numerical models for analyzing and simulating the observed optical phenomena.

To reach the goals of the MANAO project, we need to increase our understanding of how light, shape, and matter act together in synergy and how the resulting signal is finally observed. For this purpose, we need to identify the different phenomena that may be captured by the targeted observers. This is the main objective of this research axis, and it is achieved by using three approaches: the simulation of interactions between light, shape, and matter, their analysis and the development of new numerical models. This resulting improved knowledge is a foundation for the researches done in the three other axes, and the simulation tools together with the numerical models serve the development of the joint optical/digital systems in Axis 2 and their validation.

One of the main and earliest goals in computer graphics is to faithfully reproduce the real world, focusing mainly on light transport. Compared to researchers in physics, researchers in computer graphics rely on a subset of physical laws (mostly radiative transfer and geometric optics), and their main concern is to efficiently use the limited available computational resources while developing as fast as possible algorithms. For this purpose, a large set of theoretical as well as computational tools has been introduced to take a maximum benefit of hardware specificities. These tools are often dedicated to specific phenomena (e.g., direct or indirect lighting, color bleeding, shadows, caustics). An efficiency-driven approach needs such a classification of light paths  56 in order to develop tailored strategies  99. For instance, starting from simple direct lighting, more complex phenomena have been progressively introduced: first diffuse indirect illumination  54, 91, then more generic inter-reflections  63, 47 and volumetric scattering  88, 44. Thanks to this search for efficiency and this classification, researchers in computer graphics have developed a now recognized expertise in fast-simulation of light propagation. Based on finite elements (radiosity techniques) or on unbiased Monte Carlo integration schemes (ray-tracing, particle-tracing, ...), the resulting algorithms and their combination are now sufficiently accurate to be used-back in physical simulations. The MANAO project will continue the search for efficient and accurate simulation techniques, but extending it from computer graphics to optics. Thanks to the close collaboration with scientific researchers from optics, new phenomena beyond radiative transfer and geometric optics will be explored.

Search for algorithmic efficiency and accuracy has to be done in parallel with numerical models. The goal of visual fidelity (generalized to accuracy from an observer point of view in the project) combined with the goal of efficiency leads to the development of alternative representations. For instance, common classical finite-element techniques compute only basis coefficients for each discretization element: the required discretization density would be too large and to computationally expensive to obtain detailed spatial variations and thus visual fidelity. Examples includes texture for decorrelating surface details from surface geometry and high-order wavelets for a multi-scale representation of lighting  43. The numerical complexity explodes when considering directional properties of light transport such as radiance intensity (Watt per square meter and per steradian - $W.m^{-2}.s{r}^{-1}$), reducing the possibility to simulate or accurately represent some optical phenomena. For instance, Haar wavelets have been extended to the spherical domain  90 but are difficult to extend to non-piecewise-constant data  93. More recently, researches prefer the use of Spherical Radial Basis Functions  96 or Spherical Harmonics  82. For more complex data, such as reflective properties (e.g., BRDF  76, 64 - 4D), ray-space (e.g., Light-Field  72 - 4D), spatially varying reflective properties (6D - 86), new models, and representations are still investigated such as rational functions  79 or dedicated models  31 and parameterizations  89, 94. For each (newly) defined phenomena, we thus explore the space of possible numerical representations to determine the most suited one for a given application, like we have done for BRDF  79.

Texuring	1st order gradient field	Environment reflection	2st order gradient field

Show image description

Firts-order analysis

Before being able to simulate or to represent the different observed phenomena, we need to define and describe them. To understand the difference between an observed phenomenon and the classical light, shape, and matter decomposition, we can take the example of a highlight. Its observed shape (by a human user or a sensor) is the resulting process of the interaction of these three components, and can be simulated this way. However, this does not provide any intuitive understanding of their relative influence on the final shape: an artist will directly describe the resulting shape, and not each of the three properties. We thus want to decompose the observed signal into models for each scale that can be easily understandable, representable, and manipulable. For this purpose, we will rely on the analysis of the resulting interaction of light, shape, and matter as observed by a human or a physical sensor. We first consider this analysis from an optical point of view, trying to identify the different phenomena and their scale according to their mathematical properties (e.g., differential  83 and frequency analysis  49). Such an approach has leaded us to exhibit the influence of surfaces flows (depth and normal gradients) into lighting pattern deformation (see Figure 4). For a human observer, this correspond to one recent trend in computer graphics that takes into account the human visual systems  51 both to evaluate the results and to guide the simulations.

3.4 Axis 2: From Acquisition to Display

Challenge: Convergence of optical and digital systems to blend real and virtual worlds.

Results: Instruments to acquire real world, to display virtual world, and to make both of them interact.

Show image description

Light-Field transfer

In this axis, we investigate unified acquisition and display systems, that is systems which combine optical instruments with digital processing. From digital to real, we investigate new display approaches  72, 59. We consider projecting systems and surfaces  38, for personal use, virtual reality and augmented reality  33. From the real world to the digital world, we favor direct measurements of parameters for models and representations, using (new) optical systems unless digitization is required  53, 52. These resulting systems have to acquire the different phenomena described in Axis 1 and to display them, in an efficient manner  57, 32, 58, 61. By efficient, we mean that we want to shorten the path between the real world and the virtual world by increasing the data bandwidth between the real (analog) and the virtual (digital) worlds, and by reducing the latency for real-time interactions (we have to prevent unnecessary conversions, and to reduce processing time). To reach this goal, the systems have to be designed as a whole, not by a simple concatenation of optical systems and digital processes, nor by considering each component independently  62.

To increase data bandwidth, one solution is to parallelize more and more the physical systems. One possible solution is to multiply the number of simultaneous acquisitions (e.g., simultaneous images from multiple viewpoints  61, 81). Similarly, increasing the number of viewpoints is a way toward the creation of full 3D displays  72. However, full acquisition or display of 3D real environments theoretically requires a continuous field of viewpoints, leading to huge data size. Despite the current belief that the increase of computational power will fill the missing gap, when it comes to visual or physical realism, if you double the processing power, people may want four times more accuracy, thus increasing data size as well. To reach the best performances, a trade-off has to be found between the amount of data required to represent accurately the reality and the amount of required processing. This trade-off may be achieved using compressive sensing. Compressive sensing is a new trend issued from the applied mathematics community that provides tools to accurately reconstruct a signal from a small set of measurements assuming that it is sparse in a transform domain (e.g., 80, 105).

We prefer to achieve this goal by avoiding as much as possible the classical approach where acquisition is followed by a fitting step: this requires in general a large amount of measurements and the fitting itself may consume consequently too much memory and preprocessing time. By preventing unnecessary conversion through fitting techniques, such an approach increase the speed and reduce the data transfer for acquisition but also for display. One of the best recent examples is the work of Cossairt et al.  42. The whole system is designed around a unique representation of the energy-field issued from (or leaving) a 3D object, either virtual or real: the Light-Field. A Light-Field encodes the light emitted in any direction from any position on an object. It is acquired thanks to a lens-array that leads to the capture of, and projection from, multiple simultaneous viewpoints. A unique representation is used for all the steps of this system. Lens-arrays, parallax barriers, and coded-aperture  69 are one of the key technologies to develop such acquisition (e.g., Light-Field camera 1 62 and acquisition of light-sources  53), projection systems (e.g., auto-stereoscopic displays). Such an approach is versatile and may be applied to improve classical optical instruments  67. More generally, by designing unified optical and digital systems  77, it is possible to leverage the requirement of processing power, the memory footprint, and the cost of optical instruments.

Those are only some examples of what we investigate. We also consider the following approaches to develop new unified systems. First, similar to (and based on) the analysis goal of Axis 1, we have to take into account as much as possible the characteristics of the measurement setup. For instance, when fitting cannot be avoided, integrating them may improve both the processing efficiency and accuracy  79. Second, we have to integrate signals from multiple sensors (such as GPS, accelerometer, ...) to prevent some computation (e.g., 70). Finally, the experience of the group in surface modeling help the design of optical surfaces  65 for light sources or head-mounted displays.

3.5 Axis 3: Rendering, Visualization and Illustration

Challenge: How to offer the most legible signal to the final observer in real-time?

Results: High-level shading primitives, expressive rendering techniques for object depiction, real-time realistic rendering algorithms

Realistic	Rendering	Visualization	and Illustration
(a) Global illumination 78	(b) Shadows 106	(c) Shape enhancement 101	(d) Shape depiction 30

Show image description

Rendering techniques from realistic solutions to more expressive ones.

The main goal of this axis is to offer to the final observer, in this case mostly a human user, the most legible signal in real-time. Thanks to the analysis and to the decomposition in different phenomena resulting from interactions between light, shape, and matter (Axis 1), and their perception, we can use them to convey essential information in the most pertinent way. Here, the word pertinent can take various forms depending on the application.

In the context of scientific illustration and visualization, we are primarily interested in tools to convey shape or material characteristics of objects in animated 3D scenes. Expressive rendering techniques (see Figure 6c,d) provide means for users to depict such features with their own style. To introduce our approach, we detail it from a shape-depiction point of view, domain where we have acquired a recognized expertise. Prior work in this area mostly focused on stylization primitives to achieve line-based rendering  103, 66 or stylized shading  36, 101 with various levels of abstraction. A clear representation of important 3D object features remains a major challenge for better shape depiction, stylization and abstraction purposes. Most existing representations provide only local properties (e.g., curvature), and thus lack characterization of broader shape features. To overcome this limitation, we are developing higher level descriptions of shape  30 with increased robustness to sparsity, noise, and outliers. This is achieved in close collaboration with Axis 1 by the use of higher-order local fitting methods, multi-scale analysis, and global regularization techniques. In order not to neglect the observer and the material characteristics of the objects, we couple this approach with an analysis of the appearance model. To our knowledge, this is an approach which has not been considered yet. This research direction is at the heart of the MANAO project, and has a strong connection with the analysis we plan to conduct in Axis 1. Material characteristics are always considered at the light ray level, but an understanding of higher-level primitives (like the shape of highlights and their motion) would help us to produce more legible renderings and permit novel stylizations; for instance, there is no method that is today able to create stylized renderings that follow the motion of highlights or shadows. We also believe such tools also play a fundamental role for geometry processing purposes (such as shape matching, reassembly, simplification), as well as for editing purposes as discussed in Axis 4.

In the context of real-time photo-realistic rendering ((see Figure 6a,b), the challenge is to compute the most plausible images with minimal effort. During the last decade, a lot of work has been devoted to design approximate but real-time rendering algorithms of complex lighting phenomena such as soft-shadows  104, motion blur  49, depth of field  92, reflexions, refractions, and inter-reflexions. For most of these effects it becomes harder to discover fundamentally new and faster methods. On the other hand, we believe that significant speedup can still be achieved through more clever use of massively parallel architectures of the current and upcoming hardware, and/or through more clever tuning of the current algorithms. In particular, regarding the second aspect, we remark that most of the proposed algorithms depend on several parameters which can be used to trade the speed over the quality. Significant speed-up could thus be achieved by identifying effects that would be masked or facilitated and thus devote appropriate computational resources to the rendering  68, 48. Indeed, the algorithm parameters controlling the quality vs speed are numerous without a direct mapping between their values and their effect. Moreover, their ideal values vary over space and time, and to be effective such an auto-tuning mechanism has to be extremely fast such that its cost is largely compensated by its gain. We believe that our various work on the analysis of the appearance such as in Axis 1 could be beneficial for such purpose too.

Realistic and real-time rendering is closely related to Axis 2: real-time rendering is a requirement to close the loop between real world and digital world. We have to thus develop algorithms and rendering primitives that allow the integration of the acquired data into real-time techniques. We have also to take care of that these real-time techniques have to work with new display systems. For instance, stereo, and more generally multi-view displays are based on the multiplication of simultaneous images. Brute force solutions consist in independent rendering pipeline for each viewpoint. A more energy-efficient solution would take advantages of the computation parts that may be factorized. Another example is the rendering techniques based on image processing, such as our work on augmented reality  40. Independent image processing for each viewpoint may disturb the feeling of depth by introducing inconsistent information in each images. Finally, more dedicated displays  59 would require new rendering pipelines.

3.6 Axis 4: Editing and Modeling

Challenge: Editing and modeling appearance using drawing- or sculpting-like tools through high level representations.

Results: High-level primitives and hybrid representations for appearance and shape.

During the last decade, the domain of computer graphics has exhibited tremendous improvements in image quality, both for 2D applications and 3D engines. This is mainly due to the availability of an ever increasing amount of shape details, and sophisticated appearance effects including complex lighting environments. Unfortunately, with such a growth in visual richness, even so-called vectorial representations (e.g., subdivision surfaces, Bézier curves, gradient meshes, etc.) become very dense and unmanageable for the end user who has to deal with a huge mass of control points, color labels, and other parameters. This is becoming a major challenge, with a necessity for novel representations. This Axis is thus complementary of Axis 3: the focus is the development of primitives that are easy to use for modeling and editing.

More specifically, we plan to investigate vectorial representations that would be amenable to the production of rich shapes with a minimal set of primitives and/or parameters. To this end we plan to build upon our insights on dynamic local reconstruction techniques and implicit surfaces  4135. When working in 3D, an interesting approach to produce detailed shapes is by means of procedural geometry generation. For instance, many natural phenomena like waves or clouds may be modeled using a combination of procedural functions. Turning such functions into triangle meshes (main rendering primitives of GPUs) is a tedious process that appears not to be necessary with an adapted vectorial shape representation where one could directly turn procedural functions into implicit geometric primitives. Since we want to prevent unnecessary conversions in the whole pipeline (here, between modeling and rendering steps), we will also consider hybrid representations mixing meshes and implicit representations. Such research has thus to be conducted while considering the associated editing tools as well as performance issues. It is indeed important to keep real-time performance (cf. Axis 2) throughout the interaction loop, from user inputs to display, via editing and rendering operations. Finally, it would be interesting to add semantic information into 2D or 3D geometric representations. Semantic geometry appears to be particularly useful for many applications such as the design of more efficient manipulation and animation tools, for automatic simplification and abstraction, or even for automatic indexing and searching. This constitutes a complementary but longer term research direction.

(a)	(b)	(c)	(d)	(e)	(f)

Show image description

A system that mimics texture (left) and shading (right) effects using image processing alone.

In the MANAO project, we want to investigate representations beyond the classical light, shape, and matter decomposition. We thus want to directly control the appearance of objects both in 2D and 3D applications (e.g., 97): this is a core topic of computer graphics. When working with 2D vector graphics, digital artists must carefully set up color gradients and textures: examples range from the creation of 2D logos to the photo-realistic imitation of object materials. Classic vector primitives quickly become impractical for creating illusions of complex materials and illuminations, and as a result an increasing amount of time and skill is required. This is only for still images. For animations, vector graphics are only used to create legible appearances composed of simple lines and color gradients. There is thus a need for more complex primitives that are able to accommodate complex reflection or texture patterns, while keeping the ease of use of vector graphics. For instance, instead of drawing color gradients directly, it is more advantageous to draw flow lines that represent local surface concavities and convexities. Going through such an intermediate structure then allows to deform simple material gradients and textures in a coherent way (see Figure 7), and animate them all at once. The manipulation of 3D object materials also raises important issues. Most existing material models are tailored to faithfully reproduce physical behaviors, not to be easily controllable by artists. Therefore artists learn to tweak model parameters to satisfy the needs of a particular shading appearance, which can quickly become cumbersome as the complexity of a 3D scene increases. We believe that an alternative approach is required, whereby material appearance of an object in a typical lighting environment is directly input (e.g., painted or drawn), and adapted to match a plausible material behavior. This way, artists will be able to create their own appearance (e.g., by using our shading primitives  97), and replicate it to novel illumination environments and 3D models. For this purpose, we will rely on the decompositions and tools issued from Axis 1.

4.1 Physical Systems

Given our close relationships with researchers in optics, one novelty of our approach is to extend the range of possible observers to physical sensors in order to work on domains such as simulation, mixed reality, and testing. Capturing, processing, and visualizing complex data is now more and more accessible to everyone, leading to the possible convergence of real and virtual worlds through visual signals. This signal is traditionally captured by cameras. It is now possible to augment them by projecting (e.g., the infrared laser of Microsoft Kinect) and capturing (e.g., GPS localization) other signals that are outside the visible range. This supplemental information replaces values traditionally extracted from standard images and thus lowers down requirements in computational power. Since the captured images are the result of the interactions between light, shape, and matter, the approaches and the improved knowledge from MANAO help in designing interactive acquisition and rendering technologies that are required to merge the real and the virtual worlds. With the resulting unified systems (optical and digital), transfer of pertinent information is favored and inefficient conversion is likely avoided, leading to new uses in interactive computer graphics applications, like augmented reality, displays and computational photography.

4.2 Interactive Visualization and Modeling

This direction includes domains such as scientific illustration and visualization, artistic or plausible rendering, and 3D modeling. In all these cases, the observer, a human, takes part in the process, justifying once more our focus on real-time methods. When targeting average users, characteristics as well as limitations of the human visual system should be taken into account: in particular, it is known that some configurations of light, shape, and matter have masking and facilitation effects on visual perception. For specialized applications (such as archeology), the expertise of the final user and the constraints for 3D user interfaces lead to new uses and dedicated solutions for models and algorithms.

5.1 Footprint of research activities

For a few years now, our team has been collectively careful in limiting its direct environmental impacts, mainly by limiting the number of flights and extending the lifetime of PCs and laptops beyond the warranty period.

5.2 Environmental involvement

Gaël Guennebaud is engaged in several actions and initiatives related to the environmental issues within the research and higher-education domain:

• Ecoinfo: He is involved within the GDS Ecoinfo of the CNRS, and in particular he is in charge of the development of the ecodiag tool among other activities.
• Labo1point5: He is part of the labos1point5 GDR, in particular to help with the development of a module to take into account the carbon footprint of ICT devices and external computing ressources within their carbon footprint estimation tool (GES1point5). The first version of the module has been released in October 2021.
• He participates in the elaboration and dissemination of an introductory course to climate change issues and environnemental impacts of ICT, with two colleagues of the LaBRI.

Both Gaël Guennebaud and Pascal Barla have compiled research projects conducted by Inria teams around environmental issues within Bordeaux research center, and prepared material for presentation to different audiences.

6.1 Awards

• Two papers published at Siggraph: one on Micrograin distributions 14 in the journal track, the other on 3D animation exaggeration (SMEAR) 20 in the conference track;
• A Blender plugin for the SMEAR technique. It has been downloaded more than 2000 times since its incorporation in the Blender add-on library in early December.

7.1 New software

7.2 New platforms

7.2.1 La Coupole

Participants: Romain Pacanowski, Marjorie Paillet, Morgane Gerardin, David Murray.

   

Show image description

View of La Coupole

La Coupole is a measurement device that acquires spatially-varying reflectance function (SV-BRDF) on non-planar object which area can be up to 1.5m${}^2$.

Its main characteristics are:

• RGB 12MP Camera (100 fps)
• 6-axes Robot
• 1080 White LED
• 3D Laser Scanner Laser: 200 $\mu m$ resolution
• Maximal Measurement Area: 1.75 m${}^2$
• Optical Resolution: 50 $\mu m$

Show image description

Left, official poster of the Exhibition Textiles 3D presented to the museum of Ethnography of Bordeaux. Right, 3D digital reconstruction of an alabaster piece using data acquired by La Coupole.

Show image description

Official poster of the Exhibition and 3D digital reconstruction of an alabaster.

La Coupole is capable of measuring objects with an average angular accuracy of 0.22 degrees, generates 4 terabytes of data per hour of measurement and allows the measurement of spatially varying BRDFs (SV-BRDF) on a non-planar shape. The 50 mm lens combined with the camera allows to obtain a spatial resolution resolution of 50 microns which corresponds approximately to the resolution of the human visual system (for an object placed at about 20 cm from the observer). After two years of conception and realization, la Coupole was used to digitize 10 garments from the collections (cf. Figure 10) of the Ethnography Museum of Bordeaux as well as as well as a reconstruction of an alabaster (cf. Figure 9) within the framework of the project LaBeX "Albâtres" project and will continue to be used the project VESPAA.

Gilet de Femme	Ceinture	Manteau

Show image description

Examples of numerical reconstructions from data acquired with La Coupole.

7.2.2 HYPERION: Measuring Bidirectional Subscattering Reflectance and Transmission Functions

Participants: Morgane Gerardin, Romain Pacanowski.

A new platform (cf. Figure 11), hyperion, to measure the volumetric properties of the light is currently being developed. The project started in March 2022 with the arrival of our new postdoctoral fellow Morgane Gérardin. The plaform permits to measure the diffusion of the light in reflection (aka BSSRDF) but also in Transmission (BSSTDF). A sample holder with two motorized axes orientates the sample wrt. to the direction of incident illumination while another motorized axis rotates a camera to image the sample (cf. Figure 12).

The platform has been validated with a publication in the journal Optics Express 12

Show image description

The BSSxDF measurement platform.

Show image description

Measurement principle

BSSRDF Data

• Contributors: Morgane Gérardin and Mathias Paulin and Romain Pacanowski
• Description: RAW and post-processed measurement data from the Optics Express publication
• Dataset PID (DOI,...): Dataset DOI
• Publications: 12
• Contact: Romain Pacanowski

8.1 Analysis and Simulation

8.1.1 Interactive Exploration of Vivid Material Iridescence using Bragg Mirrors

Participants: Gary Fourneau, Romain Pacanowski, Pascal Barla.

Many animals, plants or gems exhibit iridescent material appearance in nature. These are due to specific geometric structures at scales comparable to visible wavelengths, yielding so‐called structural colors. The most vivid examples are due to photonic crystals, where a same structure is repeated in one, two or three dimensions, augmenting the magnitude and complexity of interference effects. In this work 11, we study the appearance of 1D photonic crystals (repetitive pairs of thin films), also called Bragg mirrors. Previous work has considered the effect of multiple thin films using the classical transfer matrix approach, which increases in complexity when the number of repetitions increases. Our first contribution is to introduce a more efficient closed‐form reflectance formula for Bragg mirror reflectance to the Graphics community, as well as an approximation that lends itself to efficient spectral integration for RGB rendering. We then explore the appearance of stacks made of rough Bragg layers (Figure 13). Here our contribution is to show that they may lead to a ballistic transmission, significantly speeding up position‐free rendering and leading to an efficient single‐reflection BRDF model.

Show image description

Rendering of layered Bragg structures

8.2 From Acquisition to Display

8.2.1 Imaging device to measure the reflective and transmissive part of isotropic BSSRDF

Participants: Morgane Gerardin, Mathias Paulin, Romain Pacanowski.

The bidirectional scattering-surface reflectance distribution function (BSSRDF) is a fundamental scattering quantity that characterizes the appearance of translucent materials. The few existing BSSRDF measurement facilities that ensure traceable results have shown the high complexity of such measurement, while only accounting for light scattered in the reflection hemisphere. In the article 12, we present an imaging device for measuring both the reflective and the transmissive part of the spectral BSSRDF (see Figure 11). The complete analysis of the uncertainties associated with the facility allows relative measurement errors of around 10%. The measurements performed on two translucent samples and primary comparisons with metrological measurements are provided and discussed.

Show image description

The BSSxDF measurement platform.

8.3 Rendering, Visualization and Illustration

8.3.1 A Fully-correlated Anisotropic Micrograin BSDF Model

Participants: Simon Lucas, Mickaël Ribardière [Université de Poitiers], Romain Pacanowski, Pascal Barla.

We introduce an improved version of the micrograin BSDF model 71 for the rendering of anisotropic porous layers. Our approach 14 leverages the properties of micrograins to take into account the correlation between their height and normal, as well as the correlation between the light and view directions. This allows us to derive an exact analytical expression for the Geometrical Attenuation Factor (GAF), summarizing shadowing and masking inside the porous layer. This fully-correlated GAF is then used to define appropriate mixing weights to blend the BSDFs of the porous and base layers (Figure 15). Furthermore, by generalizing the micrograins shape to anisotropy, combined with their fully-correlated GAF, our improved BSDF model produces effects specific to porous layers such as retro-reflection visible on dust layers at grazing angles or height and color correlation that can be found on rusty materials. Finally, we demonstrate very close matches between our BSDF model and light transport simulations realized with explicit instances of micrograins, thus validating our model.

Show image description

Fully-correlated micrograin BSDF model

8.3.2 Non-Orthogonal Reduction for Rendering Fluorescent Materials in Non-Spectral Engines

Participants: Alban Fichet [Intel, Grenoble], Laurent Belcour [Intel, Grenoble], Pascal Barla.

We propose a method to accurately handle fluorescence in a non-spectral (e.g., tristimulus) rendering engine, showcasing color-shifting and increased luminance effects (Figure 16). Core to our method 10 is a principled reduction technique that encodes the re-radiation into a low-dimensional matrix working in the space of the renderer’s Color Matching Functions (CMFs). Our process is independent of a specific CMF set and allows for the addition of a non-visible ultraviolet band during light transport. Our representation visually matches full spectral light transport for measured fluorescent materials even for challenging illuminants.

Show image description

Rendering fluorescent materials in non-spectral engines.

8.3.3 Patch Decomposition for Efficient Mesh Contours Extraction

Participants: Panagiotis Tsiakpolis, Pierre Bénard.

Object-space occluding contours of triangular meshes (a.k.a. mesh contours) are at the core of many methods in computer graphics and computational geometry. A number of hierarchical data-structures have been proposed to accelerate their computation on the CPU, but they do not map well to the GPU for real-time applications, such as video games. We show in 17 that a simple, flat data-structure composed of patches bounded by a normal cone and a bounding sphere may reach this goal, provided it is constructed to maximize the probability for a patch to be culled over all viewpoints (Figure 17). We derive a heuristic metric to efficiently estimate this probability, and present a greedy, bottom-up algorithm that constructs patches by grouping mesh edges according to this metric. In addition, we propose an effective way of computing their bounding sphere. We demonstrate through extensive experiments that this data-structure achieves similar performance as the state-of-the-art on the CPU but is also perfectly adapted to the GPU, leading to up to x5 speedups.

Show image description

Patch decomposition for mesh contour extraction

8.4 Editing and Modeling

8.4.1 Inbetweening with Occlusions for Non-Linear Rough 2D Animation

Participants: Melvin Even, Pierre Bénard, Pascal Barla.

Representing 3D motion and depth through 2D animated drawings is a notoriously difficult task, requiring time and expertise when done by hand. Artists must pay particular attention to occlusions and how they evolve through time, a tedious process. Computer-assisted inbetweening methods such as cut-out animation tools allow for such occlusions to be handled beforehand using a 2D rig, at the expense of flexibility and artistic expression. In this work 26, we extend the flexible 2D animation framework of Even et al. 50 to handle occlusions. We do so by retaining three key properties of their system that are crucial to speed-up the animation process: input rough drawings, real-time preview, and non-linear animation editing. Our contribution is two-fold: a fast method to compute 2D masks from rough drawings with a semi-automatic dynamic layout system for occlusions between drawing parts; and an artist-friendly method to both automatically and manually control the dynamic visibility of strokes for self-occlusions. Such controls are not available in any traditional 2D animation software especially with rough drawings. Our system helps artists produce convincing 3D-like 2D animations (Figure 18), including head turns, foreshortening effects, out-of-plane rotations, overlapping volumes and even transparency.

Show image description

Flour sack animation produced with our rough 2D animation system

8.4.2 SMEAR: Stylized Motion Exaggeration with ARt-direction

Participants: Jean Basset, Pierre Bénard, Pascal Barla.

Smear frames are routinely used by artists for the expressive depiction of motion in animations. In this work 20, we present an automatic, yet art-directable method for the generation of smear frames in 3D, with a focus on elongated in-betweens where an object is stretched along its trajectory. It takes as input a key-framed animation of a 3D mesh, and outputs a deformed version of this mesh for each frame of the animation, while providing for artistic refinement at the end of the animation process and prior to rendering. Our approach works in two steps. We first compute spatially and temporally coherent motion offsets that describe to which extent parts of the input mesh should be leading in front or trailing behind. We then describe a framework to stylize these motion offsets in order to produce elongated in-betweens at interactive rates, which we extend to the other two common smear frame effects: multiple in-betweens and motion lines (see Figure 19). Novice users may rely on preset stylization functions for fast and easy prototyping, while more complex custom-made stylization functions may be designed by experienced artists through our geometry node implementation in Blender. The tool presented in this paper is available as an open-source Blender add-on. This project and future directions were also presented at the conference Vision & Depiction 23.

Show image description

3D jumping animation stylized with smear frames created with our method (elongated in-betweens, motion lines, multiple in-betweens)

8.5 Modeling environnemental impacts of digitization

8.5.1 Energy consumption of data transfer: Intensity indicators versus absolute estimates

Participants: Gaël Guennebaud, Aurélie Bugeau [Université de Bordeaux, LaBRI].

The assessment of energy consumption of data traffic for Internet services usually relies on energy intensity figures (in Wh/GB). In this work 13, we argue against using these indicators for evaluating the evolution of energy consumption of data transmission induced by changes in Internet usage. We describe a model that estimates global impacts for different scenarios of Internet usages and technological hypothesises, and show that it can overcome some limitations of intensity indicators. We experiment the model on four use-cases: basic usage, video streaming, large downloads, and video conferencing. Results show that increasing the resolution of videos does increase the total energy consumption while misleadingly decreasing the power intensity indicator at the same time. In other words, a more efficient network does not necessarily mean less energy consumption. Our model is publicly available as a web application illustrated in Figure 20.

Show image description

Parametric network model for streaming applications

9.1 Bilateral contracts with industry

10.1 International initiatives

10.2 National initiatives

10.3 Regional initiatives

11.1 Promoting scientific activities

11.2 Teaching - Supervision - Juries

11.3 Popularization

12.1 Major publications

• 1 articleL.Laurent Belcour and P.Pascal Barla. A Practical Extension to Microfacet Theory for the Modeling of Varying Iridescence.ACM Transactions on Graphics364July 2017, 65HALDOI
• 2 articleT.Thomas Crespel, P.Patrick Reuter, A.Adrian Travis, Y.Yves Gentet and X.Xavier Granier. Autostereoscopic transparent display using a wedge light guide and a holographic optical element: implementation and results.Applied optics5834November 2019HALDOI
• 3 articleN.Nicolas Holzschuch and R.Romain Pacanowski. A Two-Scale Microfacet Reflectance Model Combining Reflection and Diffraction.ACM Transactions on Graphics364Article 66July 2017, 12HALDOI
• 4 articleT.Thibaud Lambert, P.Pierre Bénard and G.Gaël Guennebaud. A View-Dependent Metric for Patch-Based LOD Generation & Selection.Proceedings of the ACM on Computer Graphics and Interactive Techniques11May 2018HALDOI
• 5 articleG.Georges Nader and G.Gaël Guennebaud. Instant Transport Maps on 2D Grids.ACM Transactions on Graphics376November 2018, 13HALDOI
• 6 articleA.Alexandra Schmid, P.Pascal Barla and K.Katja Doerschner. Material category of visual objects computed from specular image structure.Nature Human Behaviour77July 2023, 1152-1169HALDOI
• 7 articleK.Kevin Vynck, R.Romain Pacanowski, A.Adrian Agreda, A.Arthur Dufay, X.Xavier Granier and P.Philippe Lalanne. The visual appearances of disordered optical metasurfaces.Nature Materials21May 2022, 1035-1041HALDOIback to text

12.2 Publications of the year

12.3 Cited publications

• 29 articleM.Marc Alexa and W.Wojciech Matusik. Reliefs as images.ACM Trans. Graph.2942010, URL: http://doi.acm.org/10.1145/1778765.1778797DOIback to text
• 30 articleL.Lucas Ammann, P.Pascal Barla, X.Xavier Granier, G.Gaël Guennebaud and P.Patrick Reuter. Surface Relief Analysis for Illustrative Shading.Computer Graphics Forum314June 2012, 1481-1490URL: http://hal.inria.fr/hal-00709492DOIback to textback to text
• 31 techreportM.Michael Ashikhmin and S.Simon Premoze. Distribution-based BRDFs.unpublishedUniv. of Utah2007back to text
• 32 articleB.Brad Atcheson, I.Ivo Ihrke, W.Wolfgang Heidrich, A.Art Tevs, D.Derek Bradley, M.Marcus Magnor and H.-P.Hans-Peter Seidel. Time-resolved 3D Capture of Non-stationary Gas Flows.ACM Trans. Graph.2752008back to text
• 33 bookO.Oliver Bimber and R.Ramesh Raskar. Spatial Augmented Reality: Merging Real and Virtual Worlds.A K Peters/CRC Press2005back to textback to text
• 34 articleA.Adrien Bousseau, E.Emmanuelle Chapoulie, R.Ravi Ramamoorthi and M.Maneesh Agrawala. Optimizing Environment Maps for Material Depiction.Comput. Graph. Forum (Proceedings of the Eurographics Symposium on Rendering)3042011, URL: http://www-sop.inria.fr/reves/Basilic/2011/BCRA11back to text
• 35 articleS.Simon Boyé, G.Gaël Guennebaud and C.Christophe Schlick. Least Squares Subdivision Surfaces.Comput. Graph. Forum2972010, 2021-2028URL: http://hal.inria.fr/inria-00524555/enback to text
• 36 articleS.Stefan Bruckner and M. E.Meister Eduard Gröller. Style Transfer Functions for Illustrative Volume Rendering.Comput. Graph. Forum2632007, 715-724URL: http://www.cg.tuwien.ac.at/research/publications/2007/bruckner-2007-STF/back to text
• 37 inproceedingsC.Chris Buehler, M.Michael Bosse, L.Leonard McMillan, S.Steven Gortler and M.Michael Cohen. Unstructured lumigraph rendering.Proc. ACM SIGGRAPH2001, 425-432URL: http://doi.acm.org/10.1145/383259.383309DOIback to text
• 38 articleO.Ozan Cakmakci, S.Sophie Vo, K. P.Kevin P. Thompson and J. P.Jannick P. Rolland. Application of radial basis functions to shape description in a dual-element off-axis eyewear display: Field-of-view limit.J. Society for Information Display16112008, 1089-1098DOIback to text
• 39 articleE.Eva Cerezo, F.Frederic Perez-Cazorla, X.Xavier Pueyo, F.Francisco Seron and F. X.François Xavier Sillion. A Survey on Participating Media Rendering Techniques.The Visual Computer2005HALback to text
• 40 inproceedingsJ.Jiazhou Chen, X.Xavier Granier, N.Naiyang Lin and Q.Qunsheng Peng. On-Line Visualization of Underground Structures using Context Features.Symposium on Virtual Reality Software and Technology (VRST)ACM2010, 167-170URL: http://hal.inria.fr/inria-00524818/enDOIback to text
• 41 articleJ.Jiazhou Chen, G.Gaël Guennebaud, P.Pascal Barla and X.Xavier Granier. Non-oriented MLS Gradient Fields.Computer Graphics ForumDecember 2013, URL: http://hal.inria.fr/hal-00857265back to text
• 42 articleO.Oliver Cossairt, S.Shree Nayar and R.Ravi Ramamoorthi. Light field transfer: global illumination between real and synthetic objects.ACM Trans. Graph.2732008, URL: http://doi.acm.org/10.1145/1360612.1360656DOIback to textback to textback to textback to text
• 43 articleF.F. Cuny, L.L. Alonso and N.Nicolas Holzschuch. A novel approach makes higher order wavelets really efficient for radiosity.Comput. Graph. Forum1932000, 99-108back to text
• 44 articleE.Eugene D'Eon and G.Geoffrey Irving. A quantized-diffusion model for rendering translucent materials.ACM Trans. Graph.3042011, URL: http://doi.acm.org/10.1145/2010324.1964951DOIback to text
• 45 inproceedingsK. J.Kristin J. Dana, B.Bram van Ginneken, S.Shree Nayar and J. J.Jan J. Koenderink. Reflectance and texture of real-world surfaces.IEEE Conference on Computer Vision and Pattern Recognition (ICCV)1997, 151-157back to text
• 46 articleY.Yue Dong, J.Jiaping Wang, F.Fabio Pellacini, X.Xin Tong and B.Baining Guo. Fabricating spatially-varying subsurface scattering.ACM Trans. Graph.2942010, URL: http://doi.acm.org/10.1145/1778765.1778799DOIback to text
• 47 bookP.Philip Dutré, K.Kavita Bala and P.Philippe Bekaert. Advanced Global Illumination.A.K. Peters2006back to textback to text
• 48 articleK.Kevin Egan, F.Florian Hecht, F.Frédo Durand and R.Ravi Ramamoorthi. Frequency analysis and sheared filtering for shadow light fields of complex occluders.ACM Trans. Graph.3022011, URL: http://doi.acm.org/10.1145/1944846.1944849DOIback to text
• 49 articleK.Kevin Egan, Y.-T.Yu-Ting Tseng, N.Nicolas Holzschuch, F.Frédo Durand and R.Ravi Ramamoorthi. Frequency Analysis and Sheared Reconstruction for Rendering Motion Blur.ACM Trans. Graph.2832009, URL: http://hal.inria.fr/inria-00388461/enDOIback to textback to textback to text
• 50 articleM.Melvin Even, P.Pierre Bénard and P.Pascal Barla. Non-linear Rough 2D Animation using Transient Embeddings.Computer Graphics ForumMain: 15 pages, 19 figures. Supplementary: 2 pages. Submitted to Eurographics.May 2023HALDOIback to text
• 51 articleR.Roland Fleming, A.Antonio Torralba and E. H.Edward H. Adelson. Specular reflections and the perception of shape.J. Vis.492004, 798-820URL: http://journalofvision.org/4/9/10/back to text
• 52 inproceedingsA.Abhijeet Ghosh, S.Shruthi Achutha, W.Wolfgang Heidrich and M.Matthew O'Toole. BRDF Acquisition with Basis Illumination.IEEE International Conference on Computer Vision (ICCV)2007, 1-8back to text
• 53 articleM.Michael Goesele, X.Xavier Granier, W.Wolfgang Heidrich and H.-P.Hans-Peter Seidel. Accurate Light Source Acquisition and Rendering.ACM Trans. Graph.2232003, 621-630URL: http://hal.inria.fr/hal-00308294DOIback to textback to text
• 54 inproceedingsC. M.Cindy M. Goral, K. E.Kenneth E. Torrance, D. P.Donald P. Greenberg and B.Bennett Battaile. Modeling the interaction of light between diffuse surfaces.Proc. ACM SIGGRAPH1984, 213-222back to text
• 55 articleM.Milos Hasan, M.Martin Fuchs, W.Wojciech Matusik, H.Hanspeter Pfister and S.Szymon Rusinkiewicz. Physical reproduction of materials with specified subsurface scattering.ACM Trans. Graph.2942010, URL: http://doi.acm.org/10.1145/1778765.1778798DOIback to textback to text
• 56 phdthesisP. S.Paul S. Heckbert. Simulating Global Illumination Using Adaptative Meshing.University of California1991back to text
• 57 articleM. B.Matthias B. Hullin, M.Martin Fuchs, I.Ivo Ihrke, H.-P.Hans-Peter Seidel and H. P.Hendrik P. A. Lensch. Fluorescent immersion range scanning.ACM Trans. Graph.2732008, URL: http://doi.acm.org/10.1145/1360612.1360686DOIback to text
• 58 articleM. B.Matthias B. Hullin, J.Johannes Hanika, B.Boris Ajdin, H.-P.Hans-Peter Seidel, J.Jan Kautz and H. P.Hendrik P. A. Lensch. Acquisition and analysis of bispectral bidirectional reflectance and reradiation distribution functions.ACM Trans. Graph.2942010, URL: http://doi.acm.org/10.1145/1778765.1778834DOIback to text
• 59 articleM. B.Matthias B. Hullin, H. P.Hendrik P. A. Lensch, R.Ramesh Raskar, H.-P.Hans-Peter Seidel and I.Ivo Ihrke. Dynamic Display of BRDFs.Comput. Graph. Forum3022011, 475--483URL: http://dx.doi.org/10.1111/j.1467-8659.2011.01891.xDOIback to textback to textback to textback to text
• 60 articleI.Ivo Ihrke, K. N.Kiriakos N. Kutulakos, H. P.Hendrik P. A. Lensch, M.Marcus Magnor and W.Wolfgang Heidrich. Transparent and Specular Object Reconstruction.Comput. Graph. Forum2982010, 2400-2426back to text
• 61 inproceedingsI.Ivo Ihrke, I.Ilya Reshetouski, A.Alkhazur Manakov, A.Art Tevs, M.Michael Wand and H.-P.Hans-Peter Seidel. A Kaleidoscopic Approach to Surround Geometry and Reflectance Acquisition.IEEE Conf. Computer Vision and Pattern Recognition Workshops (CVPRW)IEEE Computer Society2012, 29-36back to textback to textback to text
• 62 inproceedingsI.Ivo Ihrke, G.Gordon Wetzstein and W.Wolfgang Heidrich. A theory of plenoptic multiplexing.IEEE Conf. Computer Vision and Pattern Recognition (CVPR)\bf oralIEEE Computer Society2010, 483-490back to textback to text
• 63 inproceedingsJ. T.James T. Kajiya. The rendering equation.Proc. ACM SIGGRAPH1986, 143-150URL: http://doi.acm.org/10.1145/15922.15902DOIback to textback to text
• 64 inproceedingsJ.Jan Kautz, P.-P.Peter-Pike Sloan and J.John Snyder. Fast, arbitrary BRDF shading for low-frequency lighting using spherical harmonics.Proc. Eurographics workshop on Rendering (EGWR)Pisa, Italy2002, 291-296back to text
• 65 articleI.Ilhan Kaya, K. P.Kevin P. Thompson and J. P.Jannick P. Rolland. Edge clustered fitting grids for $$-polynomial characterization of freeform optical surfaces.Opt. Express19272011, 26962-26974URL: http://www.opticsexpress.org/abstract.cfm?URI=oe-19-27-26962DOIback to text
• 66 articleM.Michael Kolomenkin, I.Ilan Shimshoni and A.Ayellet Tal. Demarcating curves for shape illustration.ACM Trans. Graph. (SIGGRAPH Asia)2752008, URL: http://doi.acm.org/10.1145/1409060.1409110DOIback to text
• 67 articleM.Marc Levoy, Z.Zhengyun Zhang and I.Ian McDowall. Recording and controlling the 4D light field in a microscope using microlens arrays.J. Microscopy23522009, 144-162URL: http://dx.doi.org/10.1111/j.1365-2818.2009.03195.xDOIback to text
• 68 articleS.Shen Li, G.Gaël Guennebaud, B.Baoguang Yang and J.Jieqing Feng. Predicted Virtual Soft Shadow Maps with High Quality Filtering.Comput. Graph. Forum3022011, 493-502URL: http://hal.inria.fr/inria-00566223/enback to text
• 69 articleC.-K.Chia-Kai Liang, T.-H.Tai-Hsu Lin, B.-Y.Bing-Yi Wong, C.Chi Liu and H. H.Homer H. Chen. Programmable aperture photography: multiplexed light field acquisition.ACM Trans. Graph.2732008, URL: http://doi.acm.org/10.1145/1360612.1360654DOIback to text
• 70 articleY.Yanli Liu and X.Xavier Granier. Online Tracking of Outdoor Lighting Variations for Augmented Reality with Moving Cameras.IEEE Transactions on Visualization and Computer Graphics184March 2012, 573-580URL: http://hal.inria.fr/hal-00664943DOIback to textback to text
• 71 inproceedingsS.Simon Lucas, M.Mickaël Ribardière, R.Romain Pacanowski and P.Pascal Barla. A Micrograin BSDF Model for the Rendering of Porous Layers.Siggraph Asia 2023 - The 16th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in AsiaSydney, AustraliaDecember 2023HALDOIback to text
• 72 articleW.Wojciech Matusik and H.Hanspeter Pfister. 3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes.ACM Trans. Graph.2332004, 814-824URL: http://doi.acm.org/10.1145/1015706.1015805DOIback to textback to textback to text
• 73 articleW.Wojciech Matusik, H.Hanspeter Pfister, M.Matt Brand and L.Leonard McMillan. A data-driven reflectance model.ACM Trans. Graph.2232003, 759-769URL: http://doi.acm.org/10.1145/882262.882343DOIback to text
• 74 inproceedingsG.Gero Müller, J.Jan Meseth, M.Mirko Sattler, R.Ralf Sarlette and R.Reinhard Klein. Acquisition, Synthesis and Rendering of Bidirectional Texture Functions.Eurographics 2004, State of the Art Reports2004, 69-94back to text
• 75 inproceedingsA.Andy Ngan, F.Frédo Durand and W.Wojciech Matusik. Experimental Analysis of BRDF Models.Proc. Eurographics Symposium on Rendering (EGSR)2005, 117-226back to text
• 76 bookF. E.F. E. Nicodemus, J. C.J. C. Richmond, J. J.J. J. Hsia, I. W.I. W. Ginsberg and T.T. Limperis. Geometrical Considerations and Nomenclature for Reflectance.National Bureau of Standards1977back to text
• 77 articleM.Matthew O'Toole and K. N.Kiriakos N. Kutulakos. Optical computing for fast light transport analysis.ACM Trans. Graph.2962010back to text
• 78 articleR.Romain Pacanowski, X.Xavier Granier, C.Christophe Schlick and P.Pierre Poulin. Volumetric Vector-based Representation for Indirect Illumination Caching.J. Computer Science and Technology (JCST)2552010, 925-932URL: http://hal.inria.fr/inria-00505132/enDOIback to text
• 79 articleR.Romain Pacanowski, O.Oliver Salazar-Celis, C.Christophe Schlick, X.Xavier Granier, P.Pierre Poulin and A.Annie Cuyt. Rational BRDF.IEEE Transactions on Visualization and Computer Graphics1811February 2012, 1824-1835URL: http://hal.inria.fr/hal-00678885DOIback to textback to textback to text
• 80 articleP.Pieter Peers, D.Dhruv Mahajan, B.Bruce Lamond, A.Abhijeet Ghosh, W.Wojciech Matusik, R.Ravi Ramamoorthi and P.Paul Debevec. Compressive light transport sensing.ACM Trans. Graph.2812009back to text
• 81 articleB.Benjamin Petit, J.-D.Jean-Denis Lesage, C.Clément Menier, J.Jérémie Allard, J.-S.Jean-Sébastien Franco, B.Bruno Raffin, E.Edmond Boyer and F.François Faure. Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration.Int. J. digital multimedia broadcasting2010Article ID 247108, 12 pages2010, URL: http://hal.inria.fr/inria-00436467DOIback to text
• 82 articleR.Ravi Ramamoorthi and P.Pat Hanrahan. On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object.J. Opt. Soc. Am. A18102001, 2448-2459back to text
• 83 articleR.Ravi Ramamoorthi, D.Dhruv Mahajan and P.Peter Belhumeur. A first-order analysis of lighting, shading, and shadows.ACM Trans. Graph.2612007, URL: http://doi.acm.org/10.1145/1189762.1189764DOIback to textback to textback to text
• 84 bookR.Ramesh Raskar and J.Jack Tumblin. Computational Photography: Mastering New Techniques for Lenses, Lighting, and Sensors.A K Peters/CRC Press2012back to text
• 85 bookE.Erik Reinhard, W.Wolfgang Heidrich, P.Paul Debevec, S.Sumanta Pattanaik, G.Greg Ward and K.Karol Myszkowski. High Dynamic Range Imaging: Acquisition, Display and Image-Based Lighting.2nd editionMorgan Kaufmann Publishers2010back to text
• 86 articleP.Peiran Ren, J.Jiaping Wang, J.John Snyder, X.Xin Tong and B.Baining Guo. Pocket reflectometry.ACM Trans. Graph.3042011back to text
• 87 articleP.Patrick Reuter, G.Guillaume Riviere, N.Nadine Couture, S.Stéphanie Mahut and L.Loïc Espinasse. ArcheoTUI-Driving virtual reassemblies with tangible 3D interaction.J. Computing and Cultural Heritage322010, 1-13URL: http://hal.inria.fr/hal-00523688/enDOIback to text
• 88 articleH. E.Holly E. Rushmeier and K. E.Kenneth E. Torrance. The zonal method for calculating light intensities in the presence of a participating medium.ACM SIGGRAPH Comput. Graph.2141987, 293-302URL: http://doi.acm.org/10.1145/37402.37436DOIback to text
• 89 inproceedingsS.Szymon Rusinkiewicz. A New Change of Variables for Efficient BRDF Representation.Proc. EGWR '981998, 11-22back to text
• 90 inproceedingsP.Peter Schröder and W.Wim Sweldens. Spherical wavelets: efficiently representing functions on the sphere.Proc. ACM SIGGRAPHannual conference on Computer graphics and interactive techniques1995, 161-172URL: http://doi.acm.org/10.1145/218380.218439back to text
• 91 bookF. X.François Xavier Sillion and C.Claude Puech. Radiosity and Global Illumination.Morgan Kaufmann Publishers1994back to text
• 92 articleC.Cyril Soler, K.Kartic Subr, F.Frédo Durand, N.Nicolas Holzschuch and F. X.François Xavier Sillion. Fourier Depth of Field.ACM Transactions on Graphics2822009, URL: http://hal.inria.fr/inria-00345902DOIback to text
• 93 articleM.Marc Stamminger, A.Annette Scheel, X.Xavier Granier, F.Frédéric Perez-Cazorla, G.George Drettakis and F. X.François Xavier Sillion. Efficient Glossy Global Illumination with Interactive Viewing.Computer Graphics Forum1912000, 13-25back to text
• 94 articleM.Michael Stark, J.James Arvo and B.Brian Smits. Barycentric Parameterizations for Isotropic BRDFs.IEEE Trans. Vis. and Comp. Graph.1122005, 126-138URL: http://dx.doi.org/10.1109/TVCG.2005.26back to text
• 95 bookW.William Thompson, R.Roland Fleming, S.Sarah Creem-Regehr and J. K.Jeanine Kelly Stefanucci. Visual Perception from a Computer Graphics Perspective.A K Peters/CRC Press2011back to textback to text
• 96 articleY.-T.Yu-Ting Tsai and Z.-C.Zen-Chung Shih. All-Frequency Precomputed Radiance Transfer Using Spherical Radial Basis Functions and Clustered Tensor Approximation.ACM Trans. Graph.2532006, 967-976back to text
• 97 inproceedingsD.David Vanderhaeghe, R.Romain Vergne, P.Pascal Barla and W.William Baxter. Dynamic Stylized Shading Primitives.Proc. Int. Symposium on Non-Photorealistic Animation and Rendering (NPAR)ACM2011, 99-104URL: http://hal.inria.fr/hal-00617157/enback to textback to text
• 98 articleP.Peter Vangorp, J.Jurgen Laurijssen and P.Philip Dutré. The influence of shape on the perception of material reflectance.ACM Trans. Graph.2632007, URL: http://doi.acm.org/10.1145/1276377.1276473DOIback to text
• 99 inproceedingsE.Eric Veach and L. J.Leonidas J. Guibas. Metropolis light transport.Proc. SIGGRAPH '97annual conference on Computer graphics and interactive techniquesACM/Addison-Wesley Publishing Co.1997, 65-76URL: http://doi.acm.org/10.1145/258734.258775back to text
• 100 articleR.Romain Vergne, P.Pascal Barla, R.Roland Fleming and X.Xavier Granier. Surface Flows for Image-based Shading Design.ACM Trans. Graph.3132012, URL: http://hal.inria.fr/hal-00702280back to textback to text
• 101 articleR.Romain Vergne, R.Romain Pacanowski, P.Pascal Barla, X.Xavier Granier and C.Christophe Schlick. Improving Shape Depiction under Arbitrary Rendering.IEEE Trans. Visualization and Computer Graphics1782011, 1071-1081URL: http://hal.inria.fr/inria-00585144/enDOIback to textback to textback to text
• 102 articleR.Romain Vergne, R.Romain Pacanowski, P.Pascal Barla, X.Xavier Granier and C.Christophe Schlick. Light warping for enhanced surface depiction.ACM Trans. Graph.283\it front cover2009, 25:1URL: http://doi.acm.org/10.1145/1531326.1531331DOIback to text
• 103 articleR.Romain Vergne, D.David Vanderhaeghe, J.Jiazhou Chen, P.Pascal Barla, X.Xavier Granier and C.Christophe Schlick. Implicit Brushes for Stylized Line-based Rendering.Comput. Graph. Forum302\bf 3\textsuperscript{rd} best paper award2011, 513-522URL: http://hal.inria.fr/inria-00569958/enDOIback to text
• 104 articleF.Forest Vincent, L.Loïc Barthe, G.Gaël Guennebaud and M.Mathias Paulin. Soft Textured Shadow Volume.Comput. Graph. Forum2842009, 1111-1120URL: http://hal.inria.fr/inria-00390534/enback to text
• 105 articleJ.Jiaping Wang, Y.Yue Dong, X.Xin Tong, Z.Zhouchen Lin and B.Baining Guo. Kernel Nyström method for light transport.ACM Trans. Graph.2832009back to text
• 106 articleB.Baoguang Yang, J.Jieqing Feng, G.Gaël Guennebaud and X.Xinguo Liu. Packet-based Hierarchical Soft Shadow Mapping.Comput. Graph. Forum2842009, 1121-1130URL: http://hal.inria.fr/inria-00390541/enback to text