Better computer graphics based on gaze direction

Matias Koskela 12.12.2018

Koskela

Virtual Reality (VR) and Augmented Reality (AR) are already starting to have a huge impact on how people work and entertain themselves. These technologies are very dependent on computer graphics and so, the field will see major changes during the next decade.

Foveated rendering

Displays for VR and AR usually have only one user and

 

it can be measured what part of the screen the user is looking at. Leaps in image quality can be achieved with so called foveated rendering, which is a graphics optimization that focuses rendering computations in the area where the user's gaze is fixed.

Path tracing

Currently rendering for VR and AR applications is done with so called rasterization. However, conventionally non-real-time rendering method of path tracing is an interesting option, because it generates better image quality. Moreover, it allows flexible sampling in screen space, which perfectly suits to the idea of foveated rendering.

In my PhD Thesis project, the two worlds of path tracing and foveated VR rendering are combined. The objective is to enable photo-realistic real-time rendering in VR and AR. In the project, we have developed new ways of distributing the path tracing samples and reconstructing noise free images from them. The hard part of the process is that samples are both sparse and noisy. Our goal is to reconstruct an image where the user doesn’t notice any errors. At the same time, we try to reduce the number of samples so much that the offline rendering method of path tracing can be done in real-time.

More info can be found at the group’s webpage: www.tut.fi/vga

Matias Koskela is a doctoral student in Virtual reality and Graphics Architectures (VGA) group at Laboratory of Pervasive Computing in Tampere University of Technology. His research interests include optimizations and parallelism in real-time rendering, especially in real-time ray tracing.

Uusimmat artikkelit

Design and Implementation of Efficient Working Hydraulics of Electrified Non-Road Mobile Machinery for Enhancing Environmental Sustainability

Kirjoittajalta Tekniikan edistämissäätiö / 5.1.2024

Design and Implementation of Efficient Working Hydraulics of Electrified Non-Road Mobile Machinery for Enhancing Environmental Sustainability 5.1.2024/Text: Vinay Partap Singh Design and Implementation of Efficient Working Hydraulics of Electrified Non-Road Mobile Machinery for Enhancing Environmental Sustainability The almost inevitable climate crisis is forcing governments, and industries across all spectrums to make every possible effort to avoid…

Verinäyte on ikkuna syöpäsolun tumaan

Kirjoittajalta Tekniikan edistämissäätiö / 4.1.2024

Verinäyte on ikkuna syöpäsolun tumaan 4.1.2024/Teksti: Joonatan Sipola Ihmisen verenkierrossa on kuolleista soluista vapautuneita DNA-pätkiä. Pitkälle edenneen syövän potilailla osa tästä on usein peräisin syöpäsoluista – soluista jotka toimivat virheellisesti DNA:han tulleiden muutosten takia. Täten yksinkertaisesta verinäytteestä voidaan nähdä suoraan syövän ytimeen, siihen mistä sen yksilöllinen käyttäytyminen johtuu. Maisemat ovat avarat Analysoimalla DNA-pätkien emäsparisekvenssit voidaan…

Nitrides for brighter future

Kirjoittajalta Marianna / 6.6.2023

Nitrides for brighter future 6.6.2023/Text: Igor Prozheev Ever since discovery of semiconductors and their first application in transistors in the middle of the 20th century, academic and industrial researches were developing these wonderful materials. Following the requirement to enhance performance while reducing production costs, enthusiasts were able to pack high power in miniature sizes. Remember…