Multi-frequency Shading and VR.

Multi-frequency Shading and VR.

Our peripheral vision is low resolution but high frequency, our focus vision is high resolution but slower frequency updates. This is one of the reasons 60hz isn't good enough for VR, at the edges most people can consciously see the flicker still.

Additional of course VR is stereoscopic, so requires two views of everything and low latency response, whilst you can just run everything at 90hz or even 144hz this is expensive performance and power wise.

Multi-frequency shading solves the issue by sharing where possible some calculation over time and space (view ports). Of course for this work, we need to break down the rendering into parts that are the same (or close enough) to be ran as shared.

Perhaps the oldest split has been diffuse versus specular. diffuse lighting is only dependent on light position and the surface being lit, so camera changes can be ignored. This has been used in lightmaps for a long time. For VR this means that diffuse lighting can be shared between eyes. Except for shadowing and GI it also only needs updating at the rate objects move, which may be infrequently.

So lets start with that split, decouple diffuse lighting from the entire equation. The first problem then is how we store these diffuse light values so they can be quickly picked up when required. A classic approach is to use a hash over the spatial position as a key into a fixed sized cache. The diffuse update runs asynchronous at for example 30hz, this is looked up at full display frequency (say 120hz) with specular and other high frequency effects are added.

This is in essence what light maps do but with a 0hz update rate, the 3d spatial lookup replaced with a surface based 2D lookup.

The question then becomes history management, how do you look up diffuse value in space (hash storage?) and do you need some form of cache replacement system to ensure that stall diffuse values get kicked out.

Again the key to high quality and fast VR seems to me to lay in changing how we define a frame. Decouple the display rate from the rest of renderer, allowing for the brain and other effects to paper over the differences. With only a tiny amount of time any error will be visible, its likely you want notice that its actually wrong sometimes.

However whether this is true, depends on wet-ware in our heads so only way to know is to try and see if anyone pukes up or gets a splitting headache.

Deano out

Comments

  1. Play Casino Review: Risk-Free Bet No Deposit on Dream
    Welcome Bonus air jordan 18 stockx to us Details. No Deposit air jordan 18 retro varsity red on sale Free Bets Available · Betting Terms · Wagering Requirements · Player Support air jordan 18 retro varsity red sports · Minimum jordan 18 white royal blue good site Deposit – £/€ 5 · where to order air jordan 18 retro men red Player

    ReplyDelete
  2. 저희는 우리카지노쿠폰 및 우리카지노계열 사이트중 우리카지노만 엄선하여 추천 및 주소를 안내해드리고, 가입 및 쿠폰문의도 받고있습니다. 그리고 우리카지노총판 문의도 받고있으니 앞으로 많은 문의 부탁드립니다. 안드로이드 스마트폰, 태블릿, 아이폰(아이폰, 아이패드) 등 모바일 기기를 이용해 고화질 라이브 카지노와 스포츠토토에 베팅을 할 바카라사이트쿠폰 수 있다. 쇼핑몰에서 원하는 옷을 주문하는 것과 비슷하며, 게임을 매우 쉽게 충전할 수 있도록 제공된다. 또한 24시간 고객센터를 통해 한국어 상담을 통해 빠른 확인과 서비스를 받을 수 있습니다. 전체 게임은 바카라, 룰렛, 블랙잭 등이 있으며 과거와 달리 플래시 시스템이 아닌 로컬 라이브 영상 전송 기준 1초 지연 없이 게임을 진행할 수 있다.

    ReplyDelete
  3. Check out the fast game rules earlier than your first spin and you’ll get much more out of your play. First off, get yourself a passport to Planet OJO by signing up 토토사이트 for free. Once you’re logged in, you’ll have entry to our galaxy of free and actual cash UK on-line on line casino video games. Funding your account is easy too, with immediate deposits using all main debit playing cards and e-wallets like PayPal. On many machines, when enough cash to afford a bonus is taken in, the bonus is not immediately awarded. Typically the game merely stops making the reels slip off the bonus symbols for a few of} video games.

    ReplyDelete

Post a Comment

Popular posts from this blog

Getting into Unity3D

Skinning Roger Rabbit AKA Are we there yet?