In 2010, Palmer Luckey designed the first prototype of the Oculus Rift. This prototype, built on a shell of another virtual reality headset, was only capable of rotational tracking. However, it boasted a 90-degree field of vision that was previously unseen in the consumer market at the time. Distortion issues arising from the lens used to create the field of vision were corrected for by software written by John Carmack for a version of Doom 3. This initial design would later serve as a basis from which the later designs came. In 2012, the Rift is presented for the first time at the E3 gaming trade show by Carmack. In 2014, Facebook purchased Oculus VR for what at the time was stated as $2 billion but later revealed that the more accurate figure was $3 billion. This purchase occurred after the first development kits ordered through Oculus' 2012 Kickstarter had shipped in 2013 but before the shipping of their second development kits in 2014. Zenimax, Carmack's former employer, sued Oculus and Facebook for taking company secrets to Facebook; the verdict was in favour of Zenimax, settled out of court later. https://www.aliexpress.com/item/9880-Anti-Police-Anti-Radar-Detector-Touch-Button-Laser-eye-360-degree-detection-Fully-16-bands/32847951694.html
The more powerful Vive Pro offers a higher-resolution display, outward-facing cameras, and a handful of other enhanced features, but it isn't nearly as compelling as the regular Vive; it costs $300 more, and doesn't include the base stations and motion controllers needed to work, so you effectively need to already have a Vive or spend even more money to get set up with it. If that isn't enough power, the Vive Pro Eye adds built-in eye-tracking to the already advanced headset. https://www.aliexpress.com/item/Insta360-ONE-360-Camera-Sport-Action-Video-Camera-VR-Panoramic-Camera-24MP-7K-Photos-4K-Videos/32878260145.html
Morton Heilig wrote in the 1950s of an "Experience Theatre" that could encompass all the senses in an effective manner, thus drawing the viewer into the onscreen activity. He built a prototype of his vision dubbed the Sensorama in 1962, along with five short films to be displayed in it while engaging multiple senses (sight, sound, smell, and touch). Predating digital computing, the Sensorama was a mechanical device. Heilig also developed what he referred to as the "Telesphere Mask" (patented in 1960). The patent application described the device as "a telescopic television apparatus for individual use...The spectator is given a complete sensation of reality, i.e. moving three dimensional images which may be in colour, with 100% peripheral vision, binaural sound, scents and air breezes." https://www.aliexpress.com/item/6-Magnetic-Rotating-Globe-Anti-Gravity-Floating-Levitating-Earth-360-degree-Rotating-For-Desktop-Office-Home/32885659597.html
Nintendo's Labo series of games/arts-and-crafts sets for the Nintendo Switch have interested us since the first Labo Variety Kit came out. You build your own controllers with cardboard and play games using the Switch and motion-sensing Joy-Con controllers. Now Nintendo has returned to VR (a field it hasn't set foot in since the ill-fated Virtual Boy) with its fourth Labo package, the Labo VR Kit.
But the competition is closer than ever. Vive is also excellent (and still offers the best room scale), while the Sony PlayStation VR is a big seller thanks to its significantly lower price and the ubiquity of PlayStation 4 consoles ready to run it. There are now better standalone VR headsets too if you want a hassle-free route to the immersive realms. https://www.youtube.com/watch?v=JrAd-c1ZQ6g&t=1s
All this sounds fantastic and amazing, which it is, but it comes with its fair share of challenges when creating this content. Before I jump into those, take a look at the final product I created for the client, so you have a better understanding of what I’m talking about as I go (Note: For best experience, view on phone or tablet. If you’re on a computer, you can still view it just fine, just click and drag around the screen to change your view):
Everything that we know about our reality comes by way of our senses. In other words, our entire experience of reality is simply a combination of sensory information and our brains sense-making mechanisms for that information. It stands to reason then, that if you can present your senses with made-up information, your perception of reality would also change in response to it. You would be presented with a version of reality that isn’t really there, but from your perspective it would be perceived as real. Something we would refer to as a virtual reality. https://www.aliexpress.com/item/Blueskysea-B1W-Dash-Camera-Car-Dvr-Full-HD-1080P-Mini-WiFi-Dash-Cam-360-Degree-Rotate/32846376624.html
Details remain scarce on the Cosmos, which looks like it may attempt to bridge the quality gap between tethered and untethered headsets. The Cosmos will require tethering to another device, but it may not be limited to high-end gaming PCs. A VR headset that can tether to a smartphone? Interesting idea. The Vive Cosmos promises “crystal-clear graphics” thanks to a new pixel-packing process that aims to minimize screen door effect as much as possible. The HMD’s tracking system promises wide and accurate tracking, gesture controls, and a 6 Degrees of freedom (DOF) headset-and-controller setup. No word on price or release date for the Cosmos yet, but expect it sometime in the second half of 2019.
Many other companies are developing Virtual Reality headsets and other peripherals. Upcoming hardware includes the GenBasic Quad HD, StarVR StarOne, Vrgineers XTAL and Pansonite VR Headset. As more and better hardware hits the market, it will continue to power a growing ecosystem of hardware manufacturers, software developers, and content providers. https://www.youtube.com/watch?v=sh9giaTKbv4&t=1s
Morton Heilig wrote in the 1950s of an "Experience Theatre" that could encompass all the senses in an effective manner, thus drawing the viewer into the onscreen activity. He built a prototype of his vision dubbed the Sensorama in 1962, along with five short films to be displayed in it while engaging multiple senses (sight, sound, smell, and touch). Predating digital computing, the Sensorama was a mechanical device. Heilig also developed what he referred to as the "Telesphere Mask" (patented in 1960). The patent application described the device as "a telescopic television apparatus for individual use...The spectator is given a complete sensation of reality, i.e. moving three dimensional images which may be in colour, with 100% peripheral vision, binaural sound, scents and air breezes."
Alright, I’m going to walk you through my specific process, although some people may do things in a slightly different order. Let’s jump back to the import. The camera I used records to 2 separate Micro SD cards, so I have to import both. In the “Ingested Footage” folder for that day’s shoot, I put a folder for one card, “Front” and one card, “Back”. Then I use the stitching software and export final stitches for every clip to a third folder I call “Stitched”. Then I dropped each of those stitched files into Adobe After Effects and mask myself, other, gear, and tripod out of the shot. This way I have clean video with only the model in it. I export these as individual files as well. https://www.youtube.com/watch?v=UTxTOXSVSQs&t=1s
In Virtual Reality, the computer uses similar sensors and math. However, rather than locating a real camera within a physical environment, the position of the user’s eyes are located within the simulated environment. If the user’s head turns, the graphics react accordingly. Rather than compositing virtual objects and a real scene, VR technology creates a convincing, interactive world for the user.
Virtual reality is the creation of a virtual environment presented to our senses in such a way that we experience it as if we were really there. It uses a host of technologies to achieve this goal and is a technically complex feat that has to account for our perception and cognition. It has both entertainment and serious uses. The technology is becoming cheaper and more widespread. We can expect to see many more innovative uses for the technology in the future and perhaps a fundamental way in which we communicate and work thanks to the possibilities of virtual reality. https://www.youtube.com/watch?v=R87vKcV0l4k&t=1s
After doing this over and over, revision after revision, eventually I have a final draft to export. In the export window, it is important that I ensure the “VR” is still enabled. What this does is put that specification in the metadata file so that sites like YouTube and Vimeo know to play it as 360° VR footage. Then I can upload it and ensure the playback is the way I want it. https://www.youtube.com/watch?v=RiANSSgCuJk&t=1s
Augmented reality (AR) is a type of virtual reality technology that blends what the user sees in their real surroundings with digital content generated by computer software. The additional software-generated images with the virtual scene typically enhance how the real surroundings look in some way. AR systems layer virtual information over a camera live feed into a headset or smartglasses or through a mobile device giving the user the ability to view three-dimensional images. https://www.youtube.com/watch?v=JI-ectchft8&t=1s
Convincing Virtual Reality applications require more than just graphics. Both hearing and vision are central to a person’s sense of space. In fact, human beings react more quickly to audio cues than to visual cues. In order to create truly immersive Virtual Reality experiences, accurate environmental sounds and spatial characteristics are a must. These lend a powerful sense of presence to a virtual world. To experience the binaural audio details that go into a Virtual Reality experience, put on some headphones and tinker with this audio infographic published by The Verge.
In projector-based virtual reality, modeling of the real environment plays a vital role in various virtual reality applications, such as robot navigation, construction modeling, and airplane simulation. Image-based virtual reality system has been gaining popularity in computer graphics and computer vision communities. In generating realistic models, it is essential to accurately register acquired 3D data; usually, camera is used for modeling small objects at a short distance. https://www.aliexpress.com/item/MYKPOP-BTS-Mobile-Phone-Holder-BT21-Holloween-360-Degree-Rotate-Desk-Holder-for-all-Smart/32952202244.html
The trade-off, besides the clunky cables, is the price. The least expensive tethered options are currently around $400. And that's before you address the processing issue; the Rift S and the Vive both need pretty powerful PCs to run, while the PS VR requires a PlayStation 4. If the cost isn't a deal breaker but the cables are, HTC offers a wireless adapter for the Vive, but it requires a desktop PC with a free PCIe slot to work. There are also third-party wireless adapters for the Rift, but we can't guarantee how well they work. https://www.youtube.com/watch?v=vd0OKYKBEPc&t=1s
In 2001, SAS Cube (SAS3) became the first PC-based cubic room, developed by Z-A Production (Maurice Benayoun, David Nahon), Barco, and Clarté. It was installed in Laval, France. The SAS3 library gave birth to Virtools VRPack. In 2007, Google introduced Street View, a service that shows panoramic views of an increasing number of worldwide positions such as roads, indoor buildings and rural areas. It also features a stereoscopic 3D mode, introduced in 2010. https://www.youtube.com/watch?v=GwavYvtumKA&t=1s