All this sounds fantastic and amazing, which it is, but it comes with its fair share of challenges when creating this content. Before I jump into those, take a look at the final product I created for the client, so you have a better understanding of what I’m talking about as I go (Note: For best experience, view on phone or tablet. If you’re on a computer, you can still view it just fine, just click and drag around the screen to change your view):
To a degree, I’ve made it sound harder than it actually is since software has compensated for much of this, but these were some of the questions I was asking when I was first learning. I then started learning that some standard editing procedures could still be done. For example, I can still create image masks in 360°. So in truth, I still stood behind the camera the whole time along with others and gear and then masked myself out with a separate cut of footage showing the empty room. And for the motion graphics, (I use Adobe software) the software has built-in accommodations for editing and viewing in the 3D space so as to create accurate graphics. So in truth, once I learned, it wasn’t that hard, but boy is it time-consuming.
In 2016, HTC shipped its first units of the HTC Vive SteamVR headset. This marked the first major commercial release of sensor-based tracking, allowing for free movement of users within a defined space. A patent filed by Sony in 2017 showed they were developing a similar location tracking technology to the Vive for PlayStation VR, with the potential for the development of a wireless headset.
Now I can start actually editing the timeline, put things to music, figure out transitions and where graphics will go. When I have a first cut of the timeline, I export sections at a time where motion graphics will be. Inside After Effects I can create a 3D camera using their “immersive” tools, convert all motion graphic to 3D layers and create the motion inside the immersive camera view. Viewing and editing on the flat, equirectangular format does little good to anyone. When motion graphics are done, I can export them and replace the original footage in the timeline with the newly exported motion graphic versions. https://www.aliexpress.com/item/Insta360-ONE-4K-360-VR-Video-Action-Sport-Camera-24MP-Bullet-Time-6-Axis-Gyroscope-Support/32842573257.html
In 2010, Palmer Luckey designed the first prototype of the Oculus Rift. This prototype, built on a shell of another virtual reality headset, was only capable of rotational tracking. However, it boasted a 90-degree field of vision that was previously unseen in the consumer market at the time. Distortion issues arising from the lens used to create the field of vision were corrected for by software written by John Carmack for a version of Doom 3. This initial design would later serve as a basis from which the later designs came. In 2012, the Rift is presented for the first time at the E3 gaming trade show by Carmack. In 2014, Facebook purchased Oculus VR for what at the time was stated as $2 billion but later revealed that the more accurate figure was $3 billion. This purchase occurred after the first development kits ordered through Oculus' 2012 Kickstarter had shipped in 2013 but before the shipping of their second development kits in 2014. Zenimax, Carmack's former employer, sued Oculus and Facebook for taking company secrets to Facebook; the verdict was in favour of Zenimax, settled out of court later. https://www.aliexpress.com/item/Tronsmart-Element-T6-Bluetooth-4-1-Portable-Speaker-Wireless-Soundbar-Audio-Receiver-Mini-Speakers-USB-AUX/32822658286.html
The Vive Pro sports a 2,880 x 1,600 resolution on a dual-OLED display, up from the Vive's 2,160 x 1,200 resolution. There's also dual cameras on the front that'll help track your hands and a 90Hz refresh rate with 70 sensors, giving you 360-degree head-tracking. It's not a leap to say that the Vive Pro is a monster. This is easily the most advanced VR headset out there, but it's also incredibly expensive, sitting at £799. If you don't need that added clarity, the Vive has all the same tricks. https://www.aliexpress.com/item/2019-M7-speed-Car-Radar-Detector-360-Degree-16-Band-Russia-English-Version-LED-Display-Anti/32924343117.html
Google and Samsung still offer phone-based VR headsets in the form of the Daydream View and the Gear VR, and even Nintendo has gotten into the game with its Labo VR Kit for the Nintendo Switch. However, these shell-like headsets, which require a phone or some other device physically inserted into them, feel like novelties next to more powerful headsets that can provide more immersive experiences. https://www.aliexpress.com/item/XM-Panoramic-360-VR-960P-1080P-3MP-HD-IP-Camera-Smart-LED-Lights-Cam-Starlight/32836066891.html
Convincing Virtual Reality applications require more than just graphics. Both hearing and vision are central to a person’s sense of space. In fact, human beings react more quickly to audio cues than to visual cues. In order to create truly immersive Virtual Reality experiences, accurate environmental sounds and spatial characteristics are a must. These lend a powerful sense of presence to a virtual world. To experience the binaural audio details that go into a Virtual Reality experience, put on some headphones and tinker with this audio infographic published by The Verge. https://www.youtube.com/watch?v=sQZfHnS3cG0&t=1s
In 1999, entrepreneur Philip Rosedale formed Linden Lab with an initial focus on the development of VR hardware. In its earliest form, the company struggled to produce a commercial version of "The Rig", which was realized in prototype form as a clunky steel contraption with several computer monitors that users could wear on their shoulders. The concept was later adapted into the personal computer-based, 3D virtual world program Second Life. https://www.youtube.com/watch?v=q-keAwnqwRQ&t=1s
If the last applies to you, you're likely a computer scientist or engineer, many of whom now avoid the words virtual reality even while they work on technologies most of us associate with VR. Today, you're more likely to hear someone use the words virtual environment (VE) to refer to what the public knows as virtual reality. We'll use the terms interchangeably in this article. https://www.aliexpress.com/item/Insta360-Pro-8K-360-VR-Video-Camera-4K-100fps-Slow-Motion-Anti-shake-Panoramic-Camera-VR/32832297122.html
Independent production of VR images and video has increased by the development of omnidirectional cameras, also known as 360-degree cameras or VR cameras, that have the ability to record 360 interactive photography, although at low-resolutions or in highly-compressed formats for online streaming of 360 video. In contrast, photogrammetry is increasingly used to combine several high-resolution photographs for the creation of detailed 3D objects and environments in VR applications.
In 2010, Palmer Luckey designed the first prototype of the Oculus Rift. This prototype, built on a shell of another virtual reality headset, was only capable of rotational tracking. However, it boasted a 90-degree field of vision that was previously unseen in the consumer market at the time. Distortion issues arising from the lens used to create the field of vision were corrected for by software written by John Carmack for a version of Doom 3. This initial design would later serve as a basis from which the later designs came. In 2012, the Rift is presented for the first time at the E3 gaming trade show by Carmack. In 2014, Facebook purchased Oculus VR for what at the time was stated as $2 billion but later revealed that the more accurate figure was $3 billion. This purchase occurred after the first development kits ordered through Oculus' 2012 Kickstarter had shipped in 2013 but before the shipping of their second development kits in 2014. Zenimax, Carmack's former employer, sued Oculus and Facebook for taking company secrets to Facebook; the verdict was in favour of Zenimax, settled out of court later. https://www.aliexpress.com/item/-/32871493166.html
Many other companies are developing Virtual Reality headsets and other peripherals. Upcoming hardware includes the GenBasic Quad HD, StarVR StarOne, Vrgineers XTAL and Pansonite VR Headset. As more and better hardware hits the market, it will continue to power a growing ecosystem of hardware manufacturers, software developers, and content providers. https://www.youtube.com/watch?v=sh9giaTKbv4&t=1s
The Oculus Touch controllers have made a world of difference since their arrival. Compared to the other headsets' controllers, they're our favourite – they conform to your hand and allow for some finger recognition, like a thumbs-up. Not just that, but when it comes to games Oculus has come on leaps and bounds. That's been largely helped by some developer cash injections from Facebook, giving us quality, polished titles like Lone Echo and Robo Recall. Room-scale support has been added too, though you'll need to purchase at least one additional sensor to get it to Vive-level tracking, and even then the Vive tracking experience is a little better in our experience.
The Fove setup is an 5.7-inch, 1440p display; a 100+ degree field of view; 70fps frame rate; and eye-tracking measured at 120fps. With the redesigned developer kit, gone are the big side panels and quite a lot of the heft of the last prototype design. The company promises the new model offers "dramatically reduced weight, size and overall wearability, as well as better production efficiency." You might have to wait a bit though – Fove hasn't confirmed plans for the consumer version just yet. https://www.aliexpress.com/item/YI-360-VR-Camera-220-degree-Dual-Lens-5-7K-30fps-Immersive-Live-stream-Effortless-Panoramic/32834344824.html
Expand your media adventures and social gaming communities with accessories and peripherals created for virtual reality. For example, a VR controller offers seamless integration with virtual reality games to give you more control over your virtual environment. Beyond PC gaming, virtual reality experiences also encompass other forms of video. Virtual reality-compatible cameras capable of filming in 360 degrees offer you the chance to view and edit your footage, along with other VR-ready components. https://www.youtube.com/watch?v=a54H2V06dqw&t=1s
After doing this over and over, revision after revision, eventually I have a final draft to export. In the export window, it is important that I ensure the “VR” is still enabled. What this does is put that specification in the metadata file so that sites like YouTube and Vimeo know to play it as 360° VR footage. Then I can upload it and ensure the playback is the way I want it. https://www.youtube.com/watch?v=zuS_GQfe7J0&t=1s
In 1979, Eric Howlett developed the Large Expanse, Extra Perspective (LEEP) optical system. The combined system created a stereoscopic image with a field of view wide enough to create a convincing sense of space. The users of the system have been impressed by the sensation of depth (field of view) in the scene and the corresponding realism. The original LEEP system was redesigned for NASA's Ames Research Center in 1985 for their first virtual reality installation, the VIEW (Virtual Interactive Environment Workstation) by Scott Fisher. The LEEP system provides the basis for most of the modern virtual reality headsets.
Virtual reality (VR) is an experience taking place within simulated and immersive environments that can be similar to or completely different from the real world. Applications of virtual reality can include entertainment (i.e. gaming) and educational purposes (i.e. medical or military training). Other, distinct types of VR style technology include augmented reality and mixed reality. https://www.youtube.com/watch?v=--yhkb7g9-0&t=1s
HTC's Vive is a comprehensive package that includes a headset, two motion controllers, and two base stations for defining a "whole-room" VR area. It's technically impressive, and can track your movements in a 10-foot cube instead of just from your seat. It also includes a set of motion controllers more advanced than the PlayStation Move. PC-tethered VR systems like the Vive need plenty of power, with HTC recommending at least an Intel Core i5-4590 CPU and a GeForce GTX 970 GPU. https://www.aliexpress.com/item/New-360-Degree-Reflective-Prism-Set-for-Leica-ATR-Total-station-Replaces-MPR122/32918809914.html
Samsung’s approach to VR was different right from the beginning, and the Gear VR was an impressive piece of tech when it was first released in November of 2015. The Gear VR was a far more common sight than an Oculus Rift or HTC Vive in 2016 and 2017, largely because Samsung often gave the device away free with the purchase of a Samsung Galaxy smartphone. Samsung’s VR HMD delivers a stripped-down VR experience, using Oculus head-tracking technology in combination with Android smartphones to power mobile VR experiences. Instead of dedicated display technology, lenses allow the phone’s screen to act as a stereoscopic display, making the device simpler and less expensive than other options. Samsung has added hand controllers to the Gear VR experience, bringing it more in line with current VR content. https://www.youtube.com/watch?v=JsuyAIANYnw&t=1s
One place Microsoft has succeeded in how easy it is to set up its WMR headsets. It uses inside-out tracking, so you won't need to go plug in a bunch of sensors to make sure your headset is being seen. These headsets have built-in cameras and sensors that handle all of that. They'll even track the Windows Mixed Reality controllers, which suffer a bit because they rely on the headset being able to see them clearly to properly track. https://www.aliexpress.com/item/New-14-Joint-360-Degree-Rotation-Resin-Nude-Naked-Female-Body-For-Bar-bie-Doll/32884974971.html
Basically, these AR headsets have transparent lenses that let you look at your surroundings, instead of completely replacing your vision with a computer-generated image. They can still project images over whatever you're looking at, but those images are designed to complement and interact with the area around you. You can make a web browser pop up in the middle of a room, for instance, or watch animals run around your coffee table. It's fascinating technology that could hint at the future of computing. https://www.aliexpress.com/item/Roofull-360-Degree-Action-Video-Camera-Wifi-Mini-2448-2448-16MP-Ultra-HD-Panorama-Camera-3D/32703486146.html
Nintendo's Labo series of games/arts-and-crafts sets for the Nintendo Switch have interested us since the first Labo Variety Kit came out. You build your own controllers with cardboard and play games using the Switch and motion-sensing Joy-Con controllers. Now Nintendo has returned to VR (a field it hasn't set foot in since the ill-fated Virtual Boy) with its fourth Labo package, the Labo VR Kit. https://www.aliexpress.com/item/SVPRO-3D-Camera-HD-dual-lens-panoramic-video-camera-virtual-reality-vr-vision-support-android-cell/32756081890.html
The emphasis here is future, as in several years away. That brings us to the second biggest reason the HoloLens and Magic Leap One aren't on this list: They aren't consumer products. Both devices are purely intended as development hardware, so AR software can be made for their platforms. Even the just-announced HoloLens 2, the second iteration of Microsoft's AR headset, is aimed specifically at developers and enterprise users rather than consumers. https://www.aliexpress.com/item/YI-360-VR-Camera-220-degree-Dual-Lens-5-7K-30fps-Immersive-Live-stream-Effortless-Panoramic/32834396748.html
Currently standard virtual reality systems use either virtual reality headsets or multi-projected environments to generate realistic images, sounds and other sensations that simulate a user's physical presence in a virtual environment. A person using virtual reality equipment is able to look around the artificial world, move around in it, and interact with virtual features or items. The effect is commonly created by VR headsets consisting of a head-mounted display with a small screen in front of the eyes, but can also be created through specially designed rooms with multiple large screens. Virtual reality typically incorporates auditory and video feedback, but may also allow other types of sensory and force feedback through haptic technology. https://www.youtube.com/watch?v=xgPHXP6x3kc&t=1s
No conversation about Mixed Reality HMDs is ever complete until someone brings up Apple. Yes, the company has no available or announced devices in this space — but there isn’t a soul following technology trends that doesn’t believe the Cupertino giant isn’t a) working on some kind of AR glasses, b) acquiring companies that make lenses and materials that are perfect for some kind of AR glasses, and c) talking about AR as a transformational technology every time a microphone appears. The rumor mill says Apple’s glasses could appear in 2019, but we have our money on a 2020 launch, alongside a newly redesigned and reimagined iPhone that moves away from the “iPhone X design” for the first time since it launched. Stay tuned.
Fast Five and Star Trek Beyond director Justin Lin put together this short film for Google's Spotlight Story program in 2016, and it's still one of the more ambitious live action VR shorts out there. Lin opts to use 360 cameras to put you in what feels like a big budget blockbuster, with an alien hellbent on chasing you through the subway. It's absolutely thrilling. https://www.youtube.com/watch?v=QS36ftzGBhw&t=1s
Expand your media adventures and social gaming communities with accessories and peripherals created for virtual reality. For example, a VR controller offers seamless integration with virtual reality games to give you more control over your virtual environment. Beyond PC gaming, virtual reality experiences also encompass other forms of video. Virtual reality-compatible cameras capable of filming in 360 degrees offer you the chance to view and edit your footage, along with other VR-ready components. https://www.aliexpress.com/item/Wetrans-Wifi-IP-Camera-Security-960P-HD-Fisheye-VR-360-Panoramic-Wireless-Camera-CCTV-Surveillance-P2P/32889253107.html
In 1999, entrepreneur Philip Rosedale formed Linden Lab with an initial focus on the development of VR hardware. In its earliest form, the company struggled to produce a commercial version of "The Rig", which was realized in prototype form as a clunky steel contraption with several computer monitors that users could wear on their shoulders. The concept was later adapted into the personal computer-based, 3D virtual world program Second Life. https://www.aliexpress.com/item/Soul-Lady-Peruvian-Body-Wave-Remy-Human-Hair-13-4-Ear-To-Ear-Lace-Frontal-with/32809358235.html
In projector-based virtual reality, modeling of the real environment plays a vital role in various virtual reality applications, such as robot navigation, construction modeling, and airplane simulation. Image-based virtual reality system has been gaining popularity in computer graphics and computer vision communities. In generating realistic models, it is essential to accurately register acquired 3D data; usually, camera is used for modeling small objects at a short distance.
Bees are, like, super important to how our ecologies work. You probably learned all of this in elementary school, but have you ever seen the process, from beginning to end? The National Honey Board wants to show you, in 360. You'll be a bee flying from flower to flower, then going back into the hive with the queen bee. After that, you'll take a look at how they get the honey out of the honeycombs and onto your table. Warning: Tons of buzzing. https://www.youtube.com/watch?v=4HnNKI0Vkds&t=1s