No conversation about Mixed Reality HMDs is ever complete until someone brings up Apple. Yes, the company has no available or announced devices in this space — but there isn’t a soul following technology trends that doesn’t believe the Cupertino giant isn’t a) working on some kind of AR glasses, b) acquiring companies that make lenses and materials that are perfect for some kind of AR glasses, and c) talking about AR as a transformational technology every time a microphone appears. The rumor mill says Apple’s glasses could appear in 2019, but we have our money on a 2020 launch, alongside a newly redesigned and reimagined iPhone that moves away from the “iPhone X design” for the first time since it launched. Stay tuned. https://www.youtube.com/watch?v=D8b2R7reusw&t=1s
Alright, I’m going to walk you through my specific process, although some people may do things in a slightly different order. Let’s jump back to the import. The camera I used records to 2 separate Micro SD cards, so I have to import both. In the “Ingested Footage” folder for that day’s shoot, I put a folder for one card, “Front” and one card, “Back”. Then I use the stitching software and export final stitches for every clip to a third folder I call “Stitched”. Then I dropped each of those stitched files into Adobe After Effects and mask myself, other, gear, and tripod out of the shot. This way I have clean video with only the model in it. I export these as individual files as well. https://www.youtube.com/watch?v=YFrYq9IMzEY&t=1s
So far, Apple has been very cool on VR, but that's slowly starting to change, at least from a software development side. OS X High Sierra enables VR development on three major VR software platforms: Steam, Unity, and Unreal. It also uses Apple's Metal 2 framework, which the company says provides the performance necessary for VR. No plans for any Apple-branded VR headset have been announced—we'll much more likely see Rift or Vive compatibility added to Macs. https://www.youtube.com/watch?v=Pl9JS8-gnWQ&t=1s
Now I can start actually editing the timeline, put things to music, figure out transitions and where graphics will go. When I have a first cut of the timeline, I export sections at a time where motion graphics will be. Inside After Effects I can create a 3D camera using their “immersive” tools, convert all motion graphic to 3D layers and create the motion inside the immersive camera view. Viewing and editing on the flat, equirectangular format does little good to anyone. When motion graphics are done, I can export them and replace the original footage in the timeline with the newly exported motion graphic versions.
All this sounds fantastic and amazing, which it is, but it comes with its fair share of challenges when creating this content. Before I jump into those, take a look at the final product I created for the client, so you have a better understanding of what I’m talking about as I go (Note: For best experience, view on phone or tablet. If you’re on a computer, you can still view it just fine, just click and drag around the screen to change your view): https://www.aliexpress.com/item/Vention-HDMI-Switch-5-in-1-out-with-IR-Wireless-Remote-HDMI-Splitter-Switcher-AC-Power/32721732290.html
A virtual environment should provide the appropriate responses – in real time- as the person explores their surroundings. The problems arise when there is a delay between the person’s actions and system response or latency which then disrupts their experience. The person becomes aware that they are in an artificial environment and adjusts their behaviour accordingly which results in a stilted, mechanical form of interaction. https://www.youtube.com/watch?v=OCa6_lLUfzw&t=1s
While audio-visual information is most easily replicated in Virtual Reality, active research and development efforts are still being conducted into the other senses. Tactile inputs such as omnidirectional treadmills allow users to feel as though they’re actually walking through a simulation, rather than sitting in a chair or on a couch. Haptic technologies, also known as kinesthetic or touch feedback tech, have progressed from simple spinning-weight “rumble” motors to futuristic ultrasound technology. It is now possible to hear and feel true-to-life sensations along with visual VR experiences. https://www.youtube.com/channel/UCLMLTE5R-LR26VKfnaDQtEA
There are few worse feelings than putting on a VR headset and having someone else's sweat drip down your face. That's why, if you're likely to be sharing your headset with others, we'd recommend some sort of cover. The company VR Cover does exactly what it suggests, selling covers for the Rift, Vive, Gear VR and Windows Mixed Reality headsets. You can get a couple of machine-washable covers or, if you prefer, some cheaper disposable ones. https://www.youtube.com/watch?v=8rdY6_AZWXk&t=1s