Microsoft just announced an update around the HoloLens that allows you to share on what you are seeing (from a first-person perspective) with others to make to more interactive. This is a combination of MRC (Mixed Reality Capture) which already exists and some new updates that address some of the short coming of the MRC - especially when working with a audience.
The main use case on the spectator view - as the name suggests is to allow those in the room not wearing a device to see the holograms but also the interactions that the folks wearing HoloLens with their mixed reality experience....
Honestly, I don’t think even Tony Stark can explain - this sums it up quite nicely and the music is just the cherry on top. :)
Some of the folks working on PPI and HoloPortation team from MSR left and went to setup a new company called PerceptiveIO
.
They have recently published a paper called Fusion4D: Real0time performance capture of challenging scenes.
In that they cover some of the work around multi-view performance capture, the raw depth acquisition and preprocessing that needs to be done around that. This interestingly also handles deformation changes (e.g. taking off a jacket or a scarf) and these can be non-rigid and much more difficult to handle, but they are done beautifully....
I guess you can see the similarity. No? 😈
In addition to the HoloLens Device Portal (
see part 1
), another option is using the UAP HoloLens companion app which you can install from the store
. I think this is a little more end-user friendly, and perhaps a little less developer focused. It exposes a subset of the same functionality.
Once you install it, you connect more or less in the same manner; I think most people will like the live streaming option....
One of the advantages of running Windows 10 on the HoloLens is that it has all the regular features that you would expect. From a developers perspective, one of those being the Device Portal which is awesome. It is essentially a web server that is being hosted on the machine, and allows you to manage your device over Wifi and USB.
It is a must have if you want to stream your apps (including Holograms) so that others can see it, or alternatively you can record and then share....
As we start to play and explore with new AR/VR mediums like Oculus and HoloLens there is a stronger shift from the traditional medium of working from a more transaction with-known-outcome based model to a more expressive and exploratory model. In the context of many enterprises this is a bigger shift - albeit some of it they have started seeing with mobility but still not the same.
I really like how Rick
explains and expresses this both in terms of definition and thinking....