http://localhost:4000// Sun, 16 Dec 2018 01:30:45 -0800 Sun, 16 Dec 2018 01:30:45 -0800 Jekyll v3.8.5 <p>Hand and object interactions for current generation HMDs</p> <h2 id="interactions">Interactions</h2> <ol> <li>Hand and Magic Leap Haptic Device</li> <li>Hand holding different types of objects tracked using image tracking.</li> <li>Hand holding trackable objects, such as pencils or magic wands</li> </ol> <h2 id="applications">Applications</h2> <ol> <li>SolderAR - AR Soldering simulation with a pen</li> </ol> <p><a href="https://www.youtube.com/watch?v=IO9n8pUdb08">https://www.youtube.com/watch?v=IO9n8pUdb08</a></p> Sat, 15 Dec 2018 00:00:00 -0800 http://localhost:4000//2018/12/15/mix3.html http://localhost:4000//2018/12/15/mix3.html <p>Meaningful applications from hand-based interactions</p> <h2 id="applications">Applications</h2> <ol> <li>Psychedelic Theremin - a realtime VFX creator app that’s also a hand-gesture based musical instrument <ul> <li>A more procedurally generated musical version of: <a href="https://devpost.com/software/magickit">https://devpost.com/software/magickit</a></li> </ul> </li> <li>“Cat’s Cradle” - string simulation based on finger gestures</li> <li>Finger-based interaction with physics simulated virtual objects, such as hanging strings on a room-scale harpsichord</li> </ol> Sat, 15 Dec 2018 00:00:00 -0800 http://localhost:4000//2018/12/15/mix2.html http://localhost:4000//2018/12/15/mix2.html <p>Tactile touchscreen interface on a phone where appropriate + HMD</p> <h2 id="interactions">Interactions</h2> <ul> <li>Phone image triggers interaction from HMD camera</li> <li>Phone connected through a low-latency protocol to HMD as a secondary screen and tactile input interface.</li> <li>Mix use of HMD sensors with phone sensors.</li> </ul> <h2 id="applications">Applications</h2> <ol> <li>Multi-purpose IoT Device Remote Control - Access anything you see <ul> <li>Realtime hack demo <ul> <li><a href="https://www.youtube.com/watch?v=XHwOH5h6VHs" title="CircuitryIOTAR - Grand Prize from AT&amp;T IoT Hackathon"><img src="https://img.youtube.com/vi/XHwOH5h6VHs/0.jpg" alt="CircuitryIOTAR - Grand Prize from AT&amp;T IoT Hackathon" /></a></li> <li><a href="http://permute.xyz/timeline/#event-hackpack-ar-for-twilio-signalconf" title="HackPack AR"><img src="https://img.youtube.com/vi/__ypmMIg4_Q/0.jpg" alt="HackPack AR" /></a></li> <li><a href="http://permute.xyz/timeline/#event-venuetaggerlive-on-google-play" title="VenueTaggerLive"><img src="https://img.youtube.com/vi/vop0qkH9SDo/0.jpg" alt="VenueTaggerLive" /></a></li> </ul> </li> <li>Simulation demos for the enterprise from the author’s Twilio SignalConf talk: <a href="http://iot.areality3d.com">http://iot.areality3d.com</a></li> <li>Remote Desktop operating system on a HMD with hybrid phone/ML controller + hand gesture interaction</li> </ul> </li> <li>Reality Designer / Freeform Any-Object Placement <ul> <li>General 3D modelplacement</li> <li>Interior Design “Portable” Virtual Warehouse: Browse through furniture on your phone or tablet and place them holographically on the HMD. <a href="http://bit.ly/holofurni">http://bit.ly/holofurni</a></li> <li>Magic spell designer: <a href="http://bit.ly/magicdex">http://bit.ly/magicdex</a></li> </ul> </li> <li>Identify Who’s Who (as inspired by a Black Mirror episode): Identify people you see and browse more info about them on your phone.</li> <li>Keynote Reality: Use a phone based interface to select and format the slides and annotations you want to place in reality on the HMD. <a href="http://bit.ly/prototypereality">http://bit.ly/prototypereality</a></li> </ol> Sat, 15 Dec 2018 00:00:00 -0800 http://localhost:4000//2018/12/15/mix1.html http://localhost:4000//2018/12/15/mix1.html