Monday, April 7, 2014

Gravity tablet - 3D sketching with Augmented Reality

 A group of students from the Royal College of Art have designed an augmented reality tool that allows designers to sketch in three dimensions. Gravity consists of a stylus and a tablet, familiar tools used for digital drawing, that have been adapted specifically for sketching in 3D. It was started in London in October 2013 as a group project between four Innovation Design Engineering students of the Royal College of Art.

 As the user draws above the clear acrylic sketchpad, radio signals are used to track the movements of the stylus from coordinates on the pad. These are sent to an Arduino board which is contained in a black panel that forms one edge of the pad. Controls on the pad can change the planes on which pen is sketching, meaning the drawing can be given volume. The drawings can be rotated and approached from any angle and other people can view the drawing using their own headset, and even add to it.

 From its video, it looks like the tool connects to a variety of augmented reality headsets and the RCA team has also connected it to an Oculus Rift virtual reality headset using the Unity3D game engine.

 The Gravity team unveiled publicly their innovation on February 5th for the Royal College of Art WIP Show 2014. Their website says they are now actively raising investments for their patent pending innovation with the strong vision that Gravity can change the way we create in 3D. I look forward to getting my hands on one and start creating. Now I just need to learn how to draw.

Tuesday, March 25, 2014

Facebook to acquire Oculus VR

Facebook has announced plans to purchase Oculus VR, the company behind the Rift headset, for around $2B in cash and stock. This includes $400 million in cash and 23.1 million shares of Facebook common stock. This is what Mark Zuckerberg had to share via the Facebook blog:

"I'm excited to announce that we've agreed to acquire Oculus VR, the leader in virtual reality technology. Our mission is to make the world more open and connected. For the past few years, this has mostly meant building mobile apps that help you share with the people you care about. We have a lot more to do on mobile, but at this point we feel we're in a position where we can start focusing on what platforms will come next to enable even more useful, entertaining and personal experiences. This is where Oculus comes in. They build virtual reality technology, like the Oculus Rift headset. When you put it on, you enter a completely immersive computer-generated environment, like a game or a movie scene or a place far away. The incredible thing about the technology is that you feel like you're actually present in another place with other people. People who try it say it's different from anything they've ever experienced in their lives.

 Oculus's mission is to enable you to experience the impossible. Their technology opens up the possibility of completely new kinds of experiences. Immersive gaming will be the first, and Oculus already has big plans here that won't be changing and we hope to accelerate. The Rift is highly anticipated by the gaming community, and there's a lot of interest from developers in building for this platform. We're going to focus on helping Oculus build out their product and develop partnerships to support more games. Oculus will continue operating independently within Facebook to achieve this. But this is just the start.

After games, we're going to make Oculus a platform for many other experiences. Imagine enjoying a court side seat at a game, studying in a classroom of students and teachers all over the world or consulting with a doctor face-to-face -- just by putting on goggles in your home. This is really a new communication platform. By feeling truly present, you can share unbounded spaces and experiences with the people in your life. Imagine sharing not just moments with your friends online, but entire experiences and adventures. These are just some of the potential uses. By working with developers and partners across the industry, together we can build many more.

One day, we believe this kind of immersive, augmented reality will become a part of daily life for billions of people. Virtual reality was once the dream of science fiction. But the internet was also once a dream, and so were computers and smartphones. The future is coming and we have a chance to build it together. I can't wait to start working with the whole team at Oculus to bring this future to the world, and to unlock new worlds for all of us."

It will be interesting to see how Facebook incorporates VR headsets and complementary technologies into their platform.

Monday, November 25, 2013

AEC Hackathon - Taking the Architecture, Engineering,& Construction Industry into a new future

November 8-10, 2013 was the very first AEC Hacktahon held at Facebook's Menlo Park campus.

A first for the Architecture, Engineering, Construction Industry, the AEC Hackathon is a non-profit event that creates on-the-spot teams of technologists and industry stakeholders to shape the future of our built environment.

My goal of the event was to help the Architecture, Engineering, & Construction Industry go 'Tony Stark' for a weekend and the attendees of the event did just that. For my motives and thoughts pre-hackathon, see these earlier posts titled AEC Hackathon – Where Techies and Builders Change the World and Hacking a Building a Techies way. The event turned out better than I could have ever hoped for.

The 130+ people that attended came from all over the U.S. and represented firms of all sizes with a few coming from as far as Asia and Europe. I was blown away by the caliber of attendee, tech gadgets (Oculus Rifts, 3D printers, scanners, Google Glass), the amount of collaboration between groups, and what was accomplished in just a weekend. This video courtesy of McGraw Hill ENR construction news shows some of the awesomeness from the event.

I highly recommend the videos of the speaker presentations at the AEC Hackathon Youtube Channel and the hacker team presentations can be seen in the video below. Team aeChack posted their project on Github here that is a free, online and open source platform for running and visualizing environmental analysis using daylighting and energy analysis engines. A great web3D example that utilizes the power of WebGL and the three.js Javascript library.

The attendees, a.k.a. AEC Pirates, made it an event like no other and something happened that weekend that is so desperately needed for the industry. I can't possibly capture in a post the passion, excitement, and energy that surrounded the event. Already it has kicked off ideas for other AEC related hackathons including a BIM hackathon that will take place at Autodesk University.

The next official AEC Hackathon will take place March 14-16 and stay tuned to the event's website and Twitter page for more details as they are announced. In addition to the event here in California, there are AEC Hackathons planned throughout the year for the East Coast and in other countries. I am happy to see this simple idea grow into reality and become a community of do'ers that are improving the tools and processes of how we build our environment and future. Hope to see you at the next one.

Saturday, November 16, 2013

castAR - augmented reality glasses

The interest in wearable computing thanks to products like Google Glass and the Pebble smart watch has created a boom of Kickstarter projects for augmented reality hardware. Joining the crowdsource club is castAR from Technical Illusions.

Technical Illusions was founded by chip wizard Jeri Ellsworth and game programmer vet Rick Johnson. Jeri Ellsworth is best known for creating a Commodore 64 emulator within a joystick. It ran 30 video games from the early 1980s, and was very popular during the 2004 Christmas season, at peak selling over 70,000 units in a single day. Johnson most recent work was at Valve working on hit games like Left 4 Dead , Portal 2, and DOTA. The experienced duo combined forces upon leaving Valve to focus on developing the new augmented reality technology. “We believe that augmented reality is the future not only in gaming, but ultimately the new user interface in computer technology.”

Information from their Kickstarter page:

How does it work?
 castAR's projected augmented reality system is comprised of two main components: a pair of glasses and a surface. The frames of the glasses contain two micro-projectors—one for each eye. Each projector casts a perspective view of a stereoscopic 3D image onto the surface. Your eyes focus on this projected image at a very natural and comfortable viewing distance. A tiny camera in-between the projectors scans for infrared identification markers placed on the surface. The camera uses these markers to precisely track your head position and orientation in the physical world, enabling the software to accurately adjust how the holographic scene should appear to you. The glasses get their video signal through an HDMI connection. The camera is connected via a USB port on the PC. We are still experimenting with communication options on mobile devices.

What are castAR's components?
 Glasses - The castAR glasses contain a set of two high resolution micro-projectors. Each projector independently refreshes at 120 hertz and has a very high fill factor (i.e. no screen door effect). While the retro-reflective surface eliminates the majority of the cross talk between projectors, active shutters eliminate the rest. There is also an integrated tracking camera (see the Tracking Camera section below). They easily fit over prescription glasses; final weight is expected to be less than 100 grams.

 AR & VR Clip-On - This clip-on attaches to the front of the glasses to transform your experience into either true AR or true VR. True AR allows you to use our glasses without the retro-reflective surface, augmenting the real world. True VR is a fully synthesized environment; the computer generates all aspects of the visuals you see. The clip-on has been designed to be comfortable and lightweight, yet still provide the immersive atmosphere you want. With this component, you will have no need for any other head mounted display.

Tracking Camera  - This highly accurate tracking system is capable of detecting movements of sub-millimeter. It is also extremely fast, capable of tracking at 120 hertz, and is low latency, cutting out several frames of delay compared to other tracking schemes. Custom hardware logic on the glasses handles localized processing of the image data. As this logic does all of the analysis-intensive work, the connected computer simply receives the results, thus freeing its CPU up for other tasks. The system is also very power efficient and will have negligible impact on your battery life when used with mobile devices. The tracking camera can be purchased separately to be used on head-mounted displays that don’t have highly accurate tracking, such as those which rely solely on gyros.

Magic Wand The Magic - Wand can be used as both a joystick and a 3D input device. The handheld portion of the wand has buttons, a trigger, and a thumb stick. The wand also tracks its own movement in 3D space, allowing you to seamlessly interact with your virtual environments. 

RFID Tracking Grid - The RFID Tracking Grid sits underneath your surface. When used with the bases (see the Bases section below) or your own RFID tags, the software can track and uniquely identify them across the surface. This allows you to associate tags with physical objects such as miniatures, cards, board game pieces, or anything else that fits on top of the surface. You can use the tracking and identifying abilities to augment your pieces, such as displaying stats or a health bar next to a physical miniature, or calculating the distance between two separate miniatures.

Bases - Bases are designed to allow you to conveniently use your existing miniatures. For most standard-sized miniatures, our base will easily snap onto the bottom. Bases come in two varieties: RFID and RFID Precision. RFID allows you coarsely track and uniquely identify game pieces across the RFID Tracking Grid. Precision Bases have a custom circuit board that allows for both RFID tracking as well as two-way communication. The two-way communication can be used for such things as increasing the precision of the position tracking or to control small motors and other miniature electronics. For example, you could have a dragon miniature with a Precision Base that has a tiny smoke generator and some red LEDs attached to it. The software could then tell the base to turn on the smoke generator and the red LEDs, providing an illusion that the dragon is breathing fire.

Larger Surface This surface is twice the size of the standard one, for people who want a larger area to experience their projected augmented reality on. Software Development On the software side, we offer several options for developers.

Software Development Kit: If you are doing a custom game or other application, you can use the SDK to get access to tracking data / rendering matrixes as well as RFID data.

Unity integration: Simply create an empty GameObject and add our interface script to it. You’ll be off and running under castAR within a few minutes. Additional scripts for the Magic Wand and RFID objects are also available.

(Potential) Support for existing VR applications: We are also investigating ways to get existing VR applications up and running on our system. Both the Unity integration and the SDK will be available free of charge. We also plan on making as many of our test / samples / experiences available for free to the public as well.

 With a Kickstarter goal of $400,000 that raised $1,052,110, seems there are a lot of folks that want to do castAR. I am eager to see what comes from it.

Sunday, October 27, 2013

Hacking a building a Techie's way


 Have you seen the game trailers for Watch Dogs? In the game, the player is a cyber-vigilante that explores a connected 'smart' city and accesses its 2D and 3D information like a high tech Batman. As an example of this, the game even has a website called We Are Data that shows real geo-located information about Paris, Berlin, and London from social media sites and public government datasets. The game seems like a glimpse into a distant future but believe it or not, we have the technology to make this notion of a 'smart' city happen now.

Screen Shot 2013-10-24 at 12.04.04 PM

  Unfortunately the building industry is currently very change-resistant and far behind almost every other industry in adopting new technologies, despite the fact that it has potentially the most to gain from interactive data visualization technologies and the Internet of Things. The technologies also already exist to model our buildings and communities in extremely high levels of detail, including fabrication-level data that is both extremely accurate and ideal for efficient fabrication of buildings components and large assemblies.  This same data can then be used by almost everyone to manage the facility and enable interaction with the occupants, both locally and remotely.  The lack of change is therefore not primarily a technology problem  (and the technology is getting better at an accelerating rate) but rather entrenched change resistance and silo thinking among architects, engineers, fabricators, builders, real estate developers and owners. Sure there is a growing use of 3D by both the geospatial and building communities, but the idea of intelligent interactive 3D cities seems more far fetched than a vacuum tube that shoots people from La to SF in 35 minutes.

 In addition, currently we are seeing wearable tech becoming more common with devices like Google Glass, the Pebble watch and other tech that allows us to know things around us as well as letting other systems know that we are there. Yet most buildings are only smart enough to know when to turn a light off and on or other very basic functions. There is far more we can do, but the industry is risk averse and most building owners are unaware of how best to use these innovations. Someone needs to hack this… 

Using advanced technologies, we can collaboratively design, manufacture and construct  innovative and high-performance buildings far less expensively and faster than by using conventional processes; but legal concerns, mindsets, domain wars and stubborn change-resistance is holding the industry back and delaying the inevitable democratization of the built environment through open digitization and automation. This has to change!

 Imagine using an Oculus Rift to walk through a building to see proposed design changes and its surrounding area, accessing building data via a Google Glass to assist with onsite construction, controlling the systems of a building touch free with haptic devices like LEAP Motion, or having intelligent building systems that interact with occupants via wearables and mobile devices. All of this is possible now,  but who is going to build it? We need a group of cutting edge designers, builders, coders and other change agents that are looking to disrupt the current status quo.

 The biggest hurtle is really mindset. But this is not like the issues faced when web 2.0 was proposed, HMD's for gaming, driver-less cars, even smart watches. Yet here we are. So to combat this, we have to hack it.  The goal of this event that will be held at Facebook's campus, is to try to kick start the imagination of people in and out of the AEC community to realize there is a lot we can do with the tools we have now.  Imagine using a 3D printer to print out a new facet.  Why not?  Pipe broken, print a new one. Want to add that extra room to the house?  Call your local prefab house builder, send them your house's digital files and everything is created exactly to fit your existing. Want some new wall art? Put on a Google Glass like device and load up some designs.  The computer already knows about your building so it can match up anything you want to see.

 We are starting to see small starts in our smart buildings.  You can buy systems that allow you to turn lights on and off, change the temperature, smart fire alarms, and a few other small things from your mobile phone, but this is barley the tip.  If we can connect smart people with the right data, there is far more we can do.  Hopefully over the next few AEC hackathons, we will see a few hints of that future.  And who knows?  It's possible something very cool, very fundable will come right from the event. Perhaps something the next version of Watch Dogs will incorporate as we build beyond what even the game proposes for our future.
AEC Hackathon Logo

Tuesday, August 20, 2013

Wearables: Meta's SpaceGlasses

Here is a cool concept video from Meta, makers of SpaceGlasses. Meta comes out of research at Columbia University. The super klunky glasses you see in the video are the combination of Epson's Moverio glasses and a 3D depth camera mounted on the top.

While the glasses are real, the applications are just concepts. I saw there booth and setup at the AWE event a few months back and they had no application this polished. Meta does have a growing number of developers and a lot of potential given the overlaid display and interface to be really cool augmented reality glasses. I look forward to getting a pair of the streamlined version shipping next year.