AR Solutions
← Back to Portfolio
Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated sensory input such as sound, video, graphics or GPS data. It is related to a more general concept called mediated reality, in which a view of reality is modified (possibly even diminished rather than augmented) by a computer. As a result, the technology functions by enhancing one’s current perception of reality. By contrast, virtual reality replaces the real world with a simulated one. Augmentation is conventionally in real-time and in a semantic context with environmental elements, such as sports scores on TV during a match. With the help of advanced AR technology (e.g. adding computer vision and object recognition) the information about the surrounding real world of the user becomes interactive and digitally manipulable. Artificial information about the environment and its objects can be overlaid on the real world.
In this augmented reality system, a professional TV Camera that captures High Definition quality images was used. From this, a driver to transform the signals from SD/HD-SDI Input to computer images with no loss of quality or fps was created.
The first stage was finding the camera’s intrinsic parameters. We used almost 500 images from different angles and positions wisely chosen to calibrate the camera. With this information in the live video, it searches each of the camera’s captured image, a fiduciary marker displayed in an Interactive Multi-Touch Table. Finally, it restores a real-world coordinate system from the data obtained using computer vision algorithms.
This solution was engineered as a prototype for sports telecasts. Sports and entertainment venues are provided with see-through and overlay augmentation through tracked camera feeds for enhanced viewing by the audience. In the videos below, a soccer talk show is simulated where the presenters can analyse a specific play, and interact with the Multi-Touch table to move the camera or select players.
Role Information:
My role in this project was as Lead R&D Software Engineer in Visualisation and Reservoirs group. I worked on this project from January/2010 to July/2010.
The main technologies involved are C++, Computer Vision, OpenCV, OpenGL and professional TV equipment.