Augmented Reality (AR) is one of the most fascinating technologies, yet many of the possibilities are yet unexplored.
The purpose and mission of this website is to conduct basic research in the field of AR and with that to inspire others to use it for their applications and use cases.
Below you find some of my private research projects, starting with research I conducted for the RFH Cologne - University of Applied Sciences in 2001: "Pattern recognition in their use in augmented reality".
My first experiences with AR date back to the ARToolKit in 1999. If you want to know more about me or get in touch, click About me.
There are many different approaches to the Metaverse. My favorite is an augmented reality (AR) solution that works with location-based services. In this private project I wanted to try out use cases where you interact with your crypto wallet in such an environment.
Location-Based Donations: You can donate to a project directly on site. The donation is thus tied to the project and the commissioning is started immediately through a smart contract as soon as the required sum has been collected.
Location-Based Entertainment: Games and tours that integrate with the real world. In this way, information about a place can be conveyed in a playful way and participants can collect special NFTs.
This is just a prototype for testing and far from a fully functional app. The MetaMask wallet is connected to the app, but the transactions are only mocks due to SDK issues with MetaMask. Unfortunately, since the right AR headset is not yet available, I use a MagiMask headset with an iPhone as a display to test my use cases. Because of the better video quality, I used a gimbal for this video.
AR Outdoor Game
Proof of Concept
This is a proof of concept for building an Augmented Reality Outdoor Game with Apples ARKit. I used two iPhones with a Collaborative Session to share their positions. One of them is used with a customized Bluetooth gun as the Mandalorian Blaster. The other one works with a MagiMask as a headset.
I also extended a buzzer with a Bluetooth sender, to use it as a door opener for the Tatooine house.
As all of my prototypes, it is only a test what is possible and it is still far away from a fully implemented App.
The goal was to test interactions between real and virtual world and to test how the weather will influence the position detection.
The user experience with this headset solution has room for improvement, but for me this is currently the best way to gain experience before a good headset is available.
Proof of Concept
This is a proof of concept for building an Augmented Reality Shooter with ARKit. This is a prototype only and still far away from a fully implemented and tested App. Also, the headset solution has room for improvement, especially in regards to the user experience. However, the work should offer a straightforward way to get experience with ARKit until a perfect headset is readily available.
Proof of Concept
Working from home seems to be the new normal, and collaborative online meeting tools help to make it more productive. However, an easy and cheap solution for a whiteboard collaboration tool is still missing. Such a tool should be simple to set up, easy to use, and not too expensive.
I developed a proof of concept that provides an Augmented Reality Whiteboard to your home office.
This App is only a prototype for the user interface and to prove the technical possibilities with a lot of possible features still missing. Additional features could be manual positioning of objects and using a Collaborative Sessions to work with the remote iPhone control as a pointer on the Whiteboard.
This app is a private project, which I created in my spare time. For that reason, the app is far from being a complete, implemented, and tested App, and not ready to be launched to the App Store. The goal of this project was only to create a proof of concept. However, it should be relatively easy for iOS developers to build this app themselves by using the Multipeer Connectivity framework and pairing the two iPhones to send the information from remote to the headset. The rest are ARKit basics.
Proof of concept of marking search areas and imaging different metals in the ground.
A metal detector can recognise metal objects in the ground when you move the coil of the detector over the ground.
With this measurement one can differentiate between different metals in the ground and produce corresponding acoustic output signals.
The Google Tango technology can track the motion and position of the phone in the real world with a Lidar sensor. Unfortunately Google has stopped the project Tango.
Detect and mark objects
The Ground Imager App combines metal detecting and the Google Tango technology. Ground Imager analyses the acoustic output of the metal detector and creates a virtual Object at the position of the metal on the ground in realtime. Ground Imager also can use different colors for the virtual objects by analysing the frequency of the acoustic output for different metals.
Mark the search area
The Ground Imager App can mark the area where the coil has moved over the ground with a transparent virtual overlay on the ground. With this feature you can always see where you have scanned for metal in the ground and optimise your moves with the coil.
In the future this information also can be shared with other users in the same area.
XP Deus Metal Detector with a tablet holder for the Lenovo Phab 2 Pro with Google Tango.
Combining the loudspeaker output of the detector with the microphone input of the Phab 2 Pro with a cable. The cable contains a potential reduction to adjust the line-out voltage to the high sensitivity of the microphone input.
Ground Imager works with every metal detector with a head phone output.
Mentor for the project "Augmented Reality Commerce App" with Google Tango.
The goal was to build an app that shows products with augmented reality in the room and to connect them to a shop website.
The Hotels Now! service was developed for hotel reservations with the Location Based Augmented Reality Plattform Layar.
The app was connected to an API to show the available hotels in the area. The hotel could be booked directly via a deep link.
The project was sold to HRS.de (Hotel Reservation Service).
1. Choose AR element
2. Threshold and video settings
3. Window and color settings
4. Optional video source
5. Pattern for AR element
6. 3D Model for AR element
7. Start AR project with all AR elements
"Pattern recognition in their use in the Augmented Reality"
RFH Cologne - University of Applied Sciences
The aim of this project consisted of two parts. On the one hand, an easy-to-use augmented reality project configurator based on ARToolKit. For this purpose the configurator WinAR was developed by my fellow stundet Osman Keskin.
And the other part dealt with pattern recognition and augmented reality use cases. In addition, various pattern tools were developed and tested.
The WinAR application offered a user interface for creating augmented reality projects. Several AR elements could be managed in one project. Each AR element had a pattern, a OpenGL 3D object and settings. The configurator then starts the current project with ARToolKit.
A CyberMaxx 2.0 was upgraded with a camera module to an Augmented Reality Headset.
The Pattern Box, Pattern Arm and the Pattern Glove were developed for special AR Use Cases.
Augmented Reality Use Case
With the help of the Augmented Reality application, every user could change a processor on a main board without any prior knowledge. The instructions were placed in the desired position using the Pattern Arm. The user then only had to work through the individual steps one after the other.
The individual components and steps were marked with signs (A1-E1) and colors. Animated arrows helped with the directions of movement.