Can you conduct technical training remotely and still provide live-action experience in real-time?
The answer is Yes!
Leveraging the live-feed from cameras in mobile devices (smart phones or tablets) or wearable devices, live training sessions can be broadcasted easily nowadays.
Furthermore, for the trainers and trainees at two different locations to interact and share information within the live camera view, technologies such as machine learning (ML) and augmented reality (AR) can be applied to overlay critical information onto the physical environment when both parties need to be aligned on what they are looking at. Not only that one party is seeing what the other party is seeing, but one party also can share information on the camera view that the other party should know or be interested in.
Let’s look at how live-action remote technical training can be conducted using these new tools in real-world, and how it is different than the current ways of doing technical training with physical systems such as devices, machines, equipment, etc. There are many industries that can be benefited from this tool, including utility, manufacturing, equipment and device suppliers.
How is this going to be used?
- Demonstrating each part or component’s functionality
When the trainer shares their camera view with the remote trainees, the trainer might lose the trainees attention after long talking that sounds more like a monologue. And the trainees might have a difficult time connecting what they are hearing from the trainer and what they are seeing from the camera.
The solution here is using AR overlay, as well as computer vision for object recognition. The way it works is that the software recognizes different components or parts of the physical system, then overlays relevant information that one can click on (text, image, animation, etc). In this way, the trainers can clearly communicate what they are talking about; and the trainees can interact with the information and stay engaged throughout the training.
- Recording correct action (or mistakes to avoid) as videos with e-notes
One of the pain points for trainees is that they can’t remember everything at once. After the training session (even the face-to-face one), they tend to forget a lot of the materials and need to go back to references to digest and understand through repetition.
The solution here is for trainees to record the camera feed with e-notes associated with it. These e-notes will be pinpointed or designated to specific part of the training.
- Troubleshooting remotely
A big challenge for many service-oriented industries is the need to troubleshoot quickly and accurately when things don’t work as they suppose to. In a perfect world where there is plenty of resources and time, this is done on-site with experience service technician. However, most companies have limited bandwidth or resources to do this fast specially when it involves travel.
The solution here is for the experienced expert to use the shared camera feed to diagnose and highlight the issue, and push information (document, image, animation etc.) to assist the remote personal performing the correct action.
What are the benefits?
1. Saving time (specially shorten the downtime)
This means faster training thanks to the flexibility of remote session with many people simultaneously. This also means less downtime in the case of remote troubleshooting.
2. Saving travel cost
This is an obvious big benefit by reducing the need to travel in many cases.
3. More engaged trainees
With interactive screen for both trainers and trainees to analyze the physical objects and environment, training session is fun and engaging.
To discuss how AR and ML can help your organization’s training applications, or to experience a real demo yourself, please contact firstname.lastname@example.org.