NALscribe AR: Spatially Positioned Live Captions for Clear Communication with Apple Vision Pro

Individuals with hearing loss often struggle to understand speech, particularly in group conversations or noisy environments. This can lead to isolation, withdrawal from social activities, and decreased participation in the workplace.

We are exploring the potential of Apple Vision Pro’s mixed reality technology to enhance hearing health and communication accessibility.

Introducing NALscribe AR, the future of accessible communication.

We have created a live captioning app for Vision Pro with multiple connected devices, with unique features not found in other smartphone or AR captioning apps, including:

• – Enhanced voice pickup and accuracy by utilizing each speaker’s smartphone as a dedicated microphone and captioning device.
• – Spatial positioning of captions near each speaker for clear attribution and easy conversation tracking.
• – Separation of individual talker streams, unlike traditional captioning solutions.
• – Attention-grabbing features, such as flashing caption boxes to indicate new speakers.

Whether it’s a business meeting or a casual get-together with friends, experience conversations like never before.

At NAL, we continue to innovate. NALscribe AR is the latest example of this.

NALScribe is a free, easy-to-use live speech captioning tool to help people with hearing difficulties understand speech and conversations. It aims to increase understanding and decrease stress levels during communication.

Apple Vision Pro seamlessly blends digital content with your physical space. The spatial computing headset includes multiple cameras, precision eye-tracking, spatial audio and a sophisticated sensor array for a highly immersive experience.

This opens up new opportunities to communicate and connect in ways never before possible.