Cantaloupe
Client
A 365 Retail Market
Overview
The project introduces a voice user interface (VUI) for the Seed Driver App, giving drivers hands-free voice commands so they can operate the app without taking their hands off the wheel or off the vending machine they're servicing.
The brief
Drivers constantly need to multitask, checking navigation while driving, and handling vending machine items and inventory while also updating entries in the driver app. That competing demand for their hands and attention is the core pain point. The team also flagged some real risks going in: voice recognition accuracy in noisy environments and across accents, the need for driver training on the right phrases, and (to a lesser extent) privacy considerations.
What we built
A fully integrated, customizable, and modular voice integration built into the Seed Driver App. It leverages the native voice recognition already built into iOS and Android (via React Native Voice), so it works offline on iOS, can in theory extend to other languages, and improves automatically as the underlying OS voice recognition improves. Under the hood, it converts voice to text, runs on a React Native UI layer, and is tuned to listen for domain-specific keywords like "coil," "fill," "remove," and "inventory" plus numeric values, triggering actions directly in the app. It's also designed to be extensible to other Cantaloupe apps like Mobile Warehouse, PickEasy, or web-based tools, not just Seed Driver.
Ready to build something that matters?
We solve problems that don't have Stack Overflow answers. Let's talk.
Book a Discovery Call