Skip to content

UI & Voice Intelligent Test Agent ​

Low-code, multi-modal UI & voice automated testing with 24/7 continuous execution capability.

Core Pain Points ​

  1. UI test efficiency and maintenance cost issues: Traditional automated test scripts are expensive to develop and hard to maintain; UI changes or resolution switching easily break scripts.
  2. Complex voice scenarios: Voice testing needs to cover wake words, multi-turn dialogue, semantic correction, speaker recognition, and noise simulation — manual verification is costly.
  3. Recurring issues: Low efficiency, high cost, hard maintenance, and recurring bugs together form a quality-delivery bottleneck.

Solution & Technical Implementation ​

  1. Natural-language test generation: Write automated test cases in natural language — no manual script development required.
  2. Multimodal UI recognition + assertions: Combines recognition of images, text, and icons, adapting to dynamic UIs such as resolution switching and multi-window layouts.
  3. Voice testing + semantic verification: Supports speech synthesis and recognition for Chinese, English, and dialects; combines audio and logs, with results judged by rules, semantic similarity, and multi-vote LLM.

Highlights ​

  • Low-code test authoring: Describe test intent in natural language.
  • Dynamic UI adaptation: Does not depend on a single pixel location; handles resolution and window changes.
  • Multimodal assertions: Validates images, text, and communication results simultaneously.
  • Robust voice evaluation: Improves verdict reliability through multi-dimensional, multi-vote judgments.

Business Value ​

  • Voice automated test coverage improved by over 80%; UI automated test coverage improved by ~40%–70%.
  • Supports 24/7 execution; average single-test execution time is under 2 minutes.
  • PPT indicates UI test resource ratio can be reduced by ~5% and voice test resource ratio by ~10%; regression efficiency improved by over 50%.
  • Unified UI and Voice testing capability is suitable for continuous integration and mass-production project regression.

SDW AIKO Product Documentation