Developing an AI-Powered Speech Annotation and Transcription Enhancer Tool

About This Grant

PROJECT SUMMARY/ABSTRACT Language Sample Analysis (LSA) is the gold standard for Speech-Language Pathologists (SLPs) to evaluate functional communication, but manual annotation is slow and inconsistent, taking 7–8 minutes per minute of speech. This bottleneck delays interventions and exacerbates workforce strain, with 55% of SLPs reporting excessive caseloads. Existing tools such as SALT, CLAN, and Whisper offer only partial automation and lack comprehensive, multi-layer analysis. With the U.S. speech therapy market valued at $4.62 billion in 2023 and projected to grow to $8.37 billion by 2032 (CAGR 6.9%), there is strong demand for efficient, scalable, and clinically useful technologies that address SLP workflow needs. We propose SATE (Speech Annotation and Transcription Enhancer), an AI-powered platform that automates multi-layer LSA with high accuracy and usability. SATE delivers precise annotations across word- and phoneme-level transcription, C-unit segmentation, phonetic analysis (e.g., mispronunciation detection), maze identification (pauses, repetitions, filler words), morpheme and syllable analysis, and grammar evaluation. Outputs are presented in interactive reports with dynamic visualization and enable real-time editing, enabling efficient review and refinement for SLPs. The system leverages both a proprietary dataset and multiple public corpora (e.g., ENNI, L2-ARCTIC, Rescorla, UltraSuite) to ensure robustness across linguistic accents, dialects, and demographic groups. Phase I will validate technical performance on typical and disordered speech, targeting ≥0.8 sensitivity and specificity (95% CI), and assess usability and adoption through participatory studies with 20 SLPs and heuristic evaluation by 8 HCI experts. Success will be defined by robust annotation accuracy, strong usability ratings, and preliminary evidence of financial feasibility. By reducing the time, effort, and variability of LSA, SATE will expand service capacity, alleviate clinician burden, and improve access to high-quality speech and language evaluation. Completion of Phase I will provide the technical, clinical, and commercial foundation for Phase II validation, workflow integration, and SaaS-based commercialization, positioning SATE to transform LSA and strengthen speech and language service delivery.