ECE.08M – Speech Accessibility

• Jinyuan Hu
• Yiheng Tao
• Mengying Wang
• Mufei Zhao

Our project aims to address the significant communication challenges faced by individuals with dysarthric speech, commonly associated with conditions such as Parkinson’s disease, ALS, cerebral palsy, stroke, and Down syndrome, through a transformative mobile application. Designed to be user-friendly and accessible, the application employs advanced sound enhancement filters and voice activity detection to convert dysarthric speech into clear, understandable language in real-time, with a specific emphasis on maintaining high-quality audio recording capabilities and ensuring seamless user interaction. Achievements include real-time speech conversion within 1600 milliseconds, application of a gain factor of at least 10 dB for enhanced speech clarity, and customizable settings tailored to various medical conditions. Furthermore, the app offers cross-platform support, ensuring functionality on both iOS and Android devices, alongside multi-language support to cater to a diverse user base. Prioritizing user privacy and security, the application integrates end-to-end encryption and adheres to strict data protection regulations. With additional features such as offline functionality, data backup, and restoration, alongside comprehensive data analysis and trend reporting tools, the project significantly advances communication capabilities for individuals with speech impairments, fostering greater independence and social integration. This initiative represents a substantial step forward in assistive communication technology, offering a practical solution to improve the quality of life for affected individuals.