Having conversations leveraging existing communication tools can be a challenge for deafs. While so many live transcription and text-to-speech tools are available in the market, they do not cater to the needs of the deaf and hard of hearing and aren't designed with an accessibility focus.
We are building this focusing on the problem deaf people are facing in India by building prototypes, testing it with the deaf community, and iterating based on the feedback.
Often it could take a lot of time for the deaf person to read transcriptions and respond to them depending on various factors from person to person. SUNVA AI intelligently simplifies and provides various filters on the transcriptions to minimize the time taken to read the transcription and switch gaze between the screen and the person while communicating.
SUNVA AI provides a text-to-speech + LLM layer features that help the deaf person having speech irregularities to type less and respond more. For example, if the deaf person types "I coffee", SUNVA AI will convert it to "I would like to have a coffee" and speak it out.
Sunva frontend is a single-screen UI where you can read the intelligently simplified transcriptions and write your response, which will be spoken back in the selected speech. Our idea is to build this app, take it to our deaf community volunteers, and based on their feedback, iterate the UI to make it even better.
The first version of the POC will have the following features along with speaker diarization and text to speech.
- Text (transcript) simplification using LLM
- Text highlighting of important and critical keywords (transcript) using LLM
- Intelligently apply simplification/highlighting to the transcriptions and provide easy summarizations.
Based on the user feedback from our focus groups, we will refine and add more features to the POC.
Edit this section with a brief explanation of your project.
Update this section with instructions on how to get started with your project:
-
Clone the repository:
git clone https://github.com/PeoplePlusAI/sunva,git -
For running locally run the instructions in frontend and backend in two tabs
-
Go to localhost:3000 and you will see the application
-
For prod run the commands in
build.sh
We welcome contributions from the community. To contribute to this project, please follow the guidelines outlined in CONTRIBUTING.md.
Explain where to find and how to use your project's documentation:
The docs folder contains project documentation and related documents. To access or contribute to the documentation, please refer to docs/README.md.
Provide instructions for reporting issues:
If you encounter any issues with the project, please create a new issue using the issue template. Provide as much detail as possible to help us understand and resolve the issue.
Explain your process for accepting pull requests:
If you are interested in volunteering for this project, please refer to this link for more information.
If you would like to contribute to the codebase, please refer to the CONTRIBUTING.md file for more information. We appreciate your contributions!
People+ai connects do-ers, dreamers, tinkerers and innovators with ideas & resources to build an ecosystem that can empower a billion people to reach their potential - Know More
Made with