A Hybrid Ionic mobile app that accepts Indic voice-based commands to search the Indic (domain) scoped data. The Indic domain data includes data such as music/tourism/theertha-stala/spiritual/yoga/etc. Here the voice to text conversion happens via JS WebSpeech API's. Also, the search engine includes custom Google search engine, Wikipedia search engine or similar one (one or more of these). The Google custom Search helps in creating our own search engine for a choosen topic collected from a group of websites of our choosing.
- Explore the client and service-side aspects of voice-to-text & tts.
- Investigate existing publicly available search engines or APIs for querying domain-specific public data, rather than building our own.
- Extend the search to include morphological analysis and generation for Indian languages to improve the search engine results. The output of the search engine depends on the input words. If a word is provided in an inflected form and is not present in the search engine's lexicon, it will affect the search engine's output.
- One of the most common use case that people want is to be able to search for information by speaking a query into a device.
- More/Extend (Own Pretrained ASR model + TTS + Q/A for websites)
- Web Speech API is a web technology specification that is developed and maintained by the World Wide Web Consortium (W3C)
- Web Speech API is a JavaScript API that allows developers to incorporate speech recognition and synthesis capabilities into web - applications.
- The implementation of the Web Speech API can vary slightly between different browsers
- Each browser implements the Web Speech API using its own underlying speech recognition and synthesis engines
- Google Chrome's speech recognition engine requires an active internet connection to work, as it relies on cloud-based speech recognition technology that processes the audio input on remote servers.
- Speech recognition engines, such as the one used in Windows 10, can work offline to some extent by using pre-installed language models and recognition algorithm
-
Web Search API’s
-
Tensor flow JS:
-
Google Custom Search
-
Wiki Search
-
Wiki Geo Search
- https://www.mediawiki.org/wiki/API:Search
- https://kn.wikipedia.org/w/api.php?action=query&format=json&list=search&srsearch=ಶ್ರೀರಂಗ&sroffset=10
- https://en.wikipedia.org/w/api.php?action=query&prop=coordinates&format=json&titles=Tirupati
- https://en.wikipedia.org/w/api.php?action=query&list=geosearch&format=json&gscoord=10.87|78.68&gsradius=10000&gslimit=5
-
Open Search API’s
