Tinkoff has integrated its assistant Oleg into Clubhouse, making it the first voice assistant, speech recognition and synthesis solution available in this audio-chat social network.
Tinkoff’s voice assistant will be able to enter rooms, transcribe speech in real time, and stream the text in his Oleg in the Clubhouse Telegram channel. He can also moderate Clubhouse rooms, voice questions to speakers, remind users about time limits, regulations, etc.
Pavel Kalaidin, Director of Artificial Intelligence at Tinkoff, commented:
“Our voice assistant team is currently experimenting with various user scenarios in Clubhouse to determine how room creators or listeners can benefit from our technologies. We have already successfully tested Oleg’s ability to transcribe audio calls in real time streaming them in his Telegram channel. The feature was piloted in the Clubhouse room created to discuss Tinkoff’s 2020 financial results. Oleg can also come in handy when listeners are unable to voice a question to speakers, for example when it is too noisy or they do not want to interrupt them. For such cases, we are designing an interface through which users can forward their questions to Oleg’s Telegram chat. Oleg will then voice the question with perfect pronunciation, keeping the user anonymous, if necessary.
One of the challenges in group speech recognition is the summarisation of information. Interjections, fillers and incoherent speech make reading even a good transcript difficult. For that reason, we are looking into ways of processing the text and capturing the gist of what is said to create a shorter and more readable transcript. We are open to working with Clubhouse communities to make our voice assistant a useful tool for content makers and listeners.”
