43 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Hoan Luu Huuandroot	30f2189986	support playht3.0 (#119) ... * support playht3.0 * update language * wip * update top_p and repetition_penalty --------- Co-authored-by: root <root@af6633a5cfe8>	2024-10-09 12:12:59 -04:00
Hoan Luu Huuandroot	ffde303446	fixed azure transcribe crashed if both endpointId and alternativeLang… (#124) ... * fixed azure transcribe crashed if both endpointId and alternativeLangs are used * fixed review comments Signed-off-by: root <root@af6633a5cfe8> --------- Signed-off-by: root <root@af6633a5cfe8> Co-authored-by: root <root@af6633a5cfe8>	2024-10-07 09:52:58 -04:00
Hoan Luu Huuandroot	7b4520c070	Playht delete circular buffer with mutex check (#123) ... Signed-off-by: root <root@af6633a5cfe8> Co-authored-by: root <root@af6633a5cfe8>	2024-10-05 10:02:07 -04:00
Hoan Luu Huuandroot	f7f8f52283	fixed google asr max duration exceeded or no audio raised jambonz_transcribe::error (#120) ... Co-authored-by: root <root@af6633a5cfe8>	2024-10-03 08:04:40 -04:00
Hoan Luu Huu	d17a2aa9be	env variable for tts stream connection timeout (#114) ... * env variable for tts stream connection timeout Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * env variable for tts stream connection timeout Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * env variable for tts stream connection timeout Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-09-17 10:05:57 -04:00
Hoan Luu Huu	5fd58ba6e5	fixed different voice quality while using playht (#111)	2024-09-16 15:56:10 -04:00
Hoan Luu Huu	eec4df4b77	support variable to enable ws ping pong for jb transcribe (#101) ... * support variable to enable ws ping pong for jb transcribe * update ping/pong time duration * fix review comment Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-08-22 07:33:05 -04:00
Hoan Luu Huu	fe1e4dcf11	deepgram tts support on-premise (#95) ... * deepgram tts support on-premise Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip * fix review comment Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-08-08 07:42:47 -04:00
Hoan Luu Huu	f828171b3b	support jambonz transcribe with multiple sampling rate (#98) ... * support jambonz transcribe with multiple sampling rate * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-08-07 14:40:22 -04:00
Hoan Luu Huu	56df923cdb	support elevenlabs previous_text, next_text (#75)	2024-07-19 10:22:59 -04:00
Hoan Luu Huu	de676ddc81	append null to ostringstream will make c_str return part of a string. (#83) ... * append null to ostringstream will make c_str return part of a string. * fixed review comment Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> * fixed review comment Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> * fixed review comment Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>	2024-06-28 07:08:40 -04:00
Hoan Luu Huu	2a94213668	support single azure connection for same channel (#73) ... * support single azure connection for same channel * wip * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-06-01 06:59:24 -04:00
Hoan Luu Huu	6ad663f9d9	whisper_tts should use rate to do resampling (#70) ... Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-05-29 08:13:38 -04:00
Hoan Luu Huu	c945a2de5a	verbio stt/tts mods (#65) ... * verbio tts mod Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * mod_verbio_transcribe * wip * wip * wip * wip * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * verbio stt Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-05-29 08:05:54 -04:00
Hoan Luu Huu	466dec7a6f	mod_custom_tts (#53) ... * mod_custom_tts Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * add custom_vendor to mod_dub * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-05-28 19:27:17 -04:00
Hoan Luu Huu	097ac337cc	mod_vad_detect (#69) ... * mod_vad_detect Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * mod_vad_detect Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-05-28 10:32:39 -04:00
Hoan Luu Huu	45ecf151c3	Delete tts tmp file if playback_start event has not been sent (#68) ... * Delete tts tmp file if playback_start event has not been sent Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * Delete tts tmp file if playback_start event has not been sent Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-05-26 09:29:05 -04:00
Hoan Luu Huu	d1d0f5dd77	jb_transcribe correctly unlock mutex before cleanup (#66) ... * jb_transcribe correctly unlock mutex before cleanup Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>	2024-05-23 07:48:02 -04:00
Hoan Luu Huu	19f20bf0e7	Fix/azure white noise (#63) ... * azure return odd bytes audio, that azure tts mode generate white noise * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-05-14 06:55:44 -04:00
Hoan Luu Huu	b019a634bd	Fix playht timeout while downloading audio (#61) ... Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>	2024-05-10 12:18:32 -04:00
Hoan Luu Huu	be3714465b	support aws sessionToken (#58) ... * support aws sessionToken Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * fix code style --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-05-02 08:28:01 -04:00
Hoan Luu Huu	b495dba126	reset response when cached speech interface feeded new text (#59) ... Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-05-02 07:24:57 -04:00
Hoan Luu Huu	33750b5420	mod_deepgram_transcribe keep alive connection (#56) ... * mod_deepgram_transcribe keep alive connection Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * read use single connection configuration from env var * remove deepgram media bug buffered data Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * fix review comments Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-04-30 08:00:59 -04:00
Hoan Luu Huu	916332d91d	elevenlabs to use http 1.1 (#57) ... * elevenlabs to use http 1.1 Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * update the rest of mod tts Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * add env variable for disabling http2 Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-04-29 07:51:09 -04:00
Hoan Luu Huu	33fee93ec7	free maloc variable on mod_audio_fork (#54)	2024-04-23 09:15:11 -04:00
Hoan Luu Huu	41aebafd1c	fix eleevnlabs callsession stuck (#55) ... * fix eleevnlabs callsession stuck Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * fix read sample rate from session is not needed Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-04-23 09:14:43 -04:00
Hoan Luu Huu	3f642467eb	add properties to tts span for mod_*_tts (#45) ... * add properties to tts span for mod_*_tts Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * support deepgram tts span Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * support tts span for playht Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * support rimelabs tts span Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-04-14 09:13:54 -04:00
Hoan Luu Huu	622cb14957	mod_*_tts is not able to parse http response code if the protocol is hot HTTP/2 (#44) ... * fix mod_tts wrongly parsing http error code Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>	2024-04-13 08:51:03 -04:00
Hoan Luu HuuandDave Horton	4ce95e6d27	support new parameters for google v2 (#31) ... * support new parameters for google v2 Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * add enable_voice_activity_events Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * changes to start and end timeout --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> Co-authored-by: Dave Horton <daveh@beachdognet.com>	2024-04-12 07:24:46 -04:00
Hoan Luu Huu	f0d15c57a2	support mod_rimelabs_tts (#41) ... * support mod_rimelabs_tts Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * add readme and license Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-04-12 07:23:21 -04:00
Hoan Luu Huu	2bbc18903c	mod audio fork cannot parse ws:<IP>/call path (#40) ... * mod audio fork cannot parse ws:<IP>/call path Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> * add comments for the regex Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> * add comments for the regex Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>	2024-04-08 20:03:01 -04:00
Hoan Luu Huu	4aabb36a64	add playht tts to mod_dub (#39) ... Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-04-08 10:54:49 -04:00
Hoan Luu Huu	ee488e4621	support mod_playht_tts (#38) ... * support mod_playht_tts * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-04-08 10:22:16 -04:00
Hoan Luu Huu	94361f1d20	mod_dub support sayOnTrack Deepgram (#35) ... * mod_dub support sayOnTrack Deepgram Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * mod_dub sayOnTrack support azure Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * support whisper * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-04-05 07:16:31 -04:00
Hoan Luu Huu	d05cfb8ef0	remove deepgram tts linear16 wav 44 bytes header (#34) ... * remove deepgram tts linear16 wav 44 bytes header Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-04-05 07:15:02 -04:00
Hoan Luu Huu	8e7f4a3fab	Feat/mod deepgram tts (#33) ... * deepgram tts mode Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * fix crash audio sound Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip * run with opus Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * dg-request-id check --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-04-04 15:54:22 -04:00
Hoan Luu Huu	63e66042af	fix cannot build mod_audio_fork (#29) ... Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-03-31 21:08:01 -04:00
Hoan Luu Huu	eedcc03112	support streaming audio for mod_audio_fork (#28) ... * support streaming audio for mod_audio_fork Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * wip Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com> * fix review comments * fix review comments --------- Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>	2024-03-31 09:05:50 -04:00
Hoan Luu Huu	be6758c3a8	support azure tts stream (#13) ... * support azure stream * delete trash file * wip * wip * wip * wip * wip * wip * wip * fire variable_tts_time_to_first_byte_ms	2024-03-24 09:18:38 -04:00
Hoan Luu Huu	d6ae0a6a39	fix elevenlabs and whisper for multiple codec (#14) ... * fix elevenlabs and whisper for multiple codec Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> * fix review comments Signed-off-by: Quan HL <quan.luuhoang8@gmail.com> --------- Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>	2024-03-12 09:52:35 -04:00
Hoan Luu Huu	92dd3fc854	enable azure language identification mode (#15) ... Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>	2024-03-08 10:12:33 -05:00
Hoan Luu HuuandDave Horton	b4f3a41913	whisper tts stream module (#8) ... * whisper tts stream module * add convert mp3 to linear * add lmpg123 link * wip * whisper cache * wip * wip * clean up * add free mem and openai metric * whisper: cache files as mp3 for simplicity --------- Co-authored-by: Dave Horton <daveh@beachdognet.com>	2024-02-22 14:17:13 -05:00
Hoan Luu HuuandDave Horton	3edb4a47f2	Support elevenlabs TTS streaming api (#7) ... * added module for using eleven labs tts * wip Signed-off-by: Dave Horton <daveh@beachdognet.com> * fixes for caching streaming file * elevenlabs: fix issue that caused issue after mod_reload * return final response code in playback stopped event * send error if tts fails --------- Signed-off-by: Dave Horton <daveh@beachdognet.com> Co-authored-by: Dave Horton <daveh@beachdognet.com>	2024-01-31 07:35:20 -08:00