Commit Graph

81 Commits

Author SHA1 Message Date
Dave Horton
b003ab0875 revert change that added support for aws language model, as this does not work on our earlier version of aws-sdk-cpp and recent versions have hugh performance issue on debian 12
Signed-off-by: Dave Horton <daveh@beachdognet.com>
1.2.27
2024-08-13 10:53:46 -04:00
Antony Jukes
81ceddf3d2 Added AWS_LANGUAGE_MODEL_NAME (#99)
Co-authored-by: ajukes <ajukes@callable.io>
1.2.26
2024-08-12 11:03:26 -04:00
rammohan-kore
110a12d5a5 feat/856: added "=" for version parameter at line #175 (#100)
https://github.com/jambonz/jambonz-feature-server/issues/856

Signed-off-by: rammohan-kore <rammohan.yadavalli@kore.com>
2024-08-12 09:09:23 -04:00
Hoan Luu Huu
fe1e4dcf11 deepgram tts support on-premise (#95)
* deepgram tts support on-premise

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

* fix review comment

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-08-08 07:42:47 -04:00
Hoan Luu Huu
f828171b3b support jambonz transcribe with multiple sampling rate (#98)
* support jambonz transcribe with multiple sampling rate

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-08-07 14:40:22 -04:00
Dave Horton
e717ca7dd3 fix: gain was being ignored in sayOnTrack (#97) 1.2.25 2024-07-31 15:19:11 -04:00
Dave Horton
3ce819b7c9 fixes for resampling and handling odd-number byte stream (#88)
* fixes for resampling and handling odd-number byte stream
1.2.24
2024-07-19 16:45:45 -04:00
Hoan Luu Huu
56df923cdb support elevenlabs previous_text, next_text (#75) 2024-07-19 10:22:59 -04:00
Vinod Dharashive
911ace221c Implementation SpeechServiceResponse_PostProcessingOption (#87)
Signed-off-by: Vinod Dharashive <vdharashive@gmail.com>
1.2.23
2024-07-07 09:17:20 -06:00
Dave Horton
47c4de4791 clear cached bidirectional audio when we get killAudio message (#86)
* clear cached bidirectional audio when we get killAudio message

* wip
1.2.22
2024-07-02 21:47:07 -06:00
Dave Horton
3459188bb6 use trylock on mutex (#85) 1.2.21 2024-07-01 08:16:31 -06:00
Dave Horton
d6e246d84c fix: discard incoming binary or text frame if we are shutting down to avoid deadlock (#84) 1.2.20 2024-06-28 07:28:35 -04:00
Hoan Luu Huu
de676ddc81 append null to ostringstream will make c_str return part of a string. (#83)
* append null to ostringstream will make c_str return part of a string.

* fixed review comment

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

* fixed review comment

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

* fixed review comment

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>
2024-06-28 07:08:40 -04:00
Dave Horton
d41bd15816 enable audio logging if env AZURE_AUDIO_LOGGING is set (#78)
* enable audio logging if env AZURE_AUDIO_LOGGING is set

* wip
1.2.19
2024-06-25 20:58:28 -04:00
Dave Horton
8bd20703b8 Fix/azure tts no device output (#79)
* enable audio logging if env AZURE_AUDIO_LOGGING is set

* wip

* per discussion with microsoft, add nullptr to creation of speechSynthesizer to ensure it knows we do not want it to play to device

Signed-off-by: Dave Horton <daveh@beachdognet.com>

* logging

* fix bug in creation of config string

* fix ticket 230 - Microsoft TTS having configuration data as part of audio generation

* azure transcribe, resuse existing cap_cb if azure configuration is changed

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* clean up azure code for how to re-create gsstream when configuration is changed

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* fix review comments

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* fix review comment

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* fix review comment

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wrap function in try catch

---------

Signed-off-by: Dave Horton <daveh@beachdognet.com>
Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
Co-authored-by: Hoan HL <quan.luuhoang8@gmail.com>
1.2.18
2024-06-23 14:54:36 -04:00
Dave Horton
2e553631dc implement silence as remove followed by add, fixes https://github.com/jambonz/jambonz-feature-server/issues/768 (#80) 2024-06-21 08:56:08 -04:00
Hoan Luu Huu
2a94213668 support single azure connection for same channel (#73)
* support single azure connection for same channel

* wip

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
1.2.17
2024-06-01 06:59:24 -04:00
Hoan Luu Huu
6ad663f9d9 whisper_tts should use rate to do resampling (#70)
Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
1.2.16
2024-05-29 08:13:38 -04:00
Hoan Luu Huu
c945a2de5a verbio stt/tts mods (#65)
* verbio tts mod

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* mod_verbio_transcribe

* wip

* wip

* wip

* wip

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* verbio stt

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-05-29 08:05:54 -04:00
Hoan Luu Huu
466dec7a6f mod_custom_tts (#53)
* mod_custom_tts

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* add custom_vendor to mod_dub

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-05-28 19:27:17 -04:00
Hoan Luu Huu
097ac337cc mod_vad_detect (#69)
* mod_vad_detect

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* mod_vad_detect

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-05-28 10:32:39 -04:00
Hoan Luu Huu
45ecf151c3 Delete tts tmp file if playback_start event has not been sent (#68)
* Delete tts tmp file if playback_start event has not been sent

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* Delete tts tmp file if playback_start event has not been sent

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-05-26 09:29:05 -04:00
Hoan Luu Huu
d1d0f5dd77 jb_transcribe correctly unlock mutex before cleanup (#66)
* jb_transcribe correctly unlock mutex before cleanup

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>
2024-05-23 07:48:02 -04:00
Dave Horton
e4a27ae133 minor logging
Signed-off-by: Dave Horton <daveh@beachdognet.com>
1.2.15
2024-05-14 06:59:11 -04:00
Hoan Luu Huu
19f20bf0e7 Fix/azure white noise (#63)
* azure return odd bytes audio, that azure tts mode generate white noise

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-05-14 06:55:44 -04:00
Hoan Luu Huu
b019a634bd Fix playht timeout while downloading audio (#61)
Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>
2024-05-10 12:18:32 -04:00
Dave Horton
f0b304b8a1 session mutex not properly unlocked causing stuck channels (#60)
Signed-off-by: Dave Horton <daveh@beachdognet.com>
1.2.14
2024-05-02 10:35:54 -04:00
Hoan Luu Huu
be3714465b support aws sessionToken (#58)
* support aws sessionToken

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* fix code style

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
1.2.12
2024-05-02 08:28:01 -04:00
Hoan Luu Huu
b495dba126 reset response when cached speech interface feeded new text (#59)
Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-05-02 07:24:57 -04:00
Hoan Luu Huu
33750b5420 mod_deepgram_transcribe keep alive connection (#56)
* mod_deepgram_transcribe keep alive connection

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* read use single connection configuration from env var

* remove deepgram media bug buffered data

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* fix review comments

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
1.2.11
2024-04-30 08:00:59 -04:00
Dave Horton
f8604656e3 minor logging 2024-04-29 18:09:23 -04:00
Hoan Luu Huu
916332d91d elevenlabs to use http 1.1 (#57)
* elevenlabs to use http 1.1

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* update the rest of mod tts

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* add env variable for disabling http2

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
1.2.10
2024-04-29 07:51:09 -04:00
Hoan Luu Huu
33fee93ec7 free maloc variable on mod_audio_fork (#54) 1.2.9 2024-04-23 09:15:11 -04:00
Hoan Luu Huu
41aebafd1c fix eleevnlabs callsession stuck (#55)
* fix eleevnlabs callsession stuck

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* fix read sample rate from session is not needed

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-04-23 09:14:43 -04:00
Andrew Golledge
bd69d476e7 Add Error Code Check to Google V1 Implementation (#51)
* Put the check for `grpc` error code 0 in the Google Speech-To-Text v1 as well.

* Distinguish between two types of error object in `grpc_read_thread`

* Improve naming of JSON field

* Correct error in JSON field name.

* Add sign-off to previous commit

Signed-off-by: Andrew Golledge <andreas.golledge@gmail.com>

---------

Signed-off-by: Andrew Golledge <andreas.golledge@gmail.com>
2024-04-22 19:20:15 -04:00
Dave Horton
fea51d5ecf initialize variables to avoid possible junk values
Signed-off-by: Dave Horton <daveh@beachdognet.com>
2024-04-22 16:06:32 -04:00
Dave Horton
83a2d1d730 modify cache folder name and various fixes from testing tts streaming (#50) 1.2.8 2024-04-18 11:28:17 -04:00
Hoan Luu Huu
3f642467eb add properties to tts span for mod_*_tts (#45)
* add properties to tts span for mod_*_tts

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* support deepgram tts span

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* support tts span for playht

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* support rimelabs tts span

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
1.2.7
2024-04-14 09:13:54 -04:00
Hoan Luu Huu
622cb14957 mod_*_tts is not able to parse http response code if the protocol is hot HTTP/2 (#44)
* fix mod_tts wrongly parsing http error code

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>
1.2.6
2024-04-13 08:51:03 -04:00
Dave Horton
1e1a51a3d1 overlapping close from previous connection after starting new one causes transcripts to stop (#43) 2024-04-12 19:02:11 -04:00
Hoan Luu Huu
4ce95e6d27 support new parameters for google v2 (#31)
* support new parameters for google v2

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* add enable_voice_activity_events

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* changes to start and end timeout

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
Co-authored-by: Dave Horton <daveh@beachdognet.com>
2024-04-12 07:24:46 -04:00
Hoan Luu Huu
f0d15c57a2 support mod_rimelabs_tts (#41)
* support mod_rimelabs_tts

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* add readme and license

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-04-12 07:23:21 -04:00
Hoan Luu Huu
2bbc18903c mod audio fork cannot parse ws:<IP>/call path (#40)
* mod audio fork cannot parse ws:<IP>/call path

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

* add comments for the regex

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

* add comments for the regex

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Quan HL <quan.luuhoang8@gmail.com>
1.2.5
2024-04-08 20:03:01 -04:00
Hoan Luu Huu
4aabb36a64 add playht tts to mod_dub (#39)
Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
1.2.4
2024-04-08 10:54:49 -04:00
Hoan Luu Huu
ee488e4621 support mod_playht_tts (#38)
* support mod_playht_tts

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
1.2.3
2024-04-08 10:22:16 -04:00
Dave Horton
751d890d9b change default base dir for streaming tts cache files to /tmp/ 1.2.2 2024-04-07 12:46:53 -04:00
Dave Horton
e431c5d159 changes to mod_azure_tts for event handling, resolve session locking issue in mod_whisper (#37) 1.2.1 2024-04-07 11:39:09 -04:00
Dave Horton
a96fb2b4b2 Fixes/mod azure tts (#36)
* fixes for unlocking mutex and minimizing time under lock

* call .get() on future returned from speechSynthesizer->SpeakTextAsync

* mod_azure_tts: various fixes, including dangling session lock and reducing latency

* mod_deepgram_transcribe: add support for transcribing filler words
1.2.0
2024-04-06 12:26:56 -04:00
Hoan Luu Huu
94361f1d20 mod_dub support sayOnTrack Deepgram (#35)
* mod_dub support sayOnTrack Deepgram

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* mod_dub sayOnTrack support azure

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* support whisper

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
1.1.3
2024-04-05 07:16:31 -04:00
Hoan Luu Huu
d05cfb8ef0 remove deepgram tts linear16 wav 44 bytes header (#34)
* remove deepgram tts linear16 wav 44 bytes header

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

* wip

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>

---------

Signed-off-by: Hoan HL <quan.luuhoang8@gmail.com>
2024-04-05 07:15:02 -04:00