ben.carrasco/jambonz-feature-server
1
0
Fork 0
mirror of https://github.com/jambonz/jambonz-feature-server.git synced 2026-10-04 02:04:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
920 Commits 179 Branches 346 Tags
feat/v092_dg_fix
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Dave Horton de1f8e7b1a #1088 ignore UtteranceEnd if we have unprocessed words (#1089) 
* #1088 ignore UtteranceEnd if we have unprocessed words

* wip
 2025-02-19 11:01:14 +07:00
Dave Horton 1efb198f72 Dial: fix error when receiving a REFER without a Referred-By header (#954) 2024-10-30 13:01:36 -04:00
Dave Horton 8e4995ec02 fix bug where middleware produces a cached app.tasks with an empty array (#947) 2024-10-24 20:43:27 -04:00
Dave Horton a005253a9f update to latest speech-utils 2024-10-18 12:27:29 -04:00
Dave Horton c79a6aaf8a Feat/llm update (#936) 
* add support for llm:update during LLM session

* make sure to end openai session when Llm task is killed

* wip

* wip

* wip

* wip

* wip

* wip

* wip
 2024-10-16 09:27:51 -04:00
Dave Horton f541ff1a15 add support for aws language model name when transcribing (#890) 
* add support for aws language model name when transcribing

* wip - from prev branch

* wip

* support both aws grpc and ws api - detect based on transcription payload

* update to drachtio-fsmrf@4.0.0

* fix for grpc compatibility, requires JAMBONES_AWS_TRANSCRIBE_USE_GRPC env

* back out major update to drachtio-srf and fsmrf; that should come in a separate PR

* update drachtio-srf
 2024-10-12 19:46:31 -04:00
Dave Horton 98b968d61f update test db (#933) 2024-10-12 19:34:40 -04:00
Dave Horton f09722a5b5 Feat/llm verb (#931) 
* wip

* working version for openai realtime beta

* lint

* tests: update db to latest 0.9.2 schema
 2024-10-12 19:26:27 -04:00
Dave Horton f84b3793e1 Feat/speechmatics (#932) 
* wip

* initial working version of speechmatics

* linting
 2024-10-12 18:42:53 -04:00
Dave Horton 84b7456c2d add support for speechmatics asr (#920) 
* update to verb specs with speechmatics support

* discover local ip using os module
 2024-10-11 09:24:36 -04:00
Dave Horton 7c24208067 fix #916: race condition where call just ended when action hook play completes (#917) 2024-09-25 20:17:22 -04:00
Dave Horton 7f7c26e982 fix for https://github.com/jambonz/freeswitch-modules/issues/117 (#912) 2024-09-25 20:13:56 -04:00
Dave Horton c4a6057fc6 bump version 2024-09-04 13:31:05 +01:00
Dave Horton c0ab936b76 wip (#830) 
* wip

* wip

* wip

* wip

* update deps

* update test to use latest freeswitch image
 2024-08-29 15:23:49 -04:00
Dave Horton 600ff763fa fix #840 (#880) 2024-08-26 10:14:59 -04:00
Dave Horton 2790e6d9ad fix linting error from PR 2024-08-20 08:36:24 -04:00
Dave Horton 68992bccf6 fix #866 (#867) 2024-08-16 14:54:22 -04:00
Dave Horton edd8f20642 fix for #826 race condition in say (#827) 
* fix for #826 race condition in say

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip
 2024-07-24 12:56:03 -04:00
Dave Horton 8672152873 fix for #765 (#785) 2024-06-28 09:05:05 -04:00
Dave Hortonandsnyk-bot 425b88f930 fix: package.json & package-lock.json to reduce vulnerabilities (#792) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JS-UNDICI-7361667

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2024-06-28 09:04:25 -04:00
Dave Horton 111976bea5 bug: clear asr timer when gather resolves with timeout (#788) 2024-06-28 08:54:36 -04:00
Dave Horton ec6d7b3f42 persistent connection for custom stt vendors in transcribe (#794) 2024-06-28 08:33:10 -04:00
Dave Horton be9c3406c1 fix bug where play incorrectly plays again after response received (#786) 
* fix bug where play incorrectly plays again after response received

* wip

* fix race condition where bot delay audio kcks off same instant we receive commands
 2024-06-25 12:25:55 -04:00
Dave Hortonandsnyk-bot 2f3ef1654a fix: package.json & package-lock.json to reduce vulnerabilities (#787) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JS-WS-7266574

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2024-06-24 15:07:55 -04:00
Dave Horton f5cbd26c9f update to speech-utils with support for JAMBONES_DISABLE_AZURE_TTS_STREAMING (#776) 2024-06-14 09:31:28 -04:00
Dave Horton d9fd82fa60 major refactor and simplification of actionHookDelay feature (#771) 
* major refactor and simplification of actionHookDelay feature

* wip for #765

* wip

* testing

* wip

* added validity checks for actionHookDelay properties

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* fix bug where config happens before endpoint is established

* wip

* hangup and clear ws connection if nogiveuptimer expires

* wip

* wip

* wip
 2024-06-14 09:24:26 -04:00
Dave Horton 76a3aa7f42 send end of utterance events if using deepgram, interim events are enabled, and utterance_end_ms option is set (#772) (#782) 2024-06-13 13:18:32 -04:00
Dave Horton 24b6d2464b update speech-utils and fsmrf (#764) 2024-05-28 18:24:51 -04:00
Dave Horton cd5421120f fix race condition with filler noise and also play filler noise when idle and waiting for commands (#763) 2024-05-28 12:45:29 -04:00
Dave Horton d132bdb92b fix gather race condition (#759) 2024-05-22 14:03:15 -04:00
Dave Horton 844b0cb05d log endpoint uuid for cross referencing with freeswitch logs 2024-05-20 11:04:15 -04:00
Dave Horton c0b56d4fc6 per email from microsoft, do not restart STT connection when we get a no audio event (#754) 2024-05-17 11:19:01 -04:00
Dave Horton d27de284e7 update to drachtio-srf@4.5.35 (#750) 2024-05-09 08:32:52 -04:00
Dave Horton dfe623e78a Fix/google race condition gather (#743) 
* lint

* logging

* wip
 2024-05-03 12:53:26 -04:00
Dave Horton 56b8f0623b limit utterance_end_ms to (1000,5000) per discussion with Deepgram (#740) 2024-05-02 13:19:14 -04:00
Dave Horton fad16144b9 update undici and ws (#739) 2024-05-01 14:20:43 -04:00
Dave HortonandHoan Luu Huu 6523a861c0 fix asr error notify wrong vendor name (#728) (#738) 
Co-authored-by: Hoan Luu Huu <110280845+xquanluu@users.noreply.github.com>
 2024-05-01 13:48:23 -04:00
Dave Horton cff67f5e4c dial race where caller hangs up while dial is starting (#737) 2024-05-01 13:38:59 -04:00
Dave Horton c77bd84e0e we should restart asr timer after a partial transcript (#735) 2024-04-30 14:53:08 -04:00
Dave Horton 3cd7a619ad ignore transcriptions from previous turns of conversation (#734) 2024-04-30 08:21:27 -04:00
Dave HortonandHoan Luu Huu 59cf02bd04 wait for session:reconnect ack to send queued msgs (#723) (#732) 
Co-authored-by: Hoan Luu Huu <110280845+xquanluu@users.noreply.github.com>
 2024-04-25 11:22:15 -04:00
Dave Horton a18d55e9ab minor fix for leaving coach mode in conferencing 2024-04-22 12:46:34 -04:00
Dave Horton d474b9d604 Feat/advanced conferencing features (#730) 
* update drachtio-fsmrf and fixes to setCoachMode

* wip

* wip

* wip

* wip

* wip

* update gh actions
 2024-04-22 11:00:05 -04:00
Dave Horton 8d2b60c284 minor 2024-04-21 09:51:05 -04:00
Dave HortonandHoan Luu Huu 9cf9d4f587 Fix/0.8.5 cherries (#724) 
* kill play task if bot responds verbs while actionHook delay is enabled (#712)

* kill play task if bot responds verbs while actionHook delay is enabled

* fix actionHook delay continues even the bot already responded verbs

* wip

* wip

* wip

* gather is hang if listenDuringPrompt = false and say/play task throw exception (#717)

* merge fix for Support ASR TTS fallback (#713)

---------

Co-authored-by: Hoan Luu Huu <110280845+xquanluu@users.noreply.github.com>
 2024-04-17 11:01:21 -04:00
Dave Horton bd002ede48 ignore google errors with error_code 0 2024-04-16 20:06:26 -04:00
Dave Horton 1a2aa91973 proper fix for precache (#721) 
* proper fix for precache

* wip
 2024-04-15 16:25:12 -04:00
Dave Horton e322b7d8d3 be more cautious about pre-caching prompts; in particular, a Config verb will not give us time to precache so avoid in that scenario (#720) 2024-04-15 15:38:10 -04:00
Dave Horton 2595f527ff gather: fix bug where empty deepgram transcript saved incorrectly 2024-04-13 09:59:02 -04:00
Dave Horton 1d77c0cd20 bugfx: bargein after first when config bargein with sticky=true fails 2024-04-12 20:08:21 -04:00
Dave Horton ecf3d140d6 fix #714 (#715) 2024-04-10 16:23:22 -04:00
Dave Horton 9b722ae36d update deps (#709) 
* update deps

* version
 2024-04-07 18:22:31 -04:00
Dave Horton 370b046fac update to speech utils with azure 1.36.0 2024-04-07 12:16:35 -04:00
Dave Horton 043860c4a3 update to speech utils supporting deepgram tts (#708) 2024-04-06 12:35:03 -04:00
Dave Horton a021ee3112 update unidici (#707) 2024-04-05 17:23:21 -04:00
Dave Horton 8999c85a71 Fixes/ws testing dh (#704) 
* fixes from testing with translator app

* more updates

* linting

* update gh actions to node 20

* add support for google v2 preconfigured recognizer

* add support for google voice activity events

* update to speech-utils@0.0.45

* update speech-utils to support caching azure tts

* transcribe must buffer transcripts for channel 1 and 2 separately

* further fix for accumulating transcripts

* linting

* deepgram sends transcripts with empty alternatives array

* fix deepgram returning an empty array
 2024-04-03 14:30:49 -04:00
Dave Horton ec58232b61 Fix/replace application issue (#692) 
* fix scenario where ws replace application from gather while awaiting command and no tasks on execution stack

* lint

* remove some debug logging
 2024-03-23 16:14:16 -04:00
Dave Horton dbd3b59901 fix #666 2024-02-26 09:39:49 -05:00
Dave Horton fc3655c9bd fixes for confirm session (#663) 
* fixes for confirm session

* allow empty dialconfirm array
 2024-02-22 12:33:35 -05:00
Dave Horton d0ebe3f99f fix possible undefined reference in precache audio (#662) 
* fix possible undefined reference in precache audio

* fix parsing of JAMBONES_EAGERLY_PRE_CACHE_AUDIO
 2024-02-22 07:58:41 -05:00
Dave Horton 51a379998f fix #655 (#658) 
* fix #655

* fix race condition
 2024-02-22 07:46:53 -05:00
Dave Horton 662b6d3d95 fix: elevenlabs caching with streaming 2024-02-12 21:08:41 -05:00
Dave Horton 42be9ff1ca update to speech-utils with env to disable elevenlabs streaming (default is on) 2024-02-12 12:49:45 -05:00
Dave Horton f0533c881b deepgram gather: if both endpointing and utterance_end_ms are set (bu… (#644) 
* deepgram gather: if both endpointing and utterance_end_ms are set (but not continous asr) return either when we get speech_final or UtteranceEnd.  This is the belt-and-suspenders apprach deepgram is recommending

* include verb id in action hook if one was provided in the verb set

* minor
 2024-02-12 12:32:43 -05:00
Dave Horton 565478cc0a #573 address race condition in pause/resume recording (#584) 2024-02-12 10:26:34 -05:00
Dave Horton 9c33a790bd update to latest speech-utils (#639) 2024-02-08 15:54:45 -05:00
Dave Horton 9f9a9ec598 initial changes for deepgram on-prem (#636) 
* initial changes for deepgram on-prem

* typo

* fixes for selecting deepgram model

* update some property names

* wip

* wip

* wip
 2024-02-07 14:21:05 -05:00
Dave Horton 75566bb268 bump to start 0.8.6 2024-02-07 08:51:05 -05:00
Dave Horton 0491c5ce25 minor logging changes 2024-01-27 12:59:23 -05:00
Dave Horton 901e412343 fix bug where final transcript with finished header results in timeout (#624) 2024-01-25 08:48:22 -05:00
Dave Horton e57c7ba90a fix for #627 (#628) 2024-01-25 08:46:57 -05:00
Dave Horton aabf37e269 update db-helpers 2024-01-17 13:23:21 -05:00
Dave Horton 6d5ef6a215 gather: dont resolve if deepgram sends final/empty transcript with no transcripts previously buffered (#618) 2024-01-17 10:59:37 -05:00
Dave Horton f22d66dfd6 set default deepgram model by language and task (gather vs transcribe) (#610) 
* set default deepgram model by language and task (gather vs transcribe)

* wip
 2024-01-14 10:38:14 -05:00
Dave Horton 09a83e3a31 Feature/precache audio (#609) 
* wip

* fix for establishing vendor etc

* more fixes

* avoid a pre-caching attempt if synth settings change
 2024-01-13 12:51:25 -05:00
Dave Horton 6f6d7a06b0 Revert "Fix/dual legs transcribe race condition (#593)" (#600) 
This reverts commit 9d70ed96a1.
 2024-01-09 08:23:13 -05:00
Dave Horton 2c48083c26 fix to be more precise about removing custom event handlers so that w… (#580) 
* fix to be more precise about removing custom event handlers so that when we stop a gather we dont also inadvertently stop a background transcribe as well

* test fixes

* fix: endpointing=false was being ignored for Deepgram
 2023-12-28 11:00:27 -05:00
Dave Horton 47fbc1a4a4 allow custom speech with no auth token (#571) 2023-12-18 14:51:34 -05:00
Dave Horton 7474a359a4 update to drachtio-fsmrf@3.0.33 2023-12-18 14:28:25 -05:00
Dave Horton 077460d0e2 Feat/multiset envs (#569) 
* update to drachtio-fsmrf@3.0.31

* fix prev commits
 2023-12-15 15:39:15 -05:00
Dave Horton bb81f9f3da minor logging 2023-12-07 13:00:25 -05:00
Dave Horton e5b60ca9b0 trying to pass redis client to speech utils causing restart (#557) 2023-12-01 18:26:33 -05:00
Dave Horton 9ae4b04fc5 update badge 2023-11-14 10:27:16 -05:00
Dave Horton 7c36a08852 Feat/dial via sip proxy (#532) 
* add support for dialing via proxy with target.proxy

* update verb-specifications with support for target.proxy
 2023-11-14 09:06:43 -05:00
Dave Horton 708c2c661f 0.8.5 2023-11-09 12:36:04 -05:00
Dave Horton 1156bae2de fix for #521 - allow pause in confirmHook applications (#522) 2023-11-07 09:46:41 -05:00
Dave Horton c6c599ab99 fix dialogflow tts bug (tts not working due to 'default' being assigned to label) and update to drachtio-srf with fix for parsing sip:1234@feature-server (#518) 2023-11-06 15:05:17 -05:00
Dave Horton 4d0f0fe75f prevent exception referencing user.uri (#517) 2023-11-06 13:42:37 -05:00
Dave Horton 6d625d87ad Feat/assemblyai testing (#516) 
* handle errors from assemblyai

* wip

* fix alert

* normalizeAssemblyai
 2023-11-02 17:05:28 -04:00
Dave Horton 6b9f6a7d90 if dial.confirmHook returns empty array do not create a confirmSession (#513) 2023-11-01 08:47:41 -04:00
Dave Horton 3cdf568fb6 fix logging on child leg after REFER received on A leg (#512) 2023-10-31 20:55:39 -04:00
Dave Horton e5772d6b85 allow dial referHook to return application to execute on the other le… (#505) 
* allow dial referHook to return application to execute on the other leg; fixes #504

* fix session tracking

* minor logging

* minor
 2023-10-30 13:59:54 -04:00
Dave Horton f43a5c1491 deepgram: rework continuous asr, and resolve on speech_final not is_f… (#501) 
* deepgram: rework continuous asr, and resolve on speech_final not is_final (wip)

* wip

* deepgram: empty final transcript should trigger resolve with speech if we have buffered transcripts

* wip

* fixes for deepgram compiling multiple transcripts

* test deepgram utteranceEndMs

* more handling of utteranceEndMs

* wip

* better handling of digit strings collected over multiple deepgram responses

* wip

* add support for deepgramOptions.shortUtterance which triggers off of is_final instead of speech_final

* apply deepgram fixes to transcribe

* cleanup continnuous asr

* more continuous asr fixes for deepgram

* update to verb-specifications for handling SttTask properties

* set log level for tests back to error
 2023-10-30 13:57:25 -04:00
Dave Horton 67f8f7181a #508 - add support for azureOptions.speechSegmentationSilenceTimeoutMs (#509) 
* #508 - add support for azureOptions.speechSegmentationSilenceTimeoutMs

* update verb specs
 2023-10-30 13:10:31 -04:00
Dave Horton ddab4d7548 update to verb-specifications for handling SttTask properties 2023-10-28 14:20:26 -04:00
Dave Horton 916d988dbd add support for deepgram smart_format option (#500) 
* add support for deepgram smart_format option

* handle nonexistent hints
 2023-10-25 14:29:38 -04:00
Dave Horton 168b4dc051 fix #493: remove nulls from cerateCall payload in order not to trip up validation (#494) 2023-10-23 10:58:28 -04:00
Dave Horton a92ea9c5da ensure recognizer.altLanguages is an empty array if not otherwise specified 2023-10-12 10:01:14 -04:00
Dave Horton f651cfa0b7 prune unused function (#478) 2023-10-09 15:03:27 -04:00
Dave Horton cb78627e66 tag is allowed in siprec (#475) 2023-10-06 08:53:13 -04:00