Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WWE example with ENCODER trigger task watchdog after enter REC_START status. (AUD-5935) #1330

Open
RoboticsChen opened this issue Dec 22, 2024 · 0 comments
Open

WWE example with ENCODER trigger task watchdog after enter REC_START status. (AUD-5935) #1330

RoboticsChen opened this issue Dec 22, 2024 · 0 comments

Comments

@RoboticsChen
Copy link

RoboticsChen commented Dec 22, 2024 •
edited
Loading

Environment

  • Audio development kit: [ESP32-S3-Korvo-2]
  • Audio kit version (for ESP32-S3-Korvo-2): [v3]
  • [Required] Module or chip used: [ESP32-S3-WROOM-1]
  • [Required] IDF version : v5.3.1
  • [Required] ADF version : v2.7-34-g8a3b56a9
  • Build system: [idf.py]
  • [Required] Running log:
Tips for collapsed Running log 
/home/user/esp/esp-adf/examples/speech_recognition/wwe/build/example_wwe.elf'
--- esp-idf-monitor 1.5.0 on /dev/ttyACM1 115200
--- Quit: Ctrl+] | Menu: Ctrl+T | Help: Ctrl+T followed by Ctrl+H
ESP-ROM:esp32s3-20210327
Build:Mar 27 2021
rst:0x1 (POWERON),boot:0xa (SPI_FAST_FLASH_BOOT)
SPIWP:0xee
mode:DIO, clock div:1
load:0x3fce2820,len:0x1918
load:0x403c8700,len:0x4
load:0x403c8704,len:0xe5c
load:0x403cb700,len:0x303c
entry 0x403c893c
I (27) boot: ESP-IDF v5.3.1-dirty 2nd stage bootloader
I (27) boot: compile time Dec 22 2024 13:42:21
I (27) boot: Multicore bootloader
I (30) boot: chip revision: v0.2
I (34) qio_mode: Enabling default flash chip QIO
I (39) boot.esp32s3: Boot SPI Speed : 80MHz
I (44) boot.esp32s3: SPI Mode       : QIO
I (49) boot.esp32s3: SPI Flash Size : 16MB
I (54) boot: Enabling RNG early entropy source...
I (59) boot: Partition Table:
I (63) boot: ## Label            Usage          Type ST Offset   Length
I (70) boot:  0 nvs              WiFi data        01 02 00009000 00004000
I (78) boot:  1 otadata          OTA data         01 00 0000d000 00002000
I (85) boot:  2 phy_init         RF data          01 01 0000f000 00001000
I (92) boot:  3 ota_0            OTA app          00 10 00010000 00290000
I (100) boot:  4 model            Unknown data     01 82 002a0000 00500000
I (108) boot:  5 flash_tone       Unknown data     01 27 007a0000 00032000
I (115) boot: End of partition table
I (119) esp_image: segment 0: paddr=00010020 vaddr=3c090020 size=33f40h (212800) map
I (160) esp_image: segment 1: paddr=00043f68 vaddr=3fc99e00 size=0551ch ( 21788) load
I (164) esp_image: segment 2: paddr=0004948c vaddr=40378000 size=06b8ch ( 27532) load
I (171) esp_image: segment 3: paddr=00050020 vaddr=42000020 size=8f1a8h (586152) map
I (263) esp_image: segment 4: paddr=000df1d0 vaddr=4037eb8c size=0b1bch ( 45500) load
I (280) boot: Loaded app from partition at offset 0x10000
I (280) boot: Disabling RNG early entropy source...
I (292) octal_psram: vendor id    : 0x0d (AP)
I (292) octal_psram: dev id       : 0x02 (generation 3)
I (292) octal_psram: density      : 0x03 (64 Mbit)
I (297) octal_psram: good-die     : 0x01 (Pass)
I (302) octal_psram: Latency      : 0x01 (Fixed)
I (308) octal_psram: VCC          : 0x01 (3V)
I (313) octal_psram: SRF          : 0x01 (Fast Refresh)
I (319) octal_psram: BurstType    : 0x01 (Hybrid Wrap)
I (324) octal_psram: BurstLen     : 0x01 (32 Byte)
I (330) octal_psram: Readlatency  : 0x02 (10 cycles@Fixed)
I (336) octal_psram: DriveStrength: 0x00 (1/1)
I (342) MSPI Timing: PSRAM timing tuning index: 4
I (346) esp_psram: Found 8MB PSRAM device
I (351) esp_psram: Speed: 80MHz
I (355) cpu_start: Multicore app
I (641) esp_psram: SPI SRAM memory test OK
I (649) cpu_start: Pro cpu start user code
I (650) cpu_start: cpu freq: 240000000 Hz
I (650) app_init: Application information:
I (652) app_init: Project name:     example_wwe
I (658) app_init: App version:      v2.7-34-g8a3b56a9-dirty
I (664) app_init: Compile time:     Dec 22 2024 13:42:14
I (670) app_init: ELF file SHA256:  628c9ba85...
I (675) app_init: ESP-IDF:          v5.3.1-dirty
I (681) efuse_init: Min chip rev:     v0.0
I (685) efuse_init: Max chip rev:     v0.99 
I (690) efuse_init: Chip rev:         v0.2
I (695) heap_init: Initializing. RAM available for dynamic allocation:
I (702) heap_init: At 3FCA04B8 len 00049258 (292 KiB): RAM
I (708) heap_init: At 3FCE9710 len 00005724 (21 KiB): RAM
I (714) heap_init: At 600FE100 len 00001EE8 (7 KiB): RTCRAM
I (721) esp_psram: Adding pool of 8192K of PSRAM memory to heap allocator
I (729) spi_flash: detected chip: gd
I (732) spi_flash: flash io: qio
W (737) ADC: legacy driver is deprecated, please migrate to `esp_adc/adc_oneshot.h`
I (745) sleep: Configure to isolate all GPIO pins in sleep state
I (752) sleep: Enable automatic switching of GPIO sleep configuration
I (759) main_task: Started on CPU0
I (779) esp_psram: Reserving pool of 32K of internal memory for DMA/internal allocations
I (779) main_task: Calling app_main()
W (779) i2c_bus_v2: I2C master handle is NULL, will create new one
I (789) gpio: GPIO[17]| InputEn: 1| OutputEn: 1| OpenDrain: 1| Pullup: 1| Pulldown: 0| Intr:0 
I (799) gpio: GPIO[18]| InputEn: 1| OutputEn: 1| OpenDrain: 1| Pullup: 1| Pulldown: 0| Intr:0 
I (809) DRV8311: ES8311 in Slave mode
I (819) gpio: GPIO[48]| InputEn: 0| OutputEn: 1| OpenDrain: 0| Pullup: 0| Pulldown: 0| Intr:0 
I (829) ES7210: ES7210 in Slave mode
I (839) ES7210: Enable ES7210_INPUT_MIC1
I (839) ES7210: Enable ES7210_INPUT_MIC2
I (839) ES7210: Enable ES7210_INPUT_MIC3
W (849) ES7210: Enable TDM mode. ES7210_SDP_INTERFACE2_REG12: 2
I (849) ES7210: config fmt 60
W (849) AUDIO_BOARD: The board has already been initialized!

----------------------------- ESP Audio Platform -----------------------------
|                                                                            |
|                 ESP_AUDIO-v1.8.0-10-g0cdd7ac-017893b-58c87be               |
|                     Compile date: Sep 27 2024-03:07:25                     |
------------------------------------------------------------------------------
I (899) wwe_example: Func:setup_player, Line:140, MEM Total:8634888 Bytes, Inter:296619 Bytes, Dram:296619 Bytes, Dram largest free:233472Bytes

I (909) wwe_example: esp_audio instance is:0x3c0d2d44

I (909) wwe_example: Recorder has been created
I (919) MODEL_LOADER: The storage free size is 23744 KB
I (919) MODEL_LOADER: The partition size is 5120 KB
I (929) MODEL_LOADER: Successfully load srmodels
I (929) RECORDER_SR: The first wakenet model: wn9_hilexin

I (939) AFE_SR: afe interface for speech recognition

I (949) AFE_SR: AFE version: SR_V220727

I (949) AFE_SR: Initial auido front-end, total channel: 3, mic num: 2, ref num: 1

I (959) AFE_SR: aec_init: 1, se_init: 1, vad_init: 1

I (959) AFE_SR: wakenet_init: 1

MC Quantized wakenet9: wakenet9_v1h24_嗨，乐鑫_3_0.608_0.615, tigger:v3, mode:2, p:0, (Sep  4 2024 11:49:31)
I (1229) AFE_SR: wake num: 3, mode: 0, (Sep  4 2024 11:49:31)

Build fst from commands.
Quantized MultiNet6:rnnt_ctc_1.0, name:mn6_cn, (Sep  4 2024 11:49:30)
Quantized MultiNet6 search method: 2, time out:5.8 s
I (2159) main_task: Returned from app_main()
I (4609) wwe_example: rec_engine_cb - REC_EVENT_WAKEUP_START
I (4609) wwe_example: wakeup: vol -42.704773, mod idx 1, word idx 1
I (4619) CODEC_ELEMENT_HELPER: The element is 0x3c0d41a8. The reserve data 2 is 0x0.
I (11089) RECORDER_SR: MN dect quit
I (14609) wwe_example: rec_engine_cb - REC_EVENT_WAKEUP_END
I (14609) wwe_example: Func:rec_engine_cb, Line:266, MEM Total:3236360 Bytes, Inter:238055 Bytes, Dram:238055 Bytes, Dram largest free:139264Bytes

I (17289) wwe_example: rec_engine_cb - REC_EVENT_WAKEUP_START
I (17289) wwe_example: wakeup: vol -33.481808, mod idx 1, word idx 1
I (17299) CODEC_ELEMENT_HELPER: The element is 0x3c0d41a8. The reserve data 2 is 0x0.
I (18899) wwe_example: rec_engine_cb - REC_EVENT_VAD_START
W (18909) wwe_example: voice read begin
I (18939) AMRNB_ENCODER: amrnb open
I (20419) wwe_example: rec_engine_cb - REC_EVENT_VAD_STOP
W (20429) wwe_example: voice read stopped
I (21319) wwe_example: rec_engine_cb - REC_EVENT_WAKEUP_END
I (21319) wwe_example: Func:rec_engine_cb, Line:266, MEM Total:3208848 Bytes, Inter:236159 Bytes, Dram:236159 Bytes, Dram largest free:139264Bytes

E (28899) task_wdt: Task watchdog got triggered. The following tasks/users did not reset the watchdog in time:
E (28899) task_wdt:  - IDLE0 (CPU 0)
E (28899) task_wdt: Tasks currently running:
E (28899) task_wdt: CPU 0: afe_mase
E (28899) task_wdt: CPU 1: IDLE1
E (28899) task_wdt: Print CPU 0 (current core) backtrace


Backtrace: 0x42062BB2:0x3FC9D470 0x4037C171:0x3FC9D4A0 0x42083A69:0x3FCB7250 0x42038EC8:0x3FCB7270 0x42034D56:0x3FCB7290 0x4203296A:0x3FCB72E0
--- 0x42062bb2: task_wdt_timeout_handling at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:434
 (inlined by) task_wdt_isr at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:507
0x4037c171: _xt_lowint1 at /home/star/esp/esp-idf/components/xtensa/xtensa_vectors.S:1240
0x42083a69: direct_radix2_bit_reverse at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_processor/asm_functions/fft_s16.c:32
0x42038ec8: test_real_fft_hp at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_processor/asm_functions/fft_s16.c:148
0x42034d56: esp_bss_hps16fft_process at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_processor/microphone_array_speech_enhancement/esp_bss_hps16fft.c:161
0x4203296a: afe_se_task at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_front_end/esp_afe_sr.c:704


E (38899) task_wdt: Task watchdog got triggered. The following tasks/users did not reset the watchdog in time:
E (38899) task_wdt:  - IDLE0 (CPU 0)
E (38899) task_wdt: Tasks currently running:
E (38899) task_wdt: CPU 0: feed_task
E (38899) task_wdt: CPU 1: IDLE1
E (38899) task_wdt: Print CPU 0 (current core) backtrace


Backtrace: 0x42062BB2:0x3FC9D470 0x4037C171:0x3FC9D4A0 0x42083BAD:0x3C3BE120 0x420338AD:0x3C3BE130 0x42031E51:0x3C3BE180 0x420321CB:0x3C3BE1A0 0x42010F69:0x3C3BE1C0
--- 0x42062bb2: task_wdt_timeout_handling at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:434
 (inlined by) task_wdt_isr at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:507
0x4037c171: _xt_lowint1 at /home/star/esp/esp-idf/components/xtensa/xtensa_vectors.S:1240
0x42083bad: loop_end_shiftl_rv16_rs16_rv16_728_shift_pos_0 at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_processor/asm_functions/shiftl_rv16_rs16_rv16_728.S:40
0x420338ad: esp_aec3_hps16fft_process at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_processor/acoustic_echo_cancellation/esp_aec3_hps16fft.c:185
0x42031e51: afe_feed_aec_init_true at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_front_end/esp_afe_sr.c:491
0x420321cb: afe_feed at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_front_end/esp_afe_sr.c:638
0x42010f69: feed_task at /home/star/esp/esp-adf/components/audio_recorder/recorder_sr.c:254


I (48009) RECORDER_SR: MN dect quit
E (48899) task_wdt: Task watchdog got triggered. The following tasks/users did not reset the watchdog in time:
E (48899) task_wdt:  - IDLE0 (CPU 0)
E (48899) task_wdt: Tasks currently running:
E (48899) task_wdt: CPU 0: resample
E (48899) task_wdt: CPU 1: IDLE1
E (48899) task_wdt: Print CPU 0 (current core) backtrace


Backtrace: 0x42062BB2:0x3FC9D470 0x4037C171:0x3FC9D4A0 0x42012568:0x3C5FB6E0
--- 0x42062bb2: task_wdt_timeout_handling at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:434
 (inlined by) task_wdt_isr at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:507
0x4037c171: _xt_lowint1 at /home/star/esp/esp-idf/components/xtensa/xtensa_vectors.S:1240
0x42012568: audio_element_task at /home/star/esp/esp-adf/components/audio_pipeline/audio_element.c:477


E (58899) task_wdt: Task watchdog got triggered. The following tasks/users did not reset the watchdog in time:
E (58899) task_wdt:  - IDLE0 (CPU 0)
E (58899) task_wdt: Tasks currently running:
E (58899) task_wdt: CPU 0: resample
E (58899) task_wdt: CPU 1: IDLE1
E (58899) task_wdt: Print CPU 0 (current core) backtrace


Backtrace: 0x42062BB2:0x3FC9D470 0x4037C171:0x3FC9D4A0 0x42012568:0x3C5FB6E0
--- 0x42062bb2: task_wdt_timeout_handling at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:434
 (inlined by) task_wdt_isr at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:507
0x4037c171: _xt_lowint1 at /home/star/esp/esp-idf/components/xtensa/xtensa_vectors.S:1240
0x42012568: audio_element_task at /home/star/esp/esp-adf/components/audio_pipeline/audio_element.c:477
  • Compiler version : xtensa-esp-elf-gcc (crosstool-NG esp-13.2.0_20240530) 13.2.0
  • Operating system: [Linux/Ubuntu24.04]
  • Using an IDE?: Vscode
  • Power supply: [USB]

Problem Description

WWE example with ENCODER trigger task watchdog after enter REC_START status.

Expected Behavior

Record voice without error after audio activation

Actual Behavior

Trigger the task watchdog and can not activate it again

Steps to Reproduce

  1. open the wwe example in the Vscode IDE with ESP32-IDF extension
  2. change the espressif device target to esp32s3
  3. change the macro definition from #define RECORDER_ENC_ENABLE (NO_ENCODER) to#define RECORDER_ENC_ENABLE (ENC_2_AMRNB)
  4. compiles the project and flash it to ESP32-S3-Korvo-2-v3 device
  5. open monitor (run the program)
  6. say the wake words (hi lexin) hearing 'ding' which means wake success, then keep quilent
  7. say the wake words again, you will find wake success again, then say something else trigger REC_START status, wait utill the wake ended
  8. now you can not wake it again, and the task watchdog error appear after seconds.

// If possible, attach a picture of your setup/wiring here.
image
image

Code to Reproduce This Issue

esp-adf/example/speech_recongnition/wwe

Other Items If Possible

elf_and_sdkconfig.zip
@github-actions github-actions bot changed the title WWE example with ENCODER trigger task watchdog after enter REC_START status. WWE example with ENCODER trigger task watchdog after enter REC_START status. (AUD-5935) Dec 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@RoboticsChen