esphome-jk-bms with webserver

[pfeupfeu]

Hello,
I would like to combine esphome-jk-bms with the web-server feature. Unfortunately the esp-idf framework does not offer this feature. So I tried to use :

external_components:
  - source: github://pr#3500
    components:
      - web_server
      - web_server_idf
      - web_server_base
      - captive_portal

but I get the Error message "ERROR Unexpected exception while reading configuration:"

What I'm doing wrong?

[syssi]

You could try to use the arduino framework. If you have luck the initial issue (crash on the first received BLE notification) was fixed.

[syssi]

On my system (Debian Bullseye, python 3.9.2, virtualenv) this builds fine:

esp32:
  board: wemos_d1_mini32
  framework:
    type: esp-idf
    version: latest

external_components:
  - source: ${external_components_source}
    refresh: 0s
  - source: github://pr#3500
    components:
      - web_server
      - web_server_idf
      - web_server_base
      - captive_portal

wifi:
  ssid: !secret wifi_ssid
  password: !secret wifi_password

Your build issue was mentioned here:

esphome/esphome#3500 (comment)
esphome/esphome#3500 (comment)

[pfeupfeu]

Thank you for your very fast answer!

If I use the esp-idf framework (without a web server), the software runs and I get an acceptable to poor connection to the WiFi.
If I use the arduino framework, the software runs but I get no connection or only a very poor connection to the WiFi.
The router is only 3m away.

Ok, no crash on the first received BLE notification, but other problems. I'm using a AZDelivery LOLIN32 Lite Board, and

board: lolin32_lite

So I have to try the other workarounds.

[pfeupfeu]

Success! It is working!
I used the second workaround you mentioned:

esphome/esphome#3500 (comment)

And the WiFi and BLE performance is very good.

Thany you very much!

[riker65]

Hi, this comment 3500 is beyond my program knowledge.

How did you implement it? thanks

[syssi]

I've prepared a user friendly version. Just use this configuration example:

https://github.com/syssi/esphome-jk-bms/blob/add-webinterface/esp32-ble-example.yaml

Or extend your configuration YAML with the green lines:

https://github.com/syssi/esphome-jk-bms/pull/278/files#diff-6d19e7b8b7435fb5c57e1ad1b8498afa48c2073ed985bf1fc1d82f08eb2ded56

This is the UI:

[riker65]

Hi, strangewise I have some issues compiling on one environment windows10 , running on ubuntu ..

Reinstalled esphome-jk-bms from git already.

Do not understand what is missing.

Maybe anyone is having an idea?
python 3.10 on windows

Compiling .pioenvs\jk-bms\src\esphome\components\web_server_idf\web_server_idf.o Compiling .pioenvs\jk-bms\src\esphome\components\web_server_idf\web_server_idf_ota.o src/esphome/components/web_server/web_server.cpp: In lambda function: src/esphome/components/web_server/web_server.cpp:107:40: error: 'class esphome::Application' has no member named 'get_friendly_name' root["title"] = App.get_friendly_name().empty() ? App.get_name() : App.get_friendly_name(); ^~~~~~~~~~~~~~~~~ src/esphome/components/web_server/web_server.cpp:107:91: error: 'class esphome::Application' has no member named 'get_friendly_name' root["title"] = App.get_friendly_name().empty() ? App.get_name() : App.get_friendly_name(); ^~~~~~~~~~~~~~~~~ src/esphome/components/web_server/web_server.cpp:108:42: error: 'class esphome::Application' has no member named 'get_comment'; did you mean 'get_name'? root["comment"] = App.get_comment(); ^~~~~~~~~~~ get_name *** [.pioenvs\jk-bms\src\esphome\components\web_server\web_server.o] Error 1 =============================================================== [FAILED] Took 134.11 seconds ===================

[syssi]

If you have the choice I would like to focus on ubuntu as build host. :-)

[riker65]

Hi, strangewise, even ota: is set, no ota options to select file on webgui ?

what am I missing?

[syssi]

Please keep in mind you are using the ESPHome pull request: esphome/esphome#3500

The description mentions:

Known limitation:

• No OTA update support yet.

[syssi]

Please use the command line esphome run yourconfig.yaml to push OTA updates to your (ota enabled) devices.

[riker65]

yes via cli it is working, just wondering why webgui ota update is not available?
thx

issue is when testing and changing the device name- ota is not working because not found in network , than uploading would be a good option

[riker65]

ok understood

[testpaul999]

Hi,
I‘v use this with the actual esp32-ble and it works fine.
But, pls is it possible the sort the entry’s in the right order?
1,2,3,4,5,6,7 and not 1,10,11,….19,2,20,21….

regards

[syssi]

This is just a setting and can be easily adjusted:

number:
  - platform: jk_bms_ble
    jk_bms_ble_id: bms0
    balance_trigger_voltage:
      name: "Ausloesespannung des Balancers"
    cell_count:
      name: "Zellanzahl"
    total_battery_capacity:
      name: "Nennkapazitaet"

[testpaul999]

Hallo,
Native Sprache ist deutlich einfacher. 😉
Mich „stört“ der Header. Ich der Text, ich hätte gerne nur den „cell count“ z.B.

danke

[syssi]

${name} is the variable which should be removed:

    cell_count:
      name: "${name} cell count"

to

    cell_count:
      name: "cell count"

[testpaul999]

Einfach $Name weglassen oder?

[testpaul999]

Danke 🙂

[andyw73]

I have been using the arduino framework however I am tryin tho incorperate the bluetooth to occupy the bms channel for safety reasons.
When trying to compile the firmware to use esp-idf and the above code from PopOs which is ubuntu based I get an error:
Compiling .pioenvs/aisite-access-demo/src/esphome/components/wifi/wifi_component.o
In file included from src/esphome/components/web_server/web_server.cpp:1:
src/esphome/components/web_server/web_server.h:17:53: error: expected initializer before 'PROGMEM'
extern const uint8_t ESPHOME_WEBSERVER_INDEX_HTML[] PROGMEM;
^~~~~~~
src/esphome/components/web_server/web_server.cpp: In member function 'void esphome::web_server::WebServer::handle_index_request(esphome::web_server_idf::AsyncWebServerRequest*)':
src/esphome/components/web_server/web_server.cpp:330:50: error: 'ESPHOME_WEBSERVER_INDEX_HTML' was not declared in this scope
request->beginResponse_P(200, "text/html", ESPHOME_WEBSERVER_INDEX_HTML, ESPHOME_WEBSERVER_INDEX_HTML_SIZE);
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
src/esphome/components/web_server/web_server.cpp:330:50: note: suggested alternative: 'ESPHOME_WEBSERVER_INDEX_HTML_SIZE'
request->beginResponse_P(200, "text/html", ESPHOME_WEBSERVER_INDEX_HTML, ESPHOME_WEBSERVER_INDEX_HTML_SIZE);
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
ESPHOME_WEBSERVER_INDEX_HTML_SIZE
Has anyone else encountered this issue?

[syssi]

Could you provide your YAML and the used ESPHome version?

[andyw73]

The code responsible is below. I have not included the bluetooth tracker....

substitutions:
  name: aisite-access-demo
  external_components_source: github://syssi/esphome-jk-bms@main
  tx_pin: GPIO16
  rx_pin: GPIO17
  mac_address: C8:47:8C:E2:D7:A2

esphome:
  name: ${name}
  platformio_options:
    build_flags:
      - -DCONFIG_ARDUINO_LOOP_STACK_SIZE=32768
  project:
    name: "syssi.esphome-jk-bms"
    version: 1.5.0

esp32:
  board: nodemcu-32s
  #variant: esp32
  framework:
    type: esp-idf
    #version: latest
    
ble_client:
  - mac_address: ${mac_address}
    id: client0

external_components:
  - source: ${external_components_source}
    refresh: 0s
    
  - source: github://pr#3500
    components:
      - web_server
      - web_server_idf
      - web_server_base
      - captive_portal
    refresh: 0s

wifi:
  ssid: !secret wifi_ssid
  password: !secret wifi_password
  manual_ip:
    static_ip: 192.168.1.25
    gateway: 192.168.1.1
    subnet: 255.255.255.0
    dns1: 1.1.1.1
    dns2: 8.8.8.8
ota:

logger:
  level: WARN

# web configuration entry
web_server:
  local: false
  port: 80
  auth:
    username: #####
    password: #####

# api:

mqtt:
  broker: 192.168.1.153	

# rest of code.....

The esphome version is 2023.6.3 which is the lastest version.

[syssi]

If you just want to occupy the bluetooth module you could stick to the Arduino framework and the official web_server component:

substitutions:
  name: aisite-access-demo
  external_components_source: github://syssi/esphome-jk-bms@main
  tx_pin: GPIO16
  rx_pin: GPIO17
  mac_address: C8:47:8C:E2:D7:A2

esphome:
  name: ${name}
  platformio_options:
    build_flags:
      - -DCONFIG_ARDUINO_LOOP_STACK_SIZE=32768
  project:
    name: "syssi.esphome-jk-bms"
    version: 1.5.0

esp32:
  board: nodemcu-32s
  #variant: esp32

ble_client:
  - mac_address: ${mac_address}
    id: client0

external_components:
  - source: ${external_components_source}
    refresh: 0s

wifi:
  ssid: !secret wifi_ssid
  password: !secret wifi_password
  manual_ip:
    static_ip: 192.168.1.25
    gateway: 192.168.1.1
    subnet: 255.255.255.0
    dns1: 1.1.1.1
    dns2: 8.8.8.8

ota:

logger:
  level: WARN

# web configuration entry
web_server:
  local: false
  port: 80

# api:

mqtt:
  broker: 192.168.1.153

# rest of code.....

[andyw73]

unfortunatly when adding anything bluetooth related I get errors on startup of the device. If I remove the bluetooth entries everything functions as expected. This is just with bl_client and not the tracker..

Hard resetting via RTS pin...
INFO Successfully uploaded program.
INFO Starting log output from /dev/ttyUSB0 with baud rate 115200
[13:00:43][W][ota:103]: Last Boot was an unhandled reset, will proceed to safe mode in 8 restarts
[13:00:43]
[13:00:43]abort() was called at PC 0x401e89a7 on core 1
[13:00:43]
[13:00:43]
[13:00:43]Backtrace:0x40083815:0x3ffcd5800x400931f9:0x3ffcd5a0 0x400987bd:0x3ffcd5c0 0x401e89a7:0x3ffcd640 0x401e89ee:0x3ffcd660 0x401e8ae7:0x3ffcd680 0x401e8a46:0x3ffcd6a0 0x400da92a:0x3ffcd6c0 0x400da95b:0x3ffcd6f0 0x400db3d0:0x3ffcd720 0x40201485:0x3ffcd740 0x400e33e8:0x3ffcd760 0x400ea31a:0x3ffcd790 0x400f5a5a:0x3ffcda60
WARNING Found stack trace! Trying to decode it
WARNING Decoded 0x40083815: panic_abort at /Users/ficeto/Desktop/ESP32/ESP32S2/esp-idf-public/components/esp_system/panic.c:402
WARNING Decoded 0x400931f9: esp_system_abort at /Users/ficeto/Desktop/ESP32/ESP32S2/esp-idf-public/components/esp_system/esp_system.c:128
WARNING Decoded 0x400987bd: abort at /Users/ficeto/Desktop/ESP32/ESP32S2/esp-idf-public/components/newlib/abort.c:46
WARNING Decoded 0x401e89a7: __cxxabiv1::__terminate(void ()()) at /builds/idf/crosstool-NG/.build/xtensa-esp32-elf/src/gcc/libstdc++-v3/libsupc++/eh_terminate.cc:47
WARNING Decoded 0x401e89ee: std::terminate() at /builds/idf/crosstool-NG/.build/xtensa-esp32-elf/src/gcc/libstdc++-v3/libsupc++/eh_terminate.cc:57
WARNING Decoded 0x401e8ae7: __cxa_throw at /builds/idf/crosstool-NG/.build/xtensa-esp32-elf/src/gcc/libstdc++-v3/libsupc++/eh_throw.cc:95
WARNING Decoded 0x401e8a46: operator new(unsigned int) at /builds/idf/crosstool-NG/.build/xtensa-esp32-elf/src/gcc/libstdc++-v3/libsupc++/new_op.cc:54
WARNING Decoded 0x400da92a: __gnu_cxx::new_allocatoresphome::mqtt::MQTTComponent*::allocate(unsigned int, void const) at /home/andy/.platformio/packages/toolchain-xtensa-esp32@8.4.0+2021r2-patch5/xtensa-esp32-elf/include/c++/8.4.0/ext/new_allocator.h:111
(inlined by) std::allocator_traits<std::allocatoresphome::mqtt::MQTTComponent* >::allocate(std::allocatoresphome::mqtt::MQTTComponent*&, unsigned int) at /home/andy/.platformio/packages/toolchain-xtensa-esp32@8.4.0+2021r2-patch5/xtensa-esp32-elf/include/c++/8.4.0/bits/alloc_traits.h:436
(inlined by) std::_Vector_base<esphome::mqtt::MQTTComponent*, std::allocatoresphome::mqtt::MQTTComponent* >::_M_allocate(unsigned int) at /home/andy/.platformio/packages/toolchain-xtensa-esp32@8.4.0+2021r2-patch5/xtensa-esp32-elf/include/c++/8.4.0/bits/stl_vector.h:296
(inlined by) void std::vector<esphome::mqtt::MQTTComponent*, std::allocatoresphome::mqtt::MQTTComponent* >::_M_realloc_insert<esphome::mqtt::MQTTComponent* const&>(__gnu_cxx::__normal_iterator<esphome::mqtt::MQTTComponent**, std::vector<esphome::mqtt::MQTTComponent*, std::allocatoresphome::mqtt::MQTTComponent* > >, esphome::mqtt::MQTTComponent* const&) at /home/andy/.platformio/packages/toolchain-xtensa-esp32@8.4.0+2021r2-patch5/xtensa-esp32-elf/include/c++/8.4.0/bits/vector.tcc:427
WARNING Decoded 0x400da95b: std::vector<esphome::mqtt::MQTTComponent*, std::allocatoresphome::mqtt::MQTTComponent* >::push_back(esphome::mqtt::MQTTComponent* const&) at /home/andy/.platformio/packages/toolchain-xtensa-esp32@8.4.0+2021r2-patch5/xtensa-esp32-elf/include/c++/8.4.0/bits/stl_vector.h:1085
(inlined by) esphome::mqtt::MQTTClientComponent::register_mqtt_component(esphome::mqtt::MQTTComponent*) at /home/andy/Esphome/esphome-jk-bms/.esphome/build/aisite-access-demo/src/esphome/components/mqtt/mqtt_client.cpp:577
WARNING Decoded 0x400db3d0: esphome::mqtt::MQTTComponent::call_setup() at /home/andy/Esphome/esphome-jk-bms/.esphome/build/aisite-access-demo/src/esphome/components/mqtt/mqtt_component.cpp:189
WARNING Decoded 0x40201485: esphome::Component::call() at /home/andy/Esphome/esphome-jk-bms/.esphome/build/aisite-access-demo/src/esphome/core/component.cpp:98
WARNING Decoded 0x400e33e8: esphome::Application::setup() at /home/andy/Esphome/esphome-jk-bms/.esphome/build/aisite-access-demo/src/esphome/core/application.cpp:38
WARNING Decoded 0x400ea31a: setup() at /home/andy/Esphome/esphome-jk-bms/.esphome/build/aisite-access-demo/esp32-mqtt.yaml:541
WARNING Decoded 0x400f5a5a: loopTask(void*) at /home/andy/.platformio/packages/framework-arduinoespressif32@3.20005.220925/cores/esp32/main.cpp:42
[13:00:44]
[13:00:44]
[13:00:44]
[13:00:44]
[13:00:44]ELF file SHA256: 0000000000000000
[13:00:44]
[13:00:44]Rebooting...
[13:00:44]ets Jun 8 2016 00:22:57
[13:00:44]
[13:00:44]rst:0xc (SW_CPU_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
[13:00:44]configsip: 0, SPIWP:0xee
[13:00:44]clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
[13:00:44]mode:DIO, clock div:2
[13:00:44]load:0x3fff0030,len:1184
[13:00:44]load:0x40078000,len:13132
[13:00:44]load:0x40080400,len:3036
[13:00:44]entry 0x400805e4
[13:00:49][W][ota:103]: Last Boot was an unhandled reset, will proceed to safe mode in 7 restarts
[13:00:50]
[13:00:50]abort() was called at PC 0x401e89a7 on core 1
[13:00:50]
[13:00:50]
[13:00:50]Backtrace:0x40083815:0x3ffcd5800x400931f9:0x3ffcd5a0 0x400987bd:0x3ffcd5c0 0x401e89a7:0x3ffcd640 0x401e89ee:0x3ffcd660 0x401e8ae7:0x3ffcd680 0x401e8a46:0x3ffcd6a0 0x400da92a:0x3ffcd6c0 0x400da95b:0x3ffcd6f0 0x400db3d0:0x3ffcd720 0x40201485:0x3ffcd740 0x400e33e8:0x3ffcd760 0x400ea31a:0x3ffcd790 0x400f5a5a:0x3ffcda60

[syssi]

Uuuuh thats bad. It look like the new ESP-IDF web_server component is work in progress and cannot be used at the moment. So you somehow stuck here.

[andyw73]

This error is only when using arduino framework hense trying the esp-idf framework.
Removing anything bluetooth related and using the arduino framework the esp32 functions as expected however would like to incorperate the bluetooth occupy fix.

[syssi]

Do you need the web_server for sure? If you could skip the web_server component the ESP-IDF framework should compile and occupy the bluetooth module properly.

[andyw73]

The web server is useful for carrying out ota updates as the systems will be remote. It is unfortunate there is no way to carry out a ota update via the mqtt server using esphome.

[syssi]

Good point but if I remember correctly (and the knowledge isn't obsolete) the ESP-IDF webserver component doesn't support OTA yet.

[andyw73]

Not sure there does seem to be a commit a couple of days ago that adds ota support? esphome/esphome#3500