Muse Luxe voice assistant now possible?

Hi,

Tetele’s yaml is working fine without modification, adding these 3 line improves a bit the listening perfrmances.

The toggle on my side was only one time, not at every command.

you can’t I think, you need to use the method where you add the device thru ESPhome

1 Like

Sadly my luxe stops responding after the first command…also I don’t hear a response from the unit afterwards?..but if I toggle the wake word slider off/on again I hear the speaker working and the light (flashing) responding again…

1 Like

New tutorial how to setup Chatgpt as a conversation adgent

1 Like

I’ve noticed a weird issue.

I reflashed the muse using esphome with Tetele’s yaml and the modifications so I could tweak them.

After I flashed it, it went into a really short loop (this log is about 3 seconds) and it only stopped after turning it off and on again.

Compiling .pioenvs/muse-luxe/src/main.cpp.o
Linking .pioenvs/muse-luxe/firmware.elf
RAM:   [=         ]  13.5% (used 44132 bytes from 327680 bytes)
Flash: [=======   ]  72.4% (used 1328405 bytes from 1835008 bytes)
Building .pioenvs/muse-luxe/firmware.bin
Creating esp32 image...
Successfully created esp32 image.
esp32_create_combined_bin([".pioenvs/muse-luxe/firmware.bin"], [".pioenvs/muse-luxe/firmware.elf"])
Wrote 0x155ba0 bytes to file /data/build/muse-luxe/.pioenvs/muse-luxe/firmware-factory.bin, ready to flash to offset 0x0
========================= [SUCCESS] Took 18.89 seconds =========================
INFO Successfully compiled program.
INFO Connecting to 192.168.3.9
INFO Uploading /data/build/muse-luxe/.pioenvs/muse-luxe/firmware.bin (1334176 bytes)
Uploading: [============================================================] 100% Done...

INFO Upload took 13.82 seconds, waiting for result...
INFO OTA successful
INFO Successfully uploaded program.
INFO Starting log output from 192.168.3.9 using esphome API
INFO Successfully connected to muse-luxe @ 192.168.3.9 in 15.392s
INFO Successful handshake with muse-luxe @ 192.168.3.9 in 0.157s
[20:41:42][D][voice_assistant:124]: microphone not running
[20:41:42][D][voice_assistant:206]: Requesting start...
[20:41:42][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:42][I][app:102]: ESPHome version 2023.12.5 compiled on Jan  4 2024, 20:40:54
[20:41:42][C][wifi:573]: WiFi:
[20:41:42][C][wifi:405]:   Local MAC:  [redacted]
[20:41:42][C][wifi:410]:   SSID: [redacted]
[20:41:42][C][wifi:411]:   IP Address:   [redacted]
[20:41:42][C][wifi:413]:   BSSID: [redacted]
[20:41:42][C][wifi:414]:   Hostname: 'muse-luxe'
[20:41:42][C][wifi:416]:   Signal strength: -69 dB ▂▄▆█
[20:41:42][C][wifi:420]:   Channel: 1
[20:41:42][C][wifi:421]:   Subnet: 255.255.255.0
[20:41:42][C][wifi:422]:   Gateway: 192.168.3.1
[20:41:42][C][wifi:423]:   DNS1: 192.168.3.1
[20:41:42][C][wifi:424]:   DNS2: 0.0.0.0
[20:41:42][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:42][D][light:051]:   Brightness: 100%
[20:41:42][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:42][D][voice_assistant:529]: Event Type: 1
[20:41:42][D][voice_assistant:532]: Assist Pipeline running
[20:41:42][D][voice_assistant:124]: microphone not running
[20:41:42][C][logger:443]: Logger:
[20:41:42][C][logger:444]:   Level: DEBUG
[20:41:42][C][logger:445]:   Log Baud Rate: 115200
[20:41:42][C][logger:447]:   Hardware UART: UART0
[20:41:42][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:42][D][light:051]:   Brightness: 100%
[20:41:42][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:42][D][voice_assistant:529]: Event Type: 9
[20:41:42][D][voice_assistant:124]: microphone not running
[20:41:42][C][i2c.arduino:053]: I2C Bus:
[20:41:42][C][i2c.arduino:054]:   SDA Pin: GPIO18
[20:41:42][C][i2c.arduino:055]:   SCL Pin: GPIO23
[20:41:42][C][i2c.arduino:056]:   Frequency: 50000 Hz
[20:41:42][C][i2c.arduino:059]:   Recovery: bus successfully recovered
[20:41:42][I][i2c.arduino:069]: Results from i2c bus scan:
[20:41:42][I][i2c.arduino:075]: Found i2c device at address 0x10
[20:41:42][D][voice_assistant:529]: Event Type: 0
[20:41:42][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:42][D][voice_assistant:522]: Signaling stop...
[20:41:42][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:42][D][voice_assistant:428]: Desired state set to IDLE
[20:41:42][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:42][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:42][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][voice_assistant:529]: Event Type: 2
[20:41:43][D][voice_assistant:619]: Assist Pipeline ended
[20:41:43][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:43][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:43][C][gpio.output:010]: GPIO Binary Output:
[20:41:43][C][gpio.output:011]:   Pin: GPIO21
[20:41:43][C][gpio.output:012]:   Inverted: YES
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:206]: Requesting start...
[20:41:43][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:43][C][template.sensor:022]: Template Sensor 'Battery'
[20:41:43][C][template.sensor:022]:   Device Class: 'battery'
[20:41:43][C][template.sensor:022]:   State Class: 'measurement'
[20:41:43][C][template.sensor:022]:   Unit of Measurement: '%'
[20:41:43][C][template.sensor:022]:   Accuracy Decimals: 0
[20:41:43][C][template.sensor:023]:   Update Interval: 15.0s
[20:41:43][D][voice_assistant:529]: Event Type: 1
[20:41:43][D][voice_assistant:532]: Assist Pipeline running
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][C][gpio.binary_sensor:015]: GPIO Binary Sensor 'Volume Up'
[20:41:43][C][gpio.binary_sensor:016]:   Pin: GPIO19
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:529]: Event Type: 9
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][C][gpio.binary_sensor:015]: GPIO Binary Sensor 'Volume Down'
[20:41:43][C][gpio.binary_sensor:016]:   Pin: GPIO32
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:529]: Event Type: 0
[20:41:43][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:43][D][voice_assistant:428]: Desired state set to IDLE
[20:41:43][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:43][C][esp32_rmt_led_strip:171]: ESP32 RMT LED Strip:
[20:41:43][C][esp32_rmt_led_strip:172]:   Pin: 22
[20:41:43][C][esp32_rmt_led_strip:173]:   Channel: 0
[20:41:43][C][esp32_rmt_led_strip:198]:   RGB Order: GRB
[20:41:43][C][esp32_rmt_led_strip:199]:   Max refresh rate: 0
[20:41:43][C][esp32_rmt_led_strip:200]:   Number of LEDs: 1
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][voice_assistant:529]: Event Type: 2
[20:41:43][D][voice_assistant:619]: Assist Pipeline ended
[20:41:43][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:43][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:206]: Requesting start...
[20:41:43][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:529]: Event Type: 1
[20:41:43][D][voice_assistant:532]: Assist Pipeline running
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:529]: Event Type: 9
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][C][gpio.binary_sensor:015]: GPIO Binary Sensor 'Action'
[20:41:43][C][gpio.binary_sensor:016]:   Pin: GPIO12
[20:41:43][D][voice_assistant:529]: Event Type: 0
[20:41:43][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:43][D][voice_assistant:428]: Desired state set to IDLE
[20:41:43][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][voice_assistant:529]: Event Type: 2
[20:41:43][D][voice_assistant:619]: Assist Pipeline ended
[20:41:43][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:43][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:43][C][light:103]: Light 'RaspiAudio Muse Luxe'
[20:41:43][C][light:105]:   Default Transition Length: 0.0s
[20:41:43][C][light:106]:   Gamma Correct: 2.80
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:206]: Requesting start...
[20:41:43][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:43][C][template.switch:068]: Template Switch 'Use Wake Word'
[20:41:43][C][template.switch:091]:   Restore Mode: restore defaults to ON
[20:41:43][C][template.switch:057]:   Optimistic: YES
[20:41:43][D][voice_assistant:529]: Event Type: 1
[20:41:43][D][voice_assistant:532]: Assist Pipeline running
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:529]: Event Type: 9
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:529]: Event Type: 0
[20:41:43][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:43][D][voice_assistant:428]: Desired state set to IDLE
[20:41:43][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][voice_assistant:529]: Event Type: 2
[20:41:43][D][voice_assistant:619]: Assist Pipeline ended
[20:41:43][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:43][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:206]: Requesting start...
[20:41:43][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:43][C][adc:097]: ADC Sensor 'Battery voltage'
[20:41:43][C][adc:097]:   Device Class: 'voltage'
[20:41:43][C][adc:097]:   State Class: 'measurement'
[20:41:43][C][adc:097]:   Unit of Measurement: 'V'
[20:41:43][C][adc:097]:   Accuracy Decimals: 2
[20:41:43][C][adc:107]:   Pin: GPIO33
[20:41:43][C][adc:109]:  Attenuation: auto
[20:41:43][C][adc:142]:   Update Interval: 15.0s
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:529]: Event Type: 1
[20:41:43][D][voice_assistant:532]: Assist Pipeline running
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:529]: Event Type: 9
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:529]: Event Type: 0
[20:41:43][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:43][D][voice_assistant:428]: Desired state set to IDLE
[20:41:43][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][voice_assistant:529]: Event Type: 2
[20:41:43][D][voice_assistant:619]: Assist Pipeline ended
[20:41:43][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:43][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:206]: Requesting start...
[20:41:43][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:43][D][voice_assistant:529]: Event Type: 1
[20:41:43][D][voice_assistant:532]: Assist Pipeline running
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][C][captive_portal:088]: Captive Portal:
[20:41:43][D][voice_assistant:529]: Event Type: 9
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][C][mdns:115]: mDNS:
[20:41:43][C][mdns:116]:   Hostname: muse-luxe
[20:41:43][D][voice_assistant:529]: Event Type: 0
[20:41:43][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:43][D][voice_assistant:428]: Desired state set to IDLE
[20:41:43][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:43][C][ota:097]: Over-The-Air Updates:
[20:41:43][C][ota:098]:   Address: muse-luxe.local:3232
[20:41:43][C][ota:101]:   Using Password.
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][C][api:139]: API Server:
[20:41:44][C][api:140]:   Address: muse-luxe.local:6053
[20:41:44][C][api:142]:   Using noise encryption: YES
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][C][improv_serial:032]: Improv Serial:
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][C][audio:203]: Audio:
[20:41:44][C][audio:225]:   External DAC channels: 2
[20:41:44][C][audio:226]:   I2S DOUT Pin: 26
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:45][D][voice_assistant:529]: Event Type: 2
[20:41:45][D][voice_assistant:619]: Assist Pipeline ended
[20:41:45][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:45][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:45][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:45][D][light:051]:   Brightness: 100%
[20:41:45][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:45][D][voice_assistant:522]: Signaling stop...
[20:41:45][D][voice_assistant:124]: microphone not running
[20:41:45][D][voice_assistant:206]: Requesting start...
[20:41:45][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:45][D][voice_assistant:529]: Event Type: 1
[20:41:45][D][voice_assistant:532]: Assist Pipeline running
[20:41:45][D][voice_assistant:124]: microphone not running
[20:41:45][D][voice_assistant:529]: Event Type: 9
[20:41:45][D][voice_assistant:124]: microphone not running
[20:41:45][D][voice_assistant:529]: Event Type: 0
[20:41:45][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:45][D][voice_assistant:522]: Signaling stop...
[20:41:45][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:45][D][voice_assistant:428]: Desired state set to IDLE
[20:41:45][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE

Hi, for the first time I have tested Voice Assistant with the Muse Luxe.
The experimentation is fun : it was my first update of Home Assistant since one year and my first experience with Voice Assistant and my first long use of the Muse Luxe :sweat_smile: . But to be honest it’s more a disappointment from Home Assistant to Muse Luxe.

First of all : don’t expect the same result as Google Home / Nest Mini. A second hand Google Home still the best value and the most reliable microphone that you can have to drive Home Assistant (from very very far).

But we all know that experimentation can also be fun, you can customize your Muse Luxe / Voice Assistant with funny stuffs (like ChatGPT) and, when it works, the reaction time of Voice Assistant is impressive.

So I’m sharing a few observations:

On Voice Assistant part :
The ChatGPT stuff is interesting because Google Nest is able to mention something written on a website but not able to create an customized answer to a question. However it seems that ChatGPT API is not free : which means that you have to pay to benefit of this feature. (let remind that the voice chat feature feature is free if you use ChatGPT app on your smartphone…).

The default Home Assistant speech recognition (Whisper STT) is clearly bad. At least in French. Using a good microphone on a computer with Voice Assistant debugger (which probably offer a better voice sample than an ESP32) shows that it’s not possible to use Whisper in french : it would require to rename all your devices with very simple one word names, and even like that you will achieve what you want only time to time. If at least the “brain” (= Conversation Agent) of Voice Assistant was trying to find by itself a device which has a similar pronunciation it could be interesting but for now it doesn’t do that at all (it seems that some already have this idea in mind) and you’ll here the sentence “Sorry I don’t know this device” a lot of time.
With Whisper, compared to the speech recognition from Google, Azure or ChatGPT you’ll be very lucky if it understand what you’ve said. To compare on Windows and test Azure speech recognition press “Windows Key + H” and speak in your microphone.

Fortunately I’ve found this reddit post to use Azure speech recognition and Text to speech with Voice Assistant and it changes everything ! Once installed (which requires some courage to find in Azure how to create an API key) Voice Assistant start to really work with French language. For now Azure offer a free plan for their TTS/STT which should be enough for a “normal” daily use.

More about the Muse Luxe itself some disappointment too : my battery has very short life but my biggest problem is that the solder of the micro-usb port has bad contacts (it doesn’t help to flash it !).

If you use the pre-compiled firmware from raspiaudio.github.io , you will not see the device in the ESPhome web interface which is a shame because you can’t easily see the debug log from here and you can’t customize the configuration. However you can create it after in ESPhome and it will not create a duplicated one.

When you use it with Voice Assistant : after a TTS play, once the led is ON to show that it is waiting for the wake-word, you still have to wait few additional seconds before trying to use the wake-word again (it’s a little too long).

I don’t know why but it seems that the media player doesn’t work with this firmware : if you send any audio track from Home Assistant, you’ll have to reboot the the Muse Luxe to have sound again. More annoying sometime I also lost sound without reason which requires a reboot of the ESP32 to work again (it seems that sometime setting the volume level again can make it work again).

I hope that it will help some of you in their investigations on Voice Assistant with Muse Luxe :wink:

Yeah this is rather disappointing.

Flashing was easy, adding the suggested voice assistant config from above to Tetele’s yaml was easy.

First try, it recognised my custom wake word from about 1m away and executed the command to turn off my Yamaha media player.

Tried a different command (turn on the lounge room lights) it woke with the wake word then I got a blue light and nothing. No further response from the device.

I tried power cycling it and it would not rejoin the network.

So I’ve gone back to using the squeezelite software. That’s been 100% reliable for TTS announcements for over a year. Voice control still seems immature at best and a gimmick at worst.

1 Like

working well with both Wakeword/VA and Media Player, but to get media player to work, I have to toggle off the wake word.

any suggestions? I’ve loaded most recent code.

ESPHome doesn’t support both playback and listening on the same I2S bus simultaneously. You have to turn off wake word listening to use the media_player.

1 Like

I set use_wake_word: false but any media is only played when pressing the action button.

I don’t believe ESPhome doesn’t support both playback and listening on the same I2S bus simultaneously. Why does ESPHome work with M5Stack Atom Echo?

I solved my issue. I sold the Muse Luxe. At the moment it causes more problems than solutions. Crackling sound, not be able to use it as playback and listening… Maybe one day will work correctly but at the moment is not.

1 Like

:laughing: may i ask what your beliefs are based on? Mine are based on some Discord messages from the founder of ESPHome, but I’m willing to change my mind if your arguments are stronger.

I don’t understand the question: doesn’t it work the same way with the Luxe? What can you do on an M5Stack Atom Echo and you can’t do on a Luxe?

Hi there,
for anyone who does not want to read forums the whole week or does not want to rip apart the espHome template and putting it back together hoping there is some bug you can fix that has not come up yet, because the muse luxe speaker does not at all respond to your wake word, maybe this post helps you out.

Its ‘OK nabu’ not ‘Hey nabu’.

Thanks to all the developers on that project. Local voice assistance is awesome!
Cheers.

Hello, we’ve developed a new component for Muse Luxe, incorporating optimized codec values to enhance microphone voice command detection. In a straightforward benchmark, I achieved a 100% recognition rate (3 out of 3) using the Whisper Small model at a 3-meter distance, compared to a 33% rate (1 out of 3) with the previous component.

To test this new component, please replace the existing component lines with the ones below:

external_components:
  - source: github://RASPIAUDIO/esphomeLuxe@main
    components: [es8388]
    refresh: 0s

I recommend @tetele’s YAML here, and I thank him for testing the early version and using his YAML.

I’ve updated my config to include your new component. Thanks for this!

1 Like

By the way, do you plan to release a new Hardware, a kind of combo between the Muse deluxe with a ESP32 S3 Box 3 ? To enjoy all new features of the MWW, VA provided by recent ESPhome framework ?

short answer: YES
It’s a new product we are working on for the pas 6 months and it is almost ready, stay tuned it’s going to be a great and beautiful product :smiley:

haha I was sure about it … I stay tuned… Any approximative release date ?

in max 1 month for beta tester

2 Likes