Muse Luxe voice assistant now possible?

[zephirus]

I also tried English, with the same results and as I said before, I can’t even play any media.

[zephirus]

Yesterday I sent a message to the vendor (I bought the Muse Luxe @Amazon) to activate the warranty. I received a message today saying this:

Hello, have you tried to load the default Bluetooth app using our apps stores? Go on Raspiaudio web site then espmuse apps store.
Sélect Luxe-Bluetooth
Then tell me if this works for you

I did that and I have the Muse Luxe working perfectly as a bluetooth speaker. So, in fact it plays audio, only doesn’t play when I install the firmware to use as Voice Assistant.

Is this of any help? I’m more confused now…

[Raspiaudio]

I had the same issue in my HA running at my home, clicking on/off the “use wake word” button unblock the sound

[zephirus]

That’s another issue I have. Sometimes, after using wake word for the first time, the next one’s are not detected. I have to toggle that. Anyway, no sound output again.

[zephirus]

Also, I’m using HA as a VM in proxmox but I also tried as a Container and also standalone in a Raspberry Pi

[Raspiaudio]

We have tried it on 2 different VM with virtualbox recommanded settings and on Rpi4 with success. I have a vague souvenir that some time ago a user reported the no sound issue and it was related to a network configuration.

Check this

ESP Muse proto: no audio [under investigation]

To conclude the various tests check this table: [image] The test was performed with Google TTS, mp3 and wav files from 3 sources to 3 destinations. V indicates successful, X marks failure. BTW: surprise, the blue LED is now spontaneously not flashing anymore, but constant on. Regards OWK

[zephirus]

I just asked to turn off some lights (in portuguese: Desliga as luzes da entrada.) and I get this:

tts:
  engine: cloud
  language: pt-PT
  voice: RaquelNeural
  tts_input: luzes da entrada desligado
  done: false

[zephirus]

It started working out of the blue. My HA url is using DuckDNS and I think it’s related with my issue. I removed the port forwarding in my router but then I couldn’t access HA, but after some changes I know can get the audio of the Voice Assistant. The settings are exactly the same anyway so… I don’t get it.

I sill can’t play an mp3 or radio in the Media section and in the logs the url to the media is pointing to the duckdns url so, in this case I think it’s because of that.

[Raspiaudio]

@zephirus It seems to be a very specific issue not exactly related to this topic, my advice is to try DLNA media streaming as explained in the link I gave you, if this works that way it will would confirm that it is related to network. I would encourage you to ask help to HA experts thru their forum or discourse.

[Raspiaudio]

Adding these 3 lines to Tetele’s yaml improves a bit pickup distance, I can call “Hey Jarvis” at 3-4m form the Luxe and ask some questions to Chatgpt without issue:

noise_suppression_level: 2
auto_gain: 31dBFS
volume_multiplier: 2.0

I will soon post a video about ChatGPT intergration + Luxe

[debrich]

Thanks for the new information as I’ve found the the mic on the luxe needed fine tuning in the yaml file.
also you made a good point that the “wake word” switch needs to be toggled after every command.
maybe this is something that could be edited in the yaml file also.?

also could you place a link to the correct yaml file that Tetele wrote? just for clarity…cheers!

[zephirus]

With the new way to flash this without the need to have ESP Home in HA, how can I change those values?

[Raspiaudio]

@debrich

the new information as I’ve found the the mic on the luxe needed fine tuning in the yaml file.
also you made a good point that the “wake word” switch needs to be toggled after eve

Hi,

Tetele’s yaml is working fine without modification, adding these 3 line improves a bit the listening perfrmances.

The toggle on my side was only one time, not at every command.

[Raspiaudio]

you can’t I think, you need to use the method where you add the device thru ESPhome

[debrich]

Sadly my luxe stops responding after the first command…also I don’t hear a response from the unit afterwards?..but if I toggle the wake word slider off/on again I hear the speaker working and the light (flashing) responding again…

[Raspiaudio]

ChatGPT as a Voice Assistant in Home Assistant using ESP Muse Luxe speakers

New tutorial how to setup Chatgpt as a conversation adgent

[SnuguruMaestro]

I’ve noticed a weird issue.

I reflashed the muse using esphome with Tetele’s yaml and the modifications so I could tweak them.

After I flashed it, it went into a really short loop (this log is about 3 seconds) and it only stopped after turning it off and on again.

Compiling .pioenvs/muse-luxe/src/main.cpp.o
Linking .pioenvs/muse-luxe/firmware.elf
RAM:   [=         ]  13.5% (used 44132 bytes from 327680 bytes)
Flash: [=======   ]  72.4% (used 1328405 bytes from 1835008 bytes)
Building .pioenvs/muse-luxe/firmware.bin
Creating esp32 image...
Successfully created esp32 image.
esp32_create_combined_bin([".pioenvs/muse-luxe/firmware.bin"], [".pioenvs/muse-luxe/firmware.elf"])
Wrote 0x155ba0 bytes to file /data/build/muse-luxe/.pioenvs/muse-luxe/firmware-factory.bin, ready to flash to offset 0x0
========================= [SUCCESS] Took 18.89 seconds =========================
INFO Successfully compiled program.
INFO Connecting to 192.168.3.9
INFO Uploading /data/build/muse-luxe/.pioenvs/muse-luxe/firmware.bin (1334176 bytes)
Uploading: [============================================================] 100% Done...

INFO Upload took 13.82 seconds, waiting for result...
INFO OTA successful
INFO Successfully uploaded program.
INFO Starting log output from 192.168.3.9 using esphome API
INFO Successfully connected to muse-luxe @ 192.168.3.9 in 15.392s
INFO Successful handshake with muse-luxe @ 192.168.3.9 in 0.157s
[20:41:42][D][voice_assistant:124]: microphone not running
[20:41:42][D][voice_assistant:206]: Requesting start...
[20:41:42][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:42][I][app:102]: ESPHome version 2023.12.5 compiled on Jan  4 2024, 20:40:54
[20:41:42][C][wifi:573]: WiFi:
[20:41:42][C][wifi:405]:   Local MAC:  [redacted]
[20:41:42][C][wifi:410]:   SSID: [redacted]
[20:41:42][C][wifi:411]:   IP Address:   [redacted]
[20:41:42][C][wifi:413]:   BSSID: [redacted]
[20:41:42][C][wifi:414]:   Hostname: 'muse-luxe'
[20:41:42][C][wifi:416]:   Signal strength: -69 dB ▂▄▆█
[20:41:42][C][wifi:420]:   Channel: 1
[20:41:42][C][wifi:421]:   Subnet: 255.255.255.0
[20:41:42][C][wifi:422]:   Gateway: 192.168.3.1
[20:41:42][C][wifi:423]:   DNS1: 192.168.3.1
[20:41:42][C][wifi:424]:   DNS2: 0.0.0.0
[20:41:42][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:42][D][light:051]:   Brightness: 100%
[20:41:42][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:42][D][voice_assistant:529]: Event Type: 1
[20:41:42][D][voice_assistant:532]: Assist Pipeline running
[20:41:42][D][voice_assistant:124]: microphone not running
[20:41:42][C][logger:443]: Logger:
[20:41:42][C][logger:444]:   Level: DEBUG
[20:41:42][C][logger:445]:   Log Baud Rate: 115200
[20:41:42][C][logger:447]:   Hardware UART: UART0
[20:41:42][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:42][D][light:051]:   Brightness: 100%
[20:41:42][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:42][D][voice_assistant:529]: Event Type: 9
[20:41:42][D][voice_assistant:124]: microphone not running
[20:41:42][C][i2c.arduino:053]: I2C Bus:
[20:41:42][C][i2c.arduino:054]:   SDA Pin: GPIO18
[20:41:42][C][i2c.arduino:055]:   SCL Pin: GPIO23
[20:41:42][C][i2c.arduino:056]:   Frequency: 50000 Hz
[20:41:42][C][i2c.arduino:059]:   Recovery: bus successfully recovered
[20:41:42][I][i2c.arduino:069]: Results from i2c bus scan:
[20:41:42][I][i2c.arduino:075]: Found i2c device at address 0x10
[20:41:42][D][voice_assistant:529]: Event Type: 0
[20:41:42][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:42][D][voice_assistant:522]: Signaling stop...
[20:41:42][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:42][D][voice_assistant:428]: Desired state set to IDLE
[20:41:42][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:42][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:42][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][voice_assistant:529]: Event Type: 2
[20:41:43][D][voice_assistant:619]: Assist Pipeline ended
[20:41:43][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:43][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:43][C][gpio.output:010]: GPIO Binary Output:
[20:41:43][C][gpio.output:011]:   Pin: GPIO21
[20:41:43][C][gpio.output:012]:   Inverted: YES
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:206]: Requesting start...
[20:41:43][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:43][C][template.sensor:022]: Template Sensor 'Battery'
[20:41:43][C][template.sensor:022]:   Device Class: 'battery'
[20:41:43][C][template.sensor:022]:   State Class: 'measurement'
[20:41:43][C][template.sensor:022]:   Unit of Measurement: '%'
[20:41:43][C][template.sensor:022]:   Accuracy Decimals: 0
[20:41:43][C][template.sensor:023]:   Update Interval: 15.0s
[20:41:43][D][voice_assistant:529]: Event Type: 1
[20:41:43][D][voice_assistant:532]: Assist Pipeline running
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][C][gpio.binary_sensor:015]: GPIO Binary Sensor 'Volume Up'
[20:41:43][C][gpio.binary_sensor:016]:   Pin: GPIO19
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:529]: Event Type: 9
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][C][gpio.binary_sensor:015]: GPIO Binary Sensor 'Volume Down'
[20:41:43][C][gpio.binary_sensor:016]:   Pin: GPIO32
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:529]: Event Type: 0
[20:41:43][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:43][D][voice_assistant:428]: Desired state set to IDLE
[20:41:43][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:43][C][esp32_rmt_led_strip:171]: ESP32 RMT LED Strip:
[20:41:43][C][esp32_rmt_led_strip:172]:   Pin: 22
[20:41:43][C][esp32_rmt_led_strip:173]:   Channel: 0
[20:41:43][C][esp32_rmt_led_strip:198]:   RGB Order: GRB
[20:41:43][C][esp32_rmt_led_strip:199]:   Max refresh rate: 0
[20:41:43][C][esp32_rmt_led_strip:200]:   Number of LEDs: 1
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][voice_assistant:529]: Event Type: 2
[20:41:43][D][voice_assistant:619]: Assist Pipeline ended
[20:41:43][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:43][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:206]: Requesting start...
[20:41:43][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:529]: Event Type: 1
[20:41:43][D][voice_assistant:532]: Assist Pipeline running
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:529]: Event Type: 9
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][C][gpio.binary_sensor:015]: GPIO Binary Sensor 'Action'
[20:41:43][C][gpio.binary_sensor:016]:   Pin: GPIO12
[20:41:43][D][voice_assistant:529]: Event Type: 0
[20:41:43][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:43][D][voice_assistant:428]: Desired state set to IDLE
[20:41:43][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][voice_assistant:529]: Event Type: 2
[20:41:43][D][voice_assistant:619]: Assist Pipeline ended
[20:41:43][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:43][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:43][C][light:103]: Light 'RaspiAudio Muse Luxe'
[20:41:43][C][light:105]:   Default Transition Length: 0.0s
[20:41:43][C][light:106]:   Gamma Correct: 2.80
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:206]: Requesting start...
[20:41:43][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:43][C][template.switch:068]: Template Switch 'Use Wake Word'
[20:41:43][C][template.switch:091]:   Restore Mode: restore defaults to ON
[20:41:43][C][template.switch:057]:   Optimistic: YES
[20:41:43][D][voice_assistant:529]: Event Type: 1
[20:41:43][D][voice_assistant:532]: Assist Pipeline running
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:529]: Event Type: 9
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:529]: Event Type: 0
[20:41:43][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:43][D][voice_assistant:428]: Desired state set to IDLE
[20:41:43][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][voice_assistant:529]: Event Type: 2
[20:41:43][D][voice_assistant:619]: Assist Pipeline ended
[20:41:43][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:43][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:206]: Requesting start...
[20:41:43][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:43][C][adc:097]: ADC Sensor 'Battery voltage'
[20:41:43][C][adc:097]:   Device Class: 'voltage'
[20:41:43][C][adc:097]:   State Class: 'measurement'
[20:41:43][C][adc:097]:   Unit of Measurement: 'V'
[20:41:43][C][adc:097]:   Accuracy Decimals: 2
[20:41:43][C][adc:107]:   Pin: GPIO33
[20:41:43][C][adc:109]:  Attenuation: auto
[20:41:43][C][adc:142]:   Update Interval: 15.0s
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:529]: Event Type: 1
[20:41:43][D][voice_assistant:532]: Assist Pipeline running
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:529]: Event Type: 9
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:051]:   Brightness: 100%
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:43][D][voice_assistant:529]: Event Type: 0
[20:41:43][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:43][D][voice_assistant:428]: Desired state set to IDLE
[20:41:43][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][voice_assistant:529]: Event Type: 2
[20:41:43][D][voice_assistant:619]: Assist Pipeline ended
[20:41:43][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:43][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][D][voice_assistant:206]: Requesting start...
[20:41:43][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:43][D][voice_assistant:529]: Event Type: 1
[20:41:43][D][voice_assistant:532]: Assist Pipeline running
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][C][captive_portal:088]: Captive Portal:
[20:41:43][D][voice_assistant:529]: Event Type: 9
[20:41:43][D][voice_assistant:124]: microphone not running
[20:41:43][C][mdns:115]: mDNS:
[20:41:43][C][mdns:116]:   Hostname: muse-luxe
[20:41:43][D][voice_assistant:529]: Event Type: 0
[20:41:43][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:43][D][voice_assistant:522]: Signaling stop...
[20:41:43][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:43][D][voice_assistant:428]: Desired state set to IDLE
[20:41:43][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:43][C][ota:097]: Over-The-Air Updates:
[20:41:43][C][ota:098]:   Address: muse-luxe.local:3232
[20:41:43][C][ota:101]:   Using Password.
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:43][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:43][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][C][api:139]: API Server:
[20:41:44][C][api:140]:   Address: muse-luxe.local:6053
[20:41:44][C][api:142]:   Using noise encryption: YES
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][C][improv_serial:032]: Improv Serial:
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][C][audio:203]: Audio:
[20:41:44][C][audio:225]:   External DAC channels: 2
[20:41:44][C][audio:226]:   I2S DOUT Pin: 26
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:44][D][voice_assistant:529]: Event Type: 2
[20:41:44][D][voice_assistant:619]: Assist Pipeline ended
[20:41:44][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:44][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:206]: Requesting start...
[20:41:44][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:44][D][voice_assistant:529]: Event Type: 1
[20:41:44][D][voice_assistant:532]: Assist Pipeline running
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 9
[20:41:44][D][voice_assistant:124]: microphone not running
[20:41:44][D][voice_assistant:529]: Event Type: 0
[20:41:44][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:44][D][voice_assistant:522]: Signaling stop...
[20:41:44][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:44][D][voice_assistant:428]: Desired state set to IDLE
[20:41:44][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:051]:   Brightness: 100%
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:44][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:44][D][light:059]:   Red: 100%, Green: 0%, Blue: 0%
[20:41:45][D][voice_assistant:529]: Event Type: 2
[20:41:45][D][voice_assistant:619]: Assist Pipeline ended
[20:41:45][D][voice_assistant:422]: State changed from IDLE to START_PIPELINE
[20:41:45][D][voice_assistant:428]: Desired state set to START_MICROPHONE
[20:41:45][D][light:036]: 'RaspiAudio Muse Luxe' Setting:
[20:41:45][D][light:051]:   Brightness: 100%
[20:41:45][D][light:059]:   Red: 100%, Green: 0%, Blue: 100%
[20:41:45][D][voice_assistant:522]: Signaling stop...
[20:41:45][D][voice_assistant:124]: microphone not running
[20:41:45][D][voice_assistant:206]: Requesting start...
[20:41:45][D][voice_assistant:422]: State changed from START_PIPELINE to STARTING_PIPELINE
[20:41:45][D][voice_assistant:529]: Event Type: 1
[20:41:45][D][voice_assistant:532]: Assist Pipeline running
[20:41:45][D][voice_assistant:124]: microphone not running
[20:41:45][D][voice_assistant:529]: Event Type: 9
[20:41:45][D][voice_assistant:124]: microphone not running
[20:41:45][D][voice_assistant:529]: Event Type: 0
[20:41:45][E][voice_assistant:656]: Error: no_wake_word - No wake word detected
[20:41:45][D][voice_assistant:522]: Signaling stop...
[20:41:45][D][voice_assistant:422]: State changed from STARTING_PIPELINE to STOP_MICROPHONE
[20:41:45][D][voice_assistant:428]: Desired state set to IDLE
[20:41:45][D][voice_assistant:422]: State changed from STOP_MICROPHONE to IDLE

[Schmurtz]

Hi, for the first time I have tested Voice Assistant with the Muse Luxe.
The experimentation is fun : it was my first update of Home Assistant since one year and my first experience with Voice Assistant and my first long use of the Muse Luxe . But to be honest it’s more a disappointment from Home Assistant to Muse Luxe.

First of all : don’t expect the same result as Google Home / Nest Mini. A second hand Google Home still the best value and the most reliable microphone that you can have to drive Home Assistant (from very very far).

But we all know that experimentation can also be fun, you can customize your Muse Luxe / Voice Assistant with funny stuffs (like ChatGPT) and, when it works, the reaction time of Voice Assistant is impressive.

So I’m sharing a few observations:

On Voice Assistant part :
The ChatGPT stuff is interesting because Google Nest is able to mention something written on a website but not able to create an customized answer to a question. However it seems that ChatGPT API is not free : which means that you have to pay to benefit of this feature. (let remind that the voice chat feature feature is free if you use ChatGPT app on your smartphone…).

The default Home Assistant speech recognition (Whisper STT) is clearly bad. At least in French. Using a good microphone on a computer with Voice Assistant debugger (which probably offer a better voice sample than an ESP32) shows that it’s not possible to use Whisper in french : it would require to rename all your devices with very simple one word names, and even like that you will achieve what you want only time to time. If at least the “brain” (= Conversation Agent) of Voice Assistant was trying to find by itself a device which has a similar pronunciation it could be interesting but for now it doesn’t do that at all (it seems that some already have this idea in mind) and you’ll here the sentence “Sorry I don’t know this device” a lot of time.
With Whisper, compared to the speech recognition from Google, Azure or ChatGPT you’ll be very lucky if it understand what you’ve said. To compare on Windows and test Azure speech recognition press “Windows Key + H” and speak in your microphone.

Fortunately I’ve found this reddit post to use Azure speech recognition and Text to speech with Voice Assistant and it changes everything ! Once installed (which requires some courage to find in Azure how to create an API key) Voice Assistant start to really work with French language. For now Azure offer a free plan for their TTS/STT which should be enough for a “normal” daily use.

More about the Muse Luxe itself some disappointment too : my battery has very short life but my biggest problem is that the solder of the micro-usb port has bad contacts (it doesn’t help to flash it !).

If you use the pre-compiled firmware from raspiaudio.github.io , you will not see the device in the ESPhome web interface which is a shame because you can’t easily see the debug log from here and you can’t customize the configuration. However you can create it after in ESPhome and it will not create a duplicated one.

When you use it with Voice Assistant : after a TTS play, once the led is ON to show that it is waiting for the wake-word, you still have to wait few additional seconds before trying to use the wake-word again (it’s a little too long).

I don’t know why but it seems that the media player doesn’t work with this firmware : if you send any audio track from Home Assistant, you’ll have to reboot the the Muse Luxe to have sound again. More annoying sometime I also lost sound without reason which requires a reboot of the ESP32 to work again (it seems that sometime setting the volume level again can make it work again).

I hope that it will help some of you in their investigations on Voice Assistant with Muse Luxe

[Tom_L]

Yeah this is rather disappointing.

Flashing was easy, adding the suggested voice assistant config from above to Tetele’s yaml was easy.

First try, it recognised my custom wake word from about 1m away and executed the command to turn off my Yamaha media player.

Tried a different command (turn on the lounge room lights) it woke with the wake word then I got a blue light and nothing. No further response from the device.

I tried power cycling it and it would not rejoin the network.

So I’ve gone back to using the squeezelite software. That’s been 100% reliable for TTS announcements for over a year. Voice control still seems immature at best and a gimmick at worst.

[momoz]

working well with both Wakeword/VA and Media Player, but to get media player to work, I have to toggle off the wake word.

any suggestions? I’ve loaded most recent code.