- 7 Posts
- 446 Comments
smiletolerantly@awful.systemsOPto Selfhosted@lemmy.world•Intent recognition for HomeAssistant without an LLM?English41·1 day agoPlease read the title of the post again. I do not want to use an LLM. Selfhosted is bad enough, but feeding my data to OpenAI is worse.
smiletolerantly@awful.systemsOPto Selfhosted@lemmy.world•Intent recognition for HomeAssistant without an LLM?English9·2 days agoYep, that’s the idea! This post basically boils down to “does this exist for HASS already, or do I need to implement it?” and the answer, unfortunately, seems to be the latter.
smiletolerantly@awful.systemsOPto Selfhosted@lemmy.world•Intent recognition for HomeAssistant without an LLM?English3·2 days agoThanks, had not heard of this before! From skimming the link, it seems that the integration with HASS mostly focuses on providing wyoming endpoints (STT, TTS, wakeword), right? (Un)fortunately, that’s the part that’s already working really well 😄
However, the idea of just writing a stand-alone application with Ollama-compatible endpoints, but not actually putting an LLM behind it is genius, I had not thought about that. That could really simplify stuff if I decide to write a custom intent handler. So, yeah, thanks for the link!!
smiletolerantly@awful.systemsOPto Selfhosted@lemmy.world•Intent recognition for HomeAssistant without an LLM?English61·2 days agoThanks for your input! The problem with the LLM approach for me is mostly that I have so many entities, HASS exposing them all (or even the subset of those I really, really want) is already big enough to slow everything to a crawl, and to get bad results from all models I’ve tried. I’ll give the model you mentioned another shot though.
However, I really don’t want to use an LLM for this. It seems brittle and like overkill at the same time. As you said, intent classification is a wee bit older than LLMs.
Unfortunately, the sentence template matching approach alone isn’t sufficient, because quite frequently, the STT is imperfect. With HomeAssistant, currently the intent “turn off all lights” is, for example, not understood if STT produces “turn off all light”. And sure, you can extend the template for that. But what about
- turn of all lights
- turn off wall lights
- turnip off all lights
- off all lights
- off all fights
- …
A human would go “huh? oh, sure, I’ll turn off all lights”. An LLM might as well. But a fuzzy matching / closest Levensthein distance approach should be more than sufficient for this, too.
Basically, I generally like the sentence template approach used by HASS, but it just needs that little bit of additional robustness against imperfections.
smiletolerantly@awful.systemsOPto Selfhosted@lemmy.world•Intent recognition for HomeAssistant without an LLM?English5·2 days agoThanks for sharing your experience! I have actually mostly been testing with a good desk mic, and expect recognition to get worse with room mics… The hardware I bought are seeed ReSpeaker mic arrays, I am somewhat hopeful about them.
Adding a lot of alternative sentences does indeed help, at least to a certain degree. However, my issue is less with “it should recognize various different commands for the same action”, and more “if I mumble, misspeak, or add a swear word on my third attempt, it should still just pick the most likely intent”, and that’s what’s currently missing from the ecosystem, as far as I can tell.
Though I must conceit, copying your strategy might be a viable stop-gap solution to get rid of Alexa. I’ll have to pay around with it a bit more.
That all said, if you find a better intent matcher or another solution, please do report back as I am very interested in an easier solution that does not require me to think of all possible sentence ahead of time.
Roger.
smiletolerantly@awful.systemsOPto Selfhosted@lemmy.world•Intent recognition for HomeAssistant without an LLM?English3·2 days agoNever heard about willow before - is it this one? Seems there is still recent activity in the repo - did the creator only recently pass away? Or did someone continue the project?
How’s your experience been with it?
And sure, will do!
smiletolerantly@awful.systemsto Technology@lemmy.world•I went to an anti-tech rally, where Gen Z dressed as gnomes and smashed iPhones. Here's what I learned. | Business InsiderEnglish2·3 days agoThat is actually a really interesting approach to moderation, huh.
Yeah. Back left is the only burned in the right size for my pasta pot. Back right is a copy of front left and thus uniquely useless.
Actually… From a data-loss POV, it’s actually pretty much fine; since the server only serves an e2ee file anyways, each end device’s data is sufficient to recover everything.
I.e. if you host Vaultwarden, log into it on your mobile device, save all your logins; then fuck up the server, it doesn’t matter, because your mobile device not only still has everything, but also does not need a server connection to export everything in a way that can then be imported again on a new server installation.
Yeah but why would I make myself dependent on Cloudflare.
To be fair, you can simply selfhost MinIO.
smiletolerantly@awful.systemsOPto Asklemmy@lemmy.ml•What one book or piece of literature would adapt into a movie/TV series if given the funding and full creative control? Why?1·8 days agoWait, not the other way round? One tale per 70-min episode?
(With the priest’s tale getting an initial 1.5hrs opening episode? 👀)
smiletolerantly@awful.systemsto Privacy@lemmy.ml•Encrypt your Linux with LUKS, like seriously.1·8 days agoAnd what is the advantage of that?
smiletolerantly@awful.systemsto Privacy@lemmy.ml•Encrypt your Linux with LUKS, like seriously.3·8 days agoAlso I am pretty sure I have at least some secrets in my shell history
smiletolerantly@awful.systemsOPto Asklemmy@lemmy.ml•What one book or piece of literature would adapt into a movie/TV series if given the funding and full creative control? Why?1·9 days agoHah… Fair 😄 Hope you’ll get the chance!
smiletolerantly@awful.systemsOPto Asklemmy@lemmy.ml•What one book or piece of literature would adapt into a movie/TV series if given the funding and full creative control? Why?3·9 days agoInteresting - this is the first time I have seem someone (implicitly) dislike Villeneuve’s version (though to be fair, I have not closely followed the discourse around it). DO you have additional grievances, beyond the actors?
smiletolerantly@awful.systemsOPto Asklemmy@lemmy.ml•What one book or piece of literature would adapt into a movie/TV series if given the funding and full creative control? Why?4·9 days agoFor myself: Dan Simmons’ Hyperion Cantos. I know that I will never be in a situation to do as the question above suggests (nor that I would have the knowledge or skills required), but I am currently re-reading the books (Hyperion, Fall of Hyperion, Endymion, Rise of Endymion), and I can’t stop thinking about a big screen adaptation.
Or rather, Simmons’ writing is so vivid, so vibrant that you can’t help but visualize it in a cinematic way before your inner eye anyways. The alien, but still somewhat familiar environments, the gargantuan forces of nature and expansive backgrounds just as much as the more intimate set pieces, cities, secret meeting rooms, and so on. “Every Frame a Painting” is something I’ve heard said about some movies, and these books are the textual equivalent: “Every page cannot be helped but be turned into a Painting”. The Hyperion Cantos isn’t even my favorite book or anything the like; it’s just something that screams for an adaptation IMO, and a beautiful one at that.
I also think that the story is exceptionally well suited for either a limited series (Hyperion & Fall of Hyperion) or a movie (Endymion, Rise of Endymion). In fact, I am convinced that if this had been made into a series back in the early/mid 2010s, it could have had a genre- and generation-defining impact akin to (the early seasons of…) Game of Thrones. Today… I’m not sure a studio would spend the required amount of money to make this good.
(Also yes I made this post simply because I had nowhere else to put this comment.)
smiletolerantly@awful.systemsto Selfhosted@lemmy.world•What's the best chat to self host?English5·9 days agoLol, exact same situation here.
Quick question, did the migration to continuwuity break calls for you as well?
Ah, thanks for mentioning. Yep, they have a docker image; as mentioned, a nixpkg will be available soonTM; and frankly, you can just build / download the release artifacts and put them on any static host.