Gratitude for asking them to fully surrender to Putin’s wishes??

Thank you so much!! I have been putting it off because what I have works but a time will soon come when I’ll want to test new models.

I’m looking for a server but not many parallel calls because I would like to use as much context as I can. When making space for e.g. 4 threads, the context is split and thus 4x as small. With llama 3.1 8b I managed to get 47104 context on the 16GB card (though actually using that much is pretty slow). That’s with KV quant to 8b too. But sometimes I just need that much.

I’ve never tried the llama.cpp directly, thanks for the tip!

Kobold sounds good too but I have some scripts talking to it directly. I’ll read up on that too see if it can do that. I don’t have time now but I’ll do it in the coming days. Thank you!

I don’t think that’s a problem. I live in Spain and speak Spanish daily with real people, many of them my friends. They’ll correct me if needed, they often do. Though most are my own mistakes.

Don’t forget people give wrong answers too. But people aren’t available 24/7 to help me.

Agreed. The way they just dumped support for my card in some update with some vague reason also irked me (we need a newer rocm they said but my card works fine with all current rocm versions)

Also the way they’re now trying to sell cloud AI means their original local service is in competition to the product they sell.

I’m looking to use something new but I don’t know what yet.

I have one server with a cheap MI50 instinct. Those come for really cheap on eBay. And it’s got really good memory bandwidth with HBM2. They worked ok with ollama until recently when they dropped support for some weird reason but a lot of other software still works fine. Also older models work fine on old ollama.

The other one runs an RTX 3060 12GB. I use this for models that only work on nvidia like whisper speech recognition.

I tend to use the same models for everything so I don’t have the delay of loading the model. Mainly uncensored ones so it doesn’t choke when someone says something slightly sexual. I’m in some very open communities so standard models are pretty useless with all their prudeness.

For frontend i use OpenWebUI and i also run stuff directly against the models like scripts.

I mainly use it for Spanish which I have a basic proficiency in. It just accompanies me on my learning journey. It may be wrong sometime but not often. Like the other reply said, LLMs are good at languages, it’s what they were originally designed for until people found out they could do more (but not quite as well).

And as for filtering, I just use it as a news feed sanitizer with a whole bunch of rules. It will miss things sometimes but it’s also my ruleset that’s not perfect. I often come across the unfiltered sources anyway and even if it misses something, it’s only news. Nothing really important to me.

I work with AI and use it personally, but I have my own servers running local models which solves tons of privacy concerns. The inaccuracy is another problem but not a big one for me as I know it and will simply fact check. Also, I don’t really use it for knowledge anyway. Just to filter news to my interest, help with summaries and translation etc.

People use AI as some all-knowing oracle but an LLM is not meant for that at all.

I think they were kinda right about globalism. Though it’s not in the form of a secret organisation meeting in a big dark Dr Evil lair. They don’t have to meet because their goals are the same. Make as much money as they can, ideally not off each other but off the little guy. Though sometimes there’s a bit of a fight between them, they are mostly aligned.

But the end result is really globalism and it has given large corporations way too much power.

Well yeah, obviously. It clearly didn’t come from anyone with any medical knowledge.

Yeah 4% is big enough to get on Google’s radar as a threat. Especially if it’s trending upwards.

This is more than just a few tinfoil hats now.

And yes they’re working on locking bootloaders and also making AOSP less useful

Give them away? Not really, Samsung S series are the same pricing as pixels here where I live. The pixel a is different of course, it’s more like a Samsung FE.

It’s not, it’s easier to visualise one person out of a group of 25 than it is 4 out of a group of 100.

I understand. I wasn’t aware of that. I don’t think those problems were around when I was there, or at least not as severely. And yes the nature is amazing. I’d go there on holiday all the time if it wasn’t 24 hours actual flight time 😭

When I was in NZ it was a fabulous country with really friendly people. Even the cops.

But this was 20 years ago. Though it sounds like it was a great place under Jacinta too.

Unfortunately the EU is sucking up to Trump nonstop. Now weakening the GDPR for example, and promising billions of investment while receiving nothing in return but a weak promise that there will be no further tariffs.

I know, but at least they are making a case which most news outlets probably would but don’t have the means for a long legal fight. They might get some precedent out of this from which the whole news industry will benefit.

I don’t think AI training should ever be fair use. These companies are making billions of other people’s work and giving nothing back.

True but we were talking about Google here that’s why I mentioned Gmail. But yes with Microsoft it’s the same. And together they control most of the email accounts in the world.

Yes they are changing gdpr so that training AI on user data becomes “legitimate use” and won’t need opt in approval (though there may or may not be an opt out(

https://noyb.eu/en/digital-omnibus-eu-commission-wants-wreck-core-gdpr-principles

Also many other principles are being removed. It’s basically a surrender to Trump and his big tech buddies

Well yeah but then the mails your receive from Gmail users or the ones you send to are still captured unless they have opted out. Which you can’t see without asking.

And the EU is dropping its protection against unwanted AI training 🤬🤬🤬