• 0 Posts
  • 20 Comments
Joined 4 years ago
cake
Cake day: July 8th, 2020

help-circle

  • It models only use of language

    This phrase, so casually deployed, is doing some seriously heavy lifting. Lanuage is by no means a trivial thing for a computer to meaningfully interpret, and the fact that LLMs do it so well is way more impressive than a casual observer might think.

    If you look at earlier procedural attempts to interpret language programmatically, you will see that time and again, the developers get stopped in their tracks because in order to understand a sentence, you need to understand the universe - or at the least a particular corner of it. For example, given the sentence “The stolen painting was found by a tree”, you need to know what a tree is in order to interpret this correctly.

    You can’t really use language *unless* you have a model of the universe.









  • What do you think evolved first - verbal communication or thoughts? Presumably we were able to think before we could speak, no? The words we have in our language are like pointers to internal concepts, and it seems to me that those internal concepts would have existed before language was a thing. The mouth-sounds as you put it are not the thoughts themselves, rather just labels for specific concepts. It might be possible and even convenient to think in mouth-sounds but it’s not necessary for logical thought.







  • I cannot wait until architecture-agnostic ML libraries are dominant and I can kiss CUDA goodbye for good

    I really hope this happens. After being on Nvidia for over a decade (960 for 5 years and similar midrange cards before that), I finally went AMD at the end of last year. Then of course AI burst onto the scene this year, and I’ve not yet managed to get stable diffusion running to the point it’s made me wonder if I might have made a bad choice.


  • Same. I had an Nvidia 960 for about 5 years on arch with very few problems. Maybe twice over that time I had to rollback to an older version temporarily due to some incompatibility with wine or such like.

    Towards the end of last year I finally decided to upgrade (mostly to play RDR2) and I went with AMD. I love the feel of using a pure open source gfx stack, but there is no real functional advantage to it.



  • I find your comment interesting because you are implying that some people believe being stupid or clever is a permanent unchangeable state. Presumably one is born as either one or the other?

    I would say that some ways of thinking are stupid. In particular when one does not challenge one’s assumptions. It’s possible to build a whole world of stupid on top of bad assumptions. If someone’s entire worldview is built in this way - a whole load of bad assumptions held together with poor logic and wishful thinking - I don’t think they’re even living in the real world any more, they’re living in a fantasy land.


  • Well there’s a huge variety of different accents in England, even more if you include the whole UK. British people themselves can struggle understanding other Brits from just 100 or 200 miles down the road. I say that as a Brit - I’ve worked in call centres where there would frequently be Liverpudlians, Geordies, Cornish etc calling back in a rage after being hung up on multiple times by colleagues who couldn’t understand them.