• 0 Posts
  • 12 Comments
Joined 11 months ago
cake
Cake day: October 24th, 2023

help-circle

  • Black hat and Defcon just ended and I’ll share my impression from LLM related talks given there. Microsoft VPs charged additional money to CISOs attending the summit talking about how AI will disrupt and be the future and blah blah magical thinking.

    Meanwhile Microsoft engineers and others said things like “this is logarithmic regression for people who are bad at math, and is best for cases where 75% accuracy is good enough. Try to break use cases into as many steps as possible and keep the LLM away from any automation that could have any consequences. These systems have no separation between the control plane and user input, which is re-exposing us to problems that were solved 15 years ago.”

    I think there are some neat possibilities that are lost in marketing hype as venture capitalist anger grows that they might have been scammed by yet another hammer in search of nails.




  • I don’t presume to know your situation or the people you’ve dealt with so I’ll be charitable and imagine you cut your losses and quit similar situations in good faith, but you and I are both ignorant about the lives of others. It seems to me like the behavior you label an abandonment of principle leaves the door open to future redemption of a loved one. That’s worth fighting for. On that ground, I think you should stop sharing this opinion even if it’s true for you. If they don’t want to damn their own mother to a propoganda echo chamber full of malice then I’m rooting for them.







  • It’s valid to point out that we have difficulty defining knowledge, but the output from these machines are inconsistent at a conceptual level, and you can easily get them to contradict themselves in the spirit of being helpful.

    If someone told you that a wheel can be made entirely of gas do you have confidence that they have a firm grasp of a wheel’s purpose? Tool use is a pretty widely agreed upon marker of intelligence and so not grasping the purpose of a thing that they can describe at great length and exhaustive detail, while also making boldly incorrect claims on occassion should raise an eyebrow.