Discussion about this post

User's avatar
Reuben Bijl's avatar

I really enjoyed this Jim. Great analogy. I used to be this person too until I woke up.

I think the deeper layer here is that the industry has defined intelligence simply as knowledge. Yet the word is about the application of knowledge. And these machines cannot do this.

https://smudge.com/journal/a-history-of-ai-as-manufactured-expert-judgement/

Kemiu's avatar
6hEdited

This is not a miscommunication because AI companies want to be regulated like the nuclear industry. They genuinely believe that the technology they are working on has the potential to become dangerous and powerful quickly. In straightforward terms, they believe they are sitting on an existential threat to humanity more severe than a thermonuclear exchange.

The “existential risk” view predates LLM technology and was well known amongst AI researchers. The trajectory of LLM development vindicated many of the technical arguments of this view and elevated the non-profits founded with this view to prominence.

So a lot of what you’re hearing is activists and non-profits advocating for government regulation of a dangerous technology, not company executives talking to customers. An important thing to keep in mind when listening to public statements from AI organizations is that OpenAI was one of these non-profits until Altman took it over (in dramatic fashion). Altman had to conform to the “existential risk” view before the takeover, and no transition is ever clean, so that’s why there’s “humanity” language mixed in with regular product marketing.

Note that since the takeover OpenAI has been fighting against the regulations supported by all other US AI organizations.

7 more comments...

No posts

Ready for more?