Extra steps are safer steps. As you said, it often get bought out by corporations, but that's an "often", not an "always". The difference between academia and corporations is also that corpos are looking for ways to improve their product first and foremost, which they are known to do to the detriment of everything else.
Again, from Altman:
¥How do you, under this pressure that there's going to be a lot of open source, there's going to be a lot of large language models, under this pressure, how do you continue prioritizing safety versus, I mean, there's several pressures. So, one of them is a market driven pressure from other companies, Google, Apple, Meta and smaller companies. How do you resist the pressure from that or how do you navigate that pressure?
>You know, I'm sure people will get ahead of us in all sorts of ways and take shortcuts we're not gonna take. [...] We have a very unusual structure so we don't have this incentive to capture unlimited value. I worry about the people who do but, you know, hopefully it's all gonna work out.
And then:
¥You kind of had this offhand comment of you worry about the uncapped companies that play with AGI. Can you elaborate on the worry here? Because AGI, out of all the technologies we have in our hands, is the potential to make, the cap is a 100X for OpenAI.
>It started as that. It's much, much lower for, like, new investors now.
¥You know, AGI can make a lot more than a 100X.
>For sure.
¥And so, how do you, like, how do you compete, like, stepping outside of OpenAI, how do you look at a world where Google is playing? Where Apple and Meta are playing?
>We can't control what other people are gonna do. We can try to, like, build something and talk about it, and influence others and provide value and you know, good systems for the world, but they're gonna do what they're gonna do. Now, I think, right now, there's, like, extremely fast and not super deliberate motion inside of some of these companies. But, already, I think people are, as they see the rate of progress, already people are grappling with what's at stake here and I think the better angels are gonna win out. [...] But, you know, the incentives of capitalism to create and capture unlimited value, I'm a little afraid of, but again, no, I think no one wants to destroy the world.
Microsoft or Meta are not to be trusted on anything, much less the massive deployment of artificial intelligence. Again, the Facebook Papers prove as much.
>in practice means regulating all AIs except for the big ones like ChatGPT (OpenAI's).
This part in particular seems to carry a lot of baggage and it's not clear how you reached this conclusion. If anything, it's the leaked stuff that's hardest to regulate.
I'm not Yudkowzky, I don't think it's an existential threat, but impersonation, fake articles and users, misinformation, all in masse, are fairly concrete things directly enabled or caused by this new AI. They hallucinate too, answers with sources that don't exist with the same factual tone. Here are some examples:
https://www.nytimes.com/2023/02/08/technology/ai-chatbots-disinformation.html
https://www.insidehook.com/daily_brief/tech/chatgpt-guardian-fake-articles
https://www.theverge.com/2023/5/2/23707788/ai-spam-content-farm-misinformation-reports-newsguard
Hell, the part about grooming isn't even an appeal to emotion, that's wrong, it's an example of a chatbot acting in an unethical way due to its ignorance. The immoral support it provides is bad because it reinforces grooming, not because it's ugly.
It's not the end of the world and it's being worked on, but it's not a nothingburger either, and I do not believe the talk warrants such an angry reply.
>We can't control what other people are gonna do. We can try to, like, build something and talk about it, and influence others and provide value and you know, good systems for the world, but they're gonna do what they're gonna do. Now, I think, right now, there's, like, extremely fast and not super deliberate motion inside of some of these companies. But, already, I think people are, as they see the rate of progress, already people are grappling with what's at stake here and I think the better angels are gonna win out. [...] But, you know, the incentives of capitalism to create and capture unlimited value, I'm a little afraid of, but again, no, I think no one wants to destroy the world.