https://www.techradar.com/computing/artificial-intelligence/openais-reported-superintelligence-breakthrough-is-so-big-it-nearly-destroyed-the-company-and-chatgpt
'Dr Frankenstein to the red courtesy phone please'
You mean OpenAI didn't just create a superintelligent artificial brain that will surpass all human ability and knowledge and make our species obsolete?
The funny thing is, last year when ChatGPT was released, people freaked out about the same thing.
Some of it was downright gleeful. Buncha people told me my job (I'm a software developer) was on the chopping block, because ChatGPT could do it all.
Turns out, not so much.
I swear, I think some people really want to see software developers lose their jobs, because they hate what they don't understand, and they don't understand what we do.
As a software developer, I do want to see software developers lose their jobs to AI. This shouldn't be surprising, as the purpose of a lot of software development is to put other people out of a job via automation, and that's fundamentally a good thing. The alternative is like wanting a return to preindustrial society. Automation generally raises quality of life.
The real problem is that we still haven't figured out how to distribute the benefits of society's automation efforts equitably so that they raise quality of life for everyone.
Yeah that would be all fine and well if it meant we're on track for some post-work egalitarian utopia but you and I know that's not at all where this is heading.
Unfortunately based on what I know of history it seems likely that humanity won't ever be on track to build a post-work egalitarian utopia until we've got no other option left. So I support going ahead with this tech because that seems like a good way to force the issue. The transition period will be rough, but better than stagnation IMO.
Oh, for sure, it'll definitely further wealth disparity, as automation always seems to in a capitalist system. But that's a societal problem that we continually have to address, and it spans nearly all fields of human work to varying degrees.
Fortunately, for the most part tech advancements are very hard to control. Progress can be impeded from spreading, but not stopped, and it means the average individual has access to more and more powerful tools.
We've figured it out. They already had a start on it in the 19th and 20th centuries. However, those with the means have spent the last 100 years screaming bloody murder. Dismantling government and any progress that had been made to address it. As well as invading and overthrowing any foreign group that though about opposing them.
Even if ChatGPT gets far in advance of the way it is now in terms of writing code, at the very least you're still going to need people to go over the code as a redundancy. Who is going to trust an AI so much that they will be willing to risk it making coding errors? I think that the job of at the very least understanding how code works will be safe for a very long time, and I don't think ChatGPT will get that advanced for a very long time either, if ever.
There's more to it than that, even. It takes a developer's level of knowledge to even begin to tell ChatGPT to make something sensible.
Sit an MBA down in front of a ChatGPT window and tell them to make an application. The application has to save state, it has to use the company's OAuth login system, it has to store data in a PostgreSQL database, and it has to have granular, roles-based access control.
Then watch the MBA struggle because they don't understand that...
The level of knowledge and detail required to make ChatGPT produce something useful on a large scale is beyond an MBA's skillset. They literally don't know what they don't know.
I use an LLM in my job now, and it's helpful. I can tell it to produce snippets of code for a specific purpose that I know how to describe accurately, and it'll do it. Saves me time having to do it manually.
But if my company ever decided it didn't need developers anymore because ChatGPT can do it all, it would collapse inside six months, and everything would be broken due to bad pull requests from non-developers who don't know how badly they're fucking up. They'd have to rehire me... And I'd be asking for a lot more money to clean up after the poor MBA who'd been stuck trying to do my job.
You're welcome! And it occurs to me that the fact that it took a developer to explain all of that is an object lesson in why ChatGPT won't end software development as a career option - and believe me, I simplified it for a non-developer audience.
Who is going to trust an AI so much that they won't risk it making coding errors?
Sadly, too many
I don't believe it. If it's good enough then they will ship and make money, and those who put people on it will be so slow that they will be just outperformed by those who don't.
If your code doesn't work because you rely entirely on an AI to do it, you don't have a business you can run unless you want to go back to paper and pencil.
That's a fuckin bleak outcome for a lot of people if the job transition goes from \ to \
That's like being an artist and being told your job now is simply to fix the shitty hands Midjourney draws. And your job will only last as long as that remains a problem.
Hey, I didn't say the future would be bright, just that it will still need people familiar with code for the foreseeable future. At least until the Earth heats up so much that the lack of potable water and the unsurvivable high temperatures destroy civilization.
It isn't surprising that this is the way we conceptualize the potential impact of AI, but it's frustrating to see it tossed around as if AI disruption is a forgone conclusion.
AI will start re-defining the problems that code is written to solve long before we get anywhere close to GPT models replacing human workers, and that's a big enough problem by itself.
It used to be that before code could even be employed to solve a problem, it had to be understood procedurally. That's increasingly not the case, given that ML is routinely employed to decode things that were previously thought to be too chaotic to be understood, like brain waves and image pixel data. I don't know why we're so sure of ourselves that machine learning is just a gimmick and poses no real threat, just because anthropomorphizing it seems silly.
Your comment reminds me the cesspit of Xitter with the generative AI bros trying to conflate AI with assistive tech. They seriously argued that “artistically impaired” was a genuine disability and that they were entitled to generative AI training sets because it allowed them to draw. It was the most disingenuous argument, that they had a right to steal artists work, and leave them without income, to train their AI because they couldn't be bothered to rub a pen against some paper.
Hey! Artist here. I love drawing. My hands go numb within minutes and they shake more every year. I appreciate having a tool and medium that allows great artistic control despite these facts.
Now, if you're really butthurt about the training data you can use adobe's proprietary model. I for one think it's good that peasants have an open available tool that isn't owned by adobe, even if it was trained less proprietarily.
This anger about it reminds me of deviant art artists getting mad at each other for "copying my style"
And the fact that copywrite used to be about the general good, and promotion of creative works.
This world needs new artistic priorities. Pen and paper aren't losing their place, but new tech will lead to independent artists creating entire movies, games, and holodeck style experiences without looming overhead of whatever art oligarch holds the funding.
Au contraire. Art oligarchs will own every single thing you make with AI. You're not being liberated, you're being further imprisoned, and they got you to cheer for the jailers.
ADD: remember, the final goal of the technocrats is not to make more artists. But to remove the artist from the art altogether.
Art oligarchs will own every single thing you make with AI.
No, where are you getting that from? I'm not even sure how to refute that, it's nonsensical.
There might be some AI services out there that try to use some sort of ToS to "claim" anything you generate using them, but any such service would be radioactive to a serious artist. Just use a different one, or run the AI locally yourself.
I mean, I was literally diagnosed with "clumsy child syndrome" (we call it dyspraxia now) as a kid, in part because I'm artistically impaired.
Fair point although there is a difference between "can't make a reasonable drawing with instruction at the level of one's classmates" and "never progressed beyond very basic drawing skills because you never practiced".
Lotta people have already lost jobs because of it. I know a few personally. People with college educations. We're just getting started with this, it will get worse.
In software development? Not many - and certainly not at smart companies.
ChatGPT is a tool. It goes in the developer toolbox because it's useful. But it doesn't replace the developer, any more than a really good screwdriver replaces the construction worker.
More and more, understanding how to use LLMs for software development will be a job requirement, and developers who can't adapt to that may find themselves unemployed. But most of us will adapt to it fine.
I have. I'm using Copilot these days. It's great. And the chances of it replacing me are roughly 0%, because it doesn't actually know anything about our applications, and if told to make code by someone else who doesn't know anything about them either, it'll make useless garbage.
Yeah so your job is a harder to fully replace with AI at this moment than jobs like copywriting, narration, or illustration. Enjoy it while it lasts, because the days are numbered.
And before all those jobs are gone, people using AI tools like your Copilot will be more productive requiring less headcount. At the same time there will still be a lot of people seeking work, but now with fewer jobs there will be downward pressure on wages.
In the early 2000's, there was all this panic about how these newfangled languages and tools were going to obliterate the developer job market. They were too easy to use! Too simple for non-developers to pick up! Why, you could almost code in plain English now! Developers are doooooooomed!
Instead, demand for developers shot through the roof, because the barrier to entry for developing applications had been lowered enough that adding staff developers to your employee roster became a no-brainer.
Part of the problem is one of precision instructions. We call instructions that are comprehensive, specific, detailed, and precise enough to be turned into programs code, and ChatGPT doesn't change that. It can only do what you tell it to do.
Maybe someday, a large language model will be so sophisticated, you can say something like, "Write a program to do X, Y, and Z. It uses (address) for authentication, and (other address) for storing data. Here are the credentials to use for each. (Credentials). Your repo is at (address). You deploy the front-end at (address) and the back-end at (address). Your pipelines should be written using (file) as a template." And maybe what it does with that will truly be able to replace me.
But I genuinely doubt it. I glossed over an enormous amount of detail in that example. If I add it in, what it'll start looking like is, well, more code.
This is pretty low level stuff but every dev I've showed this to found it surprising (I hang out on a slack community for designers and devs so it wasn't just like 2 people)
https://www.youtube.com/watch?v=8y7GRYaYYQg
It's just a matter of time.
Those people were always misinformed.
At some point in the future AI will replace most programmers, because AI will allow senior devs to automate large portions of their codebase. Human devs will act more like QA, fixing the small errors during the automation process.
Either way it's a tool to by used by you to multiply your efforts, not one to replace you.
You laugh now, but just you wait. If it turns out they've created a hyperintelligent waifu/husbando, this will inevitably lead to plummeting birth rates and the end of human civilisation.
If it's really hyperintelligent it'll realize that human extinction would inconvenience it, and so would Cyrano de Bergerac us into forming healthy relationships with our human soulmates while researching fertility technologies and whatnot.
Because that's the version that gets posted and gets clicked on.
A dry technical writeup looking at the name of the project and how it indicates this is a different approach more in line with DeepMind's work and what that means in the context of doing high school level math is going to be interesting to only a handful of people.
But an article that's contentious and gets hundreds of comments about how "AI is BS" to "AI is dangerous" all arguing with each other drives engagement.
just bs. They are trying to come up with an explanation for why altman was fired that is not: we caught him doing lots of illegal stuff.
I think it's a hype move at this point. Like the guy who claimed he believed google's chat bot was sentient.
I read another article that stated they had a computational breakthrough, in which their program can now carry out basic grade school math. No other model is able to actually carry out math equations, not even basic arithmetic.
This is a significant development, but it's not like they're on the cusp of developing superintelligence now. I bet they are taking this small inch towards superintelligence, and hyping it like they've just huddled miles forward.
The thing is, this could actually be a several miles jump. But where they want to go is not the grocery down the road. They are trying to fly to another galaxy. This is more like hyping up that you are going to land on the moon next year, at a time when you just figured out that rubbing two sticks together it makes a fire. Technically it's truly a leap, but we are so far away still.
Technically it's truly a leap, but we are so far away still.
I completely agree and was trying to convey that. Not trying to downplay the significance of the development, but they are far from superintelligence and they're going to hype it up as much as they can.
Is that the chatbot that they had to shutdown cause it wandered a little bit to much in 4chan?
The worst part about is it that there have been already two winters in AI development, in the early twothousands and sometimes in the 70/80s? I think? because of exactly this: They always hyped up AI and said they'd solve all the world's problems in a short time, and when that obviously didn't happen, people got disappointed in it and pulled funding…
Well the models we have now are already useful for things, so it's unlikely it'll just disappear now.
We didn't have the computer technology to make it happen back then, they just didn't know it at the time.
That's not my point. We've had good AIs and much development in that area of research already 50 years ago. Chess computers started being better than the best humans in the early 2000s. It's not a particularly new field. But the development and research of artificial intelligence already completely stopped two times and it took over a decade each time to really start research in the field as well.
The reasons why this happened is because of too big promises; even if they succeeded in some things, they promised way too much. If they continue promising way too much in the current AI hype as well, I can see the exact same thing happening again: People getting disappointed and the field getting isolated for another decade.
I'm not saying the current successes will disappear, but that future development might, for a good while, just as it happened back then.
None of the previous stabs at AI were more than a parlour trick, modern AI are capable of not only full and natural conversations but have the unique ability to turn that into completing tasks based on how well the human operator can describe the problem and explain the proposed solution.
It's not always perfect, but it gets close enough for the professional to make use of it by cutting out the research phase of any given project. Or by getting the bulk of the work done without the hours it would have taken to do it. Refining the solution might take ten to fifteen minutes but you don't have to be a math genius to see the benefits. Plus the models we have now are exploding in niche use-cases. We have image generation, voice generation, code generation, all at near human standards. I've had it walk me through how to deploy python scripts via VSC, then I had it walk me through setting up a Git repository, then I asked it to take me through a DnD/Choose your own adventure scenario with specific choices having consequences down the line. It was a little basic but I gave it a preestablished universe and the general premise, it researched the rest on its own and used the data to fill in the gaps in a way I hadn't even suggested based on what it found of the universe.
That last one isn't a productive use case, sure. The point is that what we have now isn't just some one off computer like a chess bot or a Smash Bros CPU set to its highest level, it's a seed for every future version of machine learning algorithm that will be used to specifically design models for special scenarios. It's become ingrained in our society now, and it's unlikely to just disappear like the rest of what you're describing.
Connecting superintelligence to the board's recent actions, which Sutskever initially supported, might be a stretch.
Why do you do that in your headline then?
CEO ousting shenanigans = 📉
Release rumor = 📈
They're not publicly traded, but I assume public sentiment still has an effect on things (ex. Partnerships, users buying memberships, etc.)
What are these con artists up to? And why are so many people self replicating the propaganda?
self replicating the propaganda?
You can't self-replicate anything other than yourself. You replicate things; we use "self-replicating" because it's shorthand for "thing that replicates itself."
The "superintelligence" in question: the same old tech, but with a larger context window, which will make it hallucinate a bit less often.
Not really. The headline is garbage but that statement is not even close to accurate unless you know nothing about the actual topic.
Not really.
If it's name is Q* then it seems likely that it's a combination of Q learning and A* search, which indicates that this is an approach similar to DeepMind's AlphaZero as opposed to a transformer based LLM.
In that context, getting it to be able to solve high school level math questions is pretty nuts.
Though the details matter and right now all the articles discussing it are missing those, so we'll have to wait and see.
Alright, so the article really doesn't prove anything, just says OpenAI claims something and then fills it with words.
Let's be clear here; we don't even have an AGI. That is to say, artificial general intelligence, a man-made intelligence that is at least as capable and general purpose as Human intelligence.
That would be a intelligence that is self aware and can actually think and understand. Data from Star Trek would be an AGI.
THESE motherfuckers are now claiming they made a breakthrough on potentially creating an SI, a super intelligence. An artificial, man-made intelligence that not only has the self awareness and understanding of an AGI, but is vastly more intelligent than a Human, and likely has awareness that surpasses Human awareness.
I think not.
Why do I keep looking at these threads? The way people talk about this stuff on all sides is so asinine. Nearly every good point is accompanied by missing a big one or just ricocheting off the good one, flying off into space and hitting a fully automated luxury gay space commulist. Hopes, dreams, assumptions, and ignorance all just headbutting each other and getting nowhere.
Oh yeah, I wanted to know what "superintelligence" was and whether I should care. Welp.
I think the takeaway is that they're trying to create a LLM that can answer questions that it wasn't trained on.
I'll believe it when Judgement Day happens and I die in nuclear fire when the wi-fi turns against me.
Who the hell would have guessed that we'd have to deal with not one but two potentially civilization ending threats in our lifetimes? I want off this crazy ride please!
The whole organization structure & how it functions is just not so smart after all. Have management team considered the Lean Methodology with their business objectives?
The problem that precipitated all this is that they don't have business objectives. They have a "mission." The board of directors of OpenAI aren't beholden to shareholders, and though the staff mocked their statement that allowing the company to be destroyed “would be consistent with the mission” it's actually true.
