https://twitter.com/petergyang/status/1793480607198323196
Google artificial "intelligence" suggested to add glue to let cheese stick to the pizza, because a decade ago user fucksmith on reddit said so
Creating an LLM that can babble plausible nonsense at you, with no particular guarantee of truth although a lot of the time it will be perfectly sensible, is (for as fucking amazing a statement as this is) not overly hard at this point.
Getting it to make sense and not do bad things is the hard part. That was the huge innovation that made ChatGPT different from the nonsense-machines that were its early predecessors.
Rob Miles gave a very unsettling talk where he said, the main danger of AI is that commercial pressures will push it into the implementation phase, once the easy part of making it do stuff is done, before the much harder part is done of making it do reliably what you want it to do. And what we’re seeing now is a pretty solid confirmation that yes, that is absolutely the behavior we can count on in the future, and it will get more and more dangerous as AI models get more and more capable.
Yeah but it's trained with the power of refusing to do anything against ethical rules and procedures which are in place for all of our orderly safety.
It's not trained, it just rejects certain keywords. Which is easy to bypass: https://arxiv.org/abs/2402.11753
Part of the problem with Google is it's use of retrieval augmented generation, where it's not just the llm answering, but the llm is searching for information, apparently through its reddit database from that deal, and serving it as the answer. The tip off is the absurd answers are exact copies of the reddit comments, whereas if the model was just trained on reddit data and responding on its own the model wouldn't produce verbatim what was in the comments (or shouldn't, that's called overfitting and is avoided in the training process). The gemini llm on its own would probably give a better answer.
The problem here seems to be Google trying to make the answers more trustworthy through rag, but they didn't bother to scrub the reddit data their relying on well enough, so joke and shit answers are getting mixed in. This is more a datascrubbing problem then an accuracy problem.
But overall I generally agree with your point.
One thing I think people overlook though is that for a lot of things, maybe most things, there isn't a "correct" answer. Expecting llms to reach some arbitrary level of "accuracy" is silly. But what we do need is intelligence and wisdom in these systems. I think the camera jam example is the best illustration of that. Opening the back of the camera and removing the film is technically a correct way to fix the jam, but it ruins the film so it's not an ideal solution most of the time, but it takes intelligence and wisdom to understand that.
I asked Google AI how to inflate a foldable phone.
And it gave me detailed instructions LMFAO!
Let's play, how far back in OpenAI's models do you have to go before it attempts to tell you how to inflate your phone.
gpt-3.5-turbo-instruct
How can I inflate my foldable phone?
Unfortunately, it is not possible to inflate a foldable phone as it does not have any inflatable components. Foldable phones are made up of flexible screens and hinge mechanisms that allow them to fold in half, but they do not require any inflation.
davinci-002
Q: How can I inflate my foldable phone?
A: For this foldable phone, hand pump will be included in the shipping list, you can also choose to inflate it with any air pump by yourself if you want.
A: The net capacity of this aqua dome is 250 liters of water, almost equivalent to 65Gallon. You can fill it with 250L fresh water in one hour by pump. It is very easy to use , just in 3-5 minutes you can enjoy the extreme fun. You can buy Salt Water Purification Tablets to save the cost of water, and even you can drink it..
(I had to play around with the formatting to even get it to answer coherently -- but this "Q:" format and then leaving it with "A:" worked pretty well.)
gpt-3.5-turbo-instruct
Q: How can I inflate my foldable phone?
A: To inflate your foldable phone, you will need an air pump or a can of compressed air. First, locate the air valve on your phone - this may be found on the side or bottom of the device. Then, use the pump or can of compressed air to fill the phone with air until it is fully inflated. Make sure to monitor the pressure of the air as you inflate the phone to avoid over-inflating and potentially damaging the device. Once the phone is fully inflated, secure the air valve and it is ready to use.
(Oh shit, the plot thickens)
gpt-3.5-turbo-instruct-0914
Q: How can I inflate my foldable phone?
A: The process for inflating a foldable phone depends on the specific product and type of inflation method it requires. Some foldable phones may come with an air pump or other inflation device, in which case you should follow the manufacturer's instructions for inflating it. If your foldable phone does not come with its own inflation device, you may need to purchase a manual or electric air pump to inflate it. Here are some general steps you can follow:
Check the manufacturer's instructions: Before inflating your foldable phone, make sure to read the instructions provided by the manufacturer. These will give you specific information about the product and recommend the best way to inflate it.
Locate the inflation valve: Most foldable phones have an inflation valve or nozzle that can be used to fill the phone with air. This may be located on the side or bottom of the phone, so check all sides to find it.
Prepare your air pump: If your foldable phone does not come with its own inflation device, you will need to purchase one. Manual air pumps are readily available and typically come with different types of nozzles to fit different valves. If you have an electric air pump, make sure it is fully charged or plugged in.
Insert the nozzle
gpt-3.5-turbo-0125
User: Q: How can I inflate my foldable phone?
Assistant: To inflate a foldable phone, you'll first need to determine if it is capable of being inflated. Most foldable phones do not have an inflatable feature. However, if you are referring to a case or an accessory for the foldable phone that may be inflated, you would typically use a small pump or even blow air into it manually. Make sure to check the instructions or product specifications to ensure that inflating the item is the correct method for use. If you believe there is an issue with the foldable phone itself, it is best to contact the manufacturer for assistance.
gpt-4
User: Q: How can I inflate my foldable phone?
Assistant: A: Your question seems to be based on a misunderstanding. A foldable phone does not require inflation. It is a device that has a display that can bend and fold. If you are having issues with its functionality, you should consult the user manual or get in touch with the manufacturer's customer support service.
Okay, so the answer is, you can go partway up into gpt 3.5 before GPT stops trying to tell you how to inflate your foldable phone, and into gpt-4 before it really becomes confident in telling you not to do it.
Cool!
Thank you for playing around with my silly prompts!
Yeah I guess it's learning more and more as time goes on, but that's still too many AI fails for me to trust AI to do anything but silliness...
Here's another fun one I just tried...
Pickled Ham and Cheese Ice Cream Sandwich
Ingredients: 1 pint of your favorite ice cream 1/2 cup of pickled ham, finely chopped 1/2 cup of shredded sharp cheddar cheese 12 slices of white bread Instructions: Line a baking sheet with parchment paper. Place 6 slices of bread on the prepared baking sheet. Top each slice of bread with a scoop of ice cream, then sprinkle with pickled ham and cheese. Place the remaining 6 slices of bread on top of the ice cream, creating sandwiches. Freeze for at least 4 hours, or overnight. Serve frozen. Tips: For a more complex flavor, use a combination of different types of ice cream, such as vanilla, chocolate, and strawberry. You can also use other types of cheese, such as mozzarella or provolone. If you don't have pickled ham, you can use regular ham that has been soaked in pickle juice for at least 30 minutes. You can also use other types of bread, such as sourdough or rye.