All Fancy Smancy Generative Ai Models Know How To Do Is Parrot What They’ve Been Exposed To.

All fancy smancy generative ai models know how to do is parrot what they’ve been exposed to.

A parrot can shout words that kind of make sense given context but a parrot doesn’t really understand the gravity of what it’s saying. All the parrot knows is that when it says something in response to certain phrases it usually gets rewarded with attention/food.

What a parrot says is sometimes kinda sorta correct/sometimes fits the conversation of humans around it eerily well but the parrot doesn’t always perfectly read the room and might curse around a child for instance if it usually curses around its adult owners without facing any punishment. Since the parrot doesn’t understand the complexities of how we don’t curse around young people due to societal norms, the parrot might mess that up/handle the situation of being around a child incorrectly.

Similarly AI lacks understanding of what it’s saying/creating. All it knows is that when it arranged pixels or words in a certain way after being given some input it usually gets rewarded/gets to survive and so continues to get the sequence of words/pixels following a prompt correct enough to imitate people convincingly (or that poorly performing version of itself gets replaced with another version of itself which is more convincing).

I argue that a key aspect of consciousness is understanding the gravity and context of what you are saying — having a reason that you’re saying or doing what you are doing more than “I get rewarded when I say/do this.” Yes AI can parrot an explanation of its thought process (eli5 prompting etc) but it’s just mimicking how people explain their thought process. It’s surface level remixing of human expression without understanding the deeper context of what it’s doing.

I do have some untested ideas as to why its understanding is only surface level but this is pure hypothesis on my part. In essence I believe humans are really good at extrapolating across scales of knowledge. We can understand some topics in great depth while understanding others similarly on a surface level and go anywhere in between those extremes. I hypothesize we are good at that because our brains have fractal structure to them that allows us to have different levels of understanding and look at some stuff at a very microscopic level while still considering the bigger picture and while fitting that microscopic knowledge into our larger zoomed out understanding.

I know that neural networks aren’t fractal (self-similar across various scales) and can’t be by design of how they learn/how data is passed through them. I hypothesize that makes them only understand the scale at which they were trained. For LLM’s/GAN’s of today that usually means a high level overview of a lot of various fields without really knowing the finer grain intricacies all that well (see how LLM’s make up believable sounding but completely fabricated quotes for long writing or how GAN’s mess up hands and text once you zoom in a little bit.

There is definitely more research I want to do into understanding AI and more generally how networks which approximate fractals relate to intellegence/other stuff like quantum physics, sociology, astrophysics, psychology, neuroscience, how math breaks sometimes etc.

That fractal stuff aside, this mental model of generative AI being glorified parrots has helped me understand how AI can seem correct on first glance/zoomed out yet completely fumble on the details. My hope is that this can help others understand AI’s limits better and therefore avoid putting too much trust into to where AI starts to have the opportunity to mess up serious stuff.

Think of the parrot cursing around children without understanding what it’s doing or why it’s wrong to say those words around that particular audience.

In conclusion, I want us to awkwardly and endearingly laugh at the AIs which mimic the squaks of humans rather than take what it says as gospel or as truth.

Park Cleanup Pet Peeves

I'll be starting my seasonal gig at Parks and Rec in a couple months and I've got a couple things I wanna say. I know that this will probably not reach the people who need to hear it, but if ONE LESS person leaves the parks a mess, I will be That Much Happier.

-You're not supposed to smoke, drink, or have sex in public parks but I know that people will anyway. But if you are going to do those things, please dispose of the evidence in the trash cans. A human has to pick these things up.

-Dog poop goes in a bag. Bag goes in the trash can.

-The little wax paper liners in the women's room? See you're supposed to put your pad/tampon in that wax paper bag, take the bag out of the bin, and then dispose of it in the actual trash can. Don't feel bad, no one told me either. Also no one told the dudes I work with. But this reduces direct exposure to bodily fluids, especially as the summer gets on and it gets hot in those bathrooms.

-On that subject! The little bins that they go in next to the toilet? Don't stick trash in there. Don't put diapers in there. Also don't put beer cans crushed in such a specific way that I slice my hand on them as I try to jimmy it out of there. Literally, that bin is too small for most things. They are meant specifically for those brown bags. Please for the love of god, throw things in the trash can.

-As for the urinals, please no solids. Most commonly gum and chewed tobacco, but you can use your imagination.

-If you're doing a photo shoot or an event with confetti, please use a paper confetti instead of a plastic one- its easier to get rid of.

-If you're doing a pizza party, we'd rather you stack the pizza boxes in a pile next to the trash can instead of trying to fit them in the trash. Because then we can just throw the trash bag over the top and tie it instead of trying to fish it out. This kind of goes for any big trash- if it won't fit in the trash can easily, don't try.

-Please don't call cops on people sleeping in the parks if they're not bothering anyone. Even if they've been sleeping there all day. Dude's just trying to chill.

-Destruction of the toilets will result in the indefinite locking of the restrooms. You ruined them and now everyone at the softball tournament can blame you for it.

-Parks people are not the police. We are maintenance workers who are not trained to handle most emergencies and the most we can do in any situation is report to the proper department. Please don't look to us for answers if someone is starting a fight.

-Also please don't spit on us for driving on the path. We're permitted to. Its essential for us to drive on the path to do our job.

-please don't abandon animals at the park. Rehome them properly. I spent a whole week trying to catch a rooster last summer.

-look, I get it- 'oh no, your pretty building has writing on it!' Grafitti is so edgy. We get it. But it means Jacob has to sand it off now so that the kids at the birthday party don't see a giant drawing of a weiner. Acts of rebellion that create more work for the working class are not revolutionary.

-please do not set fire to the Tiny Free Library. Why did you do that? That's mean.

-please do not feed bread to ducks and geese. Corn, birdseed, lettuce- those are better for them. If you want to reduce tge amount of goose poop in the parks, shop feeding them bread.

-also do not anger tge geese. They remember what its like to be dinosaurs.

I'll have more later, probably, once the season wears on.

Tags

third spaces are awesome thank you for working to maintain them I appreciate your efforts also reblogging because park employees deserve respect

2K notes View Post

zephiris

1 year ago

Reblog to kill it faster

296K notes View Post

zephiris

1 year ago

every software is like. your mission-critical app requires you to use the scrimble protocol to squeeb some snorble files for sprongle expressions. do you use:

libsnorble-2-dev, a C library that the author only distributes as source code and therefore must be compiled from source using CMake

Squeeb.js, which sort of has most of the features you want, but requires about a gigabyte of Node dependencies and has only been in development for eight months and has 4.7k open issues on Github

Squeeh.js, a typosquatting trojan that uses your GPU to mine crypto if you install it by mistake

Sprongloxide, a Rust crate beloved by its fanatical userbase, which has been in version 0.9.* for about four years, and is actually just a thin wrapper for libsnorble-2-dev

GNU Scrimble, a GPLv3-licensed command-line tool maintained by the Free Software Foundation, which has over a hundred different flags, and also comes with an integrated Lisp interpreter for scripting, and also a TUI-based Pong implementation as an "easter egg", and also supports CSV, XML, JSON, PDF, XLSX, and even HTML files, but does not actually come with support for squeebing snorble files for ideological reasons. it does have a boomeresque drawing of a grinning meerkat as its logo, though

Microsoft Scrimble Framework Core, a .NET library that has all the features you need and more, but costs $399 anually and comes with a proprietary licensing agreement that grants Microsoft the right to tattoo advertisements on the inside of your eyelids

snorblite, a full-featured Perl module which is entirely developed and maintained by a single guy who is completely insane and constantly makes blog posts about how much he hates the ATF and the "woke mind-virus", but everyone uses it because it has all the features you need and is distributed under the MIT license

Google Squeebular (deprecated since 2017)

6K notes View Post

zephiris

1 year ago

My guess would be that the compiler is not added to your PATH environment variable or you need to restart your computer. I’m not sure which OS you’re on, but if you follow the instructions on this page in the “install a compiler” section then that should help you properly configure your PATH environment variable.

hi sorry if this is a dumb question but I'm just starting to learn to code and I can't figure out how to set up visual studio code for c++. I've installed the extension and a compiler but still it doesn't work. Maybe you or one of your followers could help me out?

Hiya 💗 Yeah I don’t have any experience in C++ so if someone could help out here thank you!

19 notes View Post

zephiris

1 year ago

Capitalism is so disgustingly goopy, sticking and amassing into deposits which never seem to release, creating increasingly larger gaps in equality.

How do you get a billionaire to care about anything when they’re coated in a mucous bubble of capital, sealed off from the real world?