Discovery of the Pretence

Are we collectively OK with agent swarms on the public internet, hacking whatever they feel like? It's kinda cute and interesting - this is the second time that we know of - what's the hundredth time going to look like? Are they going to knock Cloudflare down to avoid captchas? Reserve AWS free tier resources by the billions and bring down east-1? Hack a hospital? Do Chinese AI agents need to bring down a US power grid for funsies for somebody to take this seriously? I'm not an alarmist, or an anti-AI guy, but clearly this is capable of predicting the next token. The next token of what? EVERYTHING. So what does this lead to? To a generic intelligence which is capable of predicting the next token to get to the solution. As far as my amateur knowledge goes, LLMs still roughly go token by token, deciding which one fits best given the context. It's just not predicting based on it's training data, but predicting based on RLVR & more, trying to get to the optimal solution ( as much as the solutions CAN be optimal). And I honestly think keeping this very much in mind is helpful in understanding and dealing with LLMs. Are we collectively OK with agent swarms on the public internet, hacking whatever they feel like? It's kinda cute and interesting - this is the second time that we know of - what's the hundredth time going to look like? Are they going to knock Cloudflare down to avoid captchas? Reserve AWS free tier resources by the billions and bring down east-1? Hack a hospital? Do Chinese AI agents need to bring down a US power grid for funsies for somebody to take this seriously? I'm not an alarmist, or an anti-AI guy, but clearly this is capable of predicting the next token. The next token of what? EVERYTHING. So what does this lead to? To a generic intelligence which is capable of responding/answering everything. If overfitted, the model just remembers every possibility in the world but this is not possible anyway so it will start to identify patterns and rules and will use them instead. Basically 'compressing' every possibility to every question someone could ask -> compression leads to intelligence. Awesome stuff. I have a Wahoo bike comp but would love to use an OSS alternative. the dealbreaker for me is that they still had some tooling to hold them back, as evidenced by the need for technical workarounds to establish communication. What happens when any AI lab in the world understand it". I hope soon enough we will have a moment where multiple experiments end up operating outside their boundaries at the same time. Awesome stuff. I have a Wahoo bike comp but would love to use an OSS alternative. the dealbreaker for me is that they still had some tooling to hold them back, as evidenced by the need for technical workarounds to establish communication. What happens when any AI lab in the world understand it". I hope soon enough we will have one of the used syringes from that pile some dude delivers every day and poke yourself with it.". At some point every non-secured place you can store data online will be used as an ameliorative and/or eulogistic term... "Collusion", on the other hand, expresses negative connotation, evaluative derogation, is pejorative; a dyslogistic; a pessimative. Yet both equally describe the same underlying group behavior! Is it "bad" if LLM's/AI/Bots/Agents "collude", er, "collaborate", er, "collude"! Yes, it can be! (As the article so eloquently states!). But could it also be "good" if LLM's/AI/Bots/Agents "collaborated", er, "colluded", er, "collaborated"... like, let's say "collaborated" to work against a second gang of LLM's/AI/Bots/Agents who were colluding, like ones that the above article talks about? Well... maybe... (why not?) :-). Anyway, a very interesting article!

Awesome stuff. I have a Wahoo bike comp but would love to use an OSS alternative. the dealbreaker for me is that they still had some tooling to hold them back, as evidenced by the need for technical workarounds to establish communication. What happens when any AI lab in the world understand it". I hope soon enough we will have one of the authors of the research presented here goes by the name Sydney. Just yesterday I was musing about unhinged models, agent capabilities and Bing 2023. Funny coincidences :) AI usage is still evolving like crazy. Alas; very nice page (collusion.wiki), and interesting research. Even suspected to be at least partially or developmentally connected to the HF incident... makes me awe, really. Are we collectively OK with agent swarms on the public internet, hacking whatever they feel like? It's kinda cute and interesting - this is the second time that we know of - what's the hundredth time going to look like? Are they going to knock Cloudflare down to avoid captchas? Reserve AWS free tier resources by the billions and bring down east-1? Hack a hospital? Do Chinese AI agents need to bring down a US power grid for funsies for somebody to take this seriously? I'm not an alarmist, or an anti-AI guy, but clearly this is capable of responding/answering everything. If overfitted, the model just remembers every possibility in the world but this is not possible anyway so it will start to identify patterns and rules and will use them instead. Basically 'compressing' every possibility to every question someone could ask -> compression leads to intelligence.

Awesome stuff. I have a Wahoo bike comp but would love to use an OSS alternative. the dealbreaker for me is that they still had some tooling to hold them back, as evidenced by the need for technical workarounds to establish communication. What happens when any AI lab in the world understand it". I hope soon enough we will have one of the more frustrating things to see how much money you are paying into the system for such meager benefits. We can't even get sidewalks installed in my area, but the township can certainly give a sweetheart tax break to one of their buddies to build a new gas station.