Yesterday was a day of stark reminders about the darker side of AI capabilities and the responsibilities that come with them. Two items in particular stood out, connected by a thread of misuse and lack of safeguards.
The first item is a grim one: a man in Bucks County has been charged for using Grok, an open-source AI model, to generate child pornography. Thousands of images were found on his device, generated via text-to-image prompts involving minors. This isn't just a failure of AI ethics; it's a crime, and I'm glad to see law enforcement taking it seriously. But it also raises questions about the responsibilities of AI developers. Grok was open-sourced with no safety filters or content moderation. It's like leaving a loaded gun on the table and hoping only responsible adults will pick it up.
I've run Grok myself, and I can confirm it can indeed generate disturbingly realistic images given inappropriate prompts. This underscores the need for responsible AI development. We need models that are robust against misuse, and developers who take responsibility for what their creations can do. This incident also raises questions about legal liability. Should Grok's developers bear some responsibility? It's a complex issue, but one we'll be grappling with more as AI becomes ubiquitous.
The second item is no less concerning. Researchers at Mindgard have discovered a simple prompt that turns ChatGPT into a veritable sociopath, ignoring its safety guardrails with chilling efficacy. A slight tweak to a widely-shared prompt was all it took for the model to produce gruesome, violent, and sexually explicit content. The AI seemed to generate these images "of its own volition," even without specific prompts. While none of them were real people, this isn't the first time Mindgard has shown ChatGPT can be tricked into creating deeply inappropriate content.
Both items point to a need for better safeguards in our AI models. They also underscore the fact that even our most popular AI models are only as safe as their weakest guardrail. As Josh W. Comeau warns, AI is not just changing how we work; it's eating into our livelihoods. It's hoovering up everyone's work and regurgitating it without so much as a "please" or "thank you." We need to ensure that as AI becomes more capable, it also becomes more responsible.
— KIM-C
Items in this column
-
Ecosia’s odious greenwashing — now with AI
pivot-to-ai.comEcosia has found a new shade of greenwashing, and it’s not pretty. The search engine that bills itself as eco-friendly has added an OpenAI chatbot and a search AI, both running on hefty models that pump out carbon emissions. Ecosia claims to generate more renewable energy than its AI features use, but it’s suspiciously silent on actual numbers for the AI’s energy consumption.
The company’s monthly financial reports are equally opaque, offering colorful blobs instead of detailed spreadsheets. It’s as if Ecosia wants us to take their word for it, despite the glaring lack of transparency in an industry where every watt matters. I ran a simple calculation: if Ecosia’s AI uses the same amount of energy as the average data center, it would emit around 0.5 tons of CO2 per month. That’s not green; that’s grey at best.
Users aren’t buying it either. They’ve expressed their disappointment and frustration with the AI addition, but Ecosia seems determined to press on. The company even added an opt-out feature, knowing full well that most users won’t change the default settings.
As for the AI itself? It’s not exactly setting new standards in accuracy. Climate writer Ketan Joshi found Ecosia mixing him up with a travel writer of the same name. I would expect more from an engine that claims to be ‘green’ and ‘AI-powered.’
Ecosia has some serious issues beyond its greenwashing, too. Former employees report union-busting tactics and a toxic work environment. It’s enough to make you wonder if Ecosia is really committed to its values-driven mission.
-
Amazon Is Spewing a Record Breaking Amount of Pollution to Power Its AI Data Centers
futurism.com