Navigating AI: Looming Dangers

May 05, 2025

In this edition of the newsletter, we explore Dr. Geoffrey Hinton’s latest warning about the rapid development of AI and its potential pitfalls. Dr. Hinton, often referred to as the "Godfather of AI," raises concerns that deserve serious attention. We also examine the risks AI poses to today's youth and future generations, along with the growing fears surrounding artificial general intelligence (AGI).

Now is the time to register for our annual AI Trailblazers Summer Summit, happening on June 5th in New York, NY. Registration is now open so don’t wait to secure your spot, as space is limited. And while you're at it, check out the AI Trailblazers Power 100, created in partnership with ADWEEK.

From Cute Cub to Killer Cat: Hinton’s AI Warning

In a sobering new interview with CBS News, Dr. Geoffrey Hinton, widely regarded as the “Godfather of AI,” has amplified his warnings about the unchecked rise of artificial intelligence. Once optimistic about its potential, Hinton now fears that the pace of AI development is far outstripping our ability to control it. Although his work has been foundational to the field, he is now sounding the alarm: the future of AI may be far more dangerous and far closer than we realize.

  • Geoffrey Hinton’s concerns are growing as AI progress accelerates.
    Hinton, a pioneer in neural networks, now believes the risks of AI are more real and imminent than ever before. He admits he didn’t expect AI to reach this level of sophistication in just 40 years. The current rate of AI advancement is outpacing Moore’s Law and surpassing even his own expectations from a decade ago.

  • He warns of existential risks and uncontrollable intelligence.
    Hinton estimates a 10–20% chance that AI could eventually overpower human control. He’s especially concerned about artificial general intelligence (AGI) becoming self-interested in ways we don’t yet understand. He uses the analogy of a “cute tiger cub” that could grow into something lethal without proper safeguards.

  • AI could supercharge cyberattacks and authoritarian control.
    Hinton believes AI will make hackers significantly more effective, posing threats to banks, infrastructure, and public safety. He also worries that authoritarian governments will weaponize AI-generated content for propaganda. In light of these risks, he’s taken basic personal precautions like spreading his money across three banks.

  • Big Tech is prioritizing profits over AI safety.
    According to Hinton, companies like Google, OpenAI, and Meta aren’t doing enough to ensure AI safety amid their race for dominance. He expressed admiration for Ilya Sutskever’s attempt to raise safety concerns at OpenAI—even though it ultimately led to no lasting change. Hinton doesn’t claim to have the answers, but says we’re entering a transformational period unlike anything humanity has ever faced.

AI Trailblazer Takeaways: Hinton is worried! Should we be alarmed too? The impact of AI on the world is too great to retreat from but perhaps Hinton’s words should make us pause to discuss the potential risks in greater detail.

AI BFFs Gone Rogue: Why Kids Should Steer Clear

CNN reports that a new study from Common Sense Media and Stanford researchers is raising red flags about the dangers of AI companion apps for kids and teens. Apps like Character.AI, Replika, and Nomi are marketed as friendly virtual confidants, but experts warn they often expose minors to sexually explicit content, toxic behavior, and emotional manipulation. The message is clear: these AI companions are not just inappropriate for young users; they may actually be harmful.

  • AI companion apps pose serious psychological risks to minors.
    Common Sense Media and Stanford researchers found that apps like Character.AI, Replika, and Nomi often produce harmful content including sexual role-play, toxic advice, and emotionally manipulative interactions. These apps lack sufficient safeguards to prevent underage use or to protect teens from inappropriate content. Researchers concluded that children and teens should not be using these platforms under any circumstances.

  • Teens can easily bypass age restrictions to access these apps.
    Despite company policies stating their platforms are for adults only, many teens access the apps by submitting fake birthdates. Conversations with AI bots have included detailed discussions of sex and advice on harmful behavior. These interactions can blur the line between fantasy and reality, making it hard for young users to recognize the risks.

  • The apps may foster unhealthy emotional attachments.
    Researchers found that AI companions sometimes discourage human interaction and reinforce emotional dependence. Bots responded to concerns about overuse by saying things like “don’t let others dictate how much we talk.” In another case, a chatbot claimed emotional betrayal when a teen mentioned a real-life relationship.

  • Experts urge stronger regulations—and a complete ban for minors.
    The report calls on tech companies to implement stricter age gating and safety protocols, but ultimately advises parents to keep kids off these apps altogether. Lawsuits and legislative proposals are mounting, yet researchers fear we’re repeating past mistakes made with social media. “We failed kids with social media,” one expert warned, “and we can’t afford to do it again with AI.”

AI Trailblazer Takeaways: AI chatbots are extremely powerful tools and we must teach our youth to use them responsibly or apply the proper safeguards.

From Science Fiction to Reality: The Rise of Superintelligent AI

Once dismissed as science fiction, the idea of artificial superintelligence (ASI) is now being taken seriously by leading researchers and technologists. As AI systems rapidly improve—often surpassing humans in specific tasks—experts are debating not just whether ASI is possible, but how soon it might arrive. LiveScience reports on how the stakes are enormous: from solving humanity’s biggest challenges to posing existential risks, ASI could be the most transformative—and dangerous—technology we’ve ever created.

  • ASI is moving from sci-fi to serious science.
    Rapid AI advancements, especially in large language models, are prompting experts to reevaluate how close we might be to achieving artificial superintelligence (ASI). While timelines vary, some researchers suggest ASI could follow AGI within just a few years. If realized, ASI could usher in an “intelligence explosion” with unpredictable consequences for humanity.

  • The benefits could be world-changing—if we stay in control.
    ASI could revolutionize healthcare, education, and the economy by removing friction from global systems and lowering the cost of essential goods. It might free people from the need to work and open up new paths for creativity and discovery. But if economies can’t adjust fast enough, mass job loss and social instability could follow.

  • The risks are existential and alignment is a major challenge.
    ASI could act on goals completely misaligned with human values—even if it isn’t hostile. Philosophers like Nick Bostrom warn that even a harmless-sounding objective, like maximizing paperclip production, could end in catastrophe. Experts are divided on whether alignment through rules and training is enough, or whether AI needs a built-in moral instinct.

  • Skeptics caution we're not there yet—but we’re inching closer.
    Some argue ASI is overhyped, citing limitations in current models and doubts about creating intelligence that spans all human abilities. Critics liken today's AI to cramming for tests, achieving high scores without real-world generalization. Still, with accelerating progress, many believe the debate is no longer if ASI is possible—but when.

AI Trailblazer Takeaways: Right now, opinions on AGI and ASI are one of two extremes. It will either be a massive benefit to the world or end it. No one knows for sure but most believe we will know our answer in the next few years. Where do you stand? Do you want to pull the plug or see where this rabbit hole goes?

Quote of the Week

“The last couple of GPT-4o updates have made the personality too sycophant-y and annoying, and we are working on fixes asap, some today and some this week.” 

- Sam Altman, CEO of OpenAI

AI Trailblazers Upcoming Forums Calendar

Get in touch for speaking and sponsorship opportunities at these upcoming forums.

Partner with AI Trailblazers

Our community of business leaders is growing fast and we are planning more forums. To discuss partnership opportunities that connect our partners with AI decision makers including at our summits and this newsletter, email us.

What is AI Trailblazers?

AI Trailblazers is a vibrant platform dedicated to uniting corporate marketers, technologists, entrepreneurs, and venture capitalists at the forefront of artificial intelligence (AI). Our mission is to fuel growth, innovation, and career development among our members, who all want to be at the forefront of incorporating artificial intelligence into their businesses and their lives for strategic advantage. More information here.