#034 - Cyber AI Chronicle - Is AI Collapsing?

PRESENTED BY

Cyber AI Chronicle

By Simon Ganiere · 8^th September 2024

Welcome back!

Project Overwatch is a cutting-edge newsletter at the intersection of cybersecurity, AI, technology, and resilience, designed to navigate the complexities of our rapidly evolving digital landscape. It delivers insightful analysis and actionable intelligence, empowering you to stay ahead in a world where staying informed is not just an option, but a necessity.

Table of Contents

• What I learned this week

  • TL;DR

  • AI Model Collapse: A Growing Threat to Cybersecuri …

    • What is AI Model Collapse?

    • Why is Model Collapse Happening?

    • Preventing AI Model Collapse

    • What This Means for Cybersecurity

    • The Importance of Human Involvement in AI-Based Cy …

    • Measuring How Well Cybersecurity AI Systems Perfor …

    • Conclusion

• Worth a full read

  • Under Meredith Whittaker, Signal is out to prove s …

    • Key Takeaway

  • The rise of the machines. Potential application of …

    • Key Takeaway

  • Business Email Compromise Guide (BEC)

    • Key Takeaway

• Wisdom of the week

• Contact

What I learned this week

TL;DR

• AI model collapse threatens the integrity and effectiveness of AI systems including AI systems that support cyber security. Equip yourself with the right knowledge about this new challenge and what can be done » READ MORE

• The threat landscape is as busy as always. To highlight only a couple of key things:

  • The U.S. Department of Justice (DoJ) seized 32 domains used by Russian-linked threat actor Doppelgänger to spread disinformation campaigns targeting the upcoming U.S. elections and international support for Ukraine; two Russian nationals were indicted for funding and spreading propaganda through a Tennessee-based company.

  • A critical-level Remote Code Execution (RCE) vulnerability (CVE-2024-70411) was found in Veeam’s Backup & Replication software, prompting immediate security updates; ransomware gangs like FIN7 and REvil are targeting these vulnerabilities to access and compromise enterprise data.

  • North Korean-backed threat actors exploited a Chromium zero-day vulnerability (CVE-2024-7971) to target cryptocurrency firms, using a rootkit for persistent kernel-level access and malware deployment; organizations are advised to patch vulnerabilities and enhance detection capabilities.

• I briefly mentioned it last week but I decided to play a little bit with Cursor and oh boy I wasn’t disappointed! As I mentioned before i’m a developer by background, I did some coding back at university and some scripting over the years so I can read some code but it’s not like I can write a full application from scratch. The augmentation AI is bringing is just a game changer. You can ask questions, chase down bugs, ask for new features, etc. in a superfast manner. I build a new agent workflow to pull the latest list of vulnerability from the CISA KEV list and ask a couple of agents to pull more details about the CVE. You can find the results here. Let me know what you think. I might as well run this on a daily basis and send an email with the details if there is interest.