#033 - Cyber AI Chronicle - Threats Scenarios Against Copilot

PRESENTED BY

Cyber AI Chronicle

By Simon Ganiere · 1^st September 2024

Welcome back!

Project Overwatch is a cutting-edge newsletter at the intersection of cybersecurity, AI, technology, and resilience, designed to navigate the complexities of our rapidly evolving digital landscape. It delivers insightful analysis and actionable intelligence, empowering you to stay ahead in a world where staying informed is not just an option, but a necessity.

Table of Contents

• What I learned this week

  • TL;DR

• Copilot Threat Scenarios

  • Spear Phishing with AI Assistance

  • Indirect Prompt Injection (IPI)

  • Retrieval-Augmented Generation (RAG) Poisoning

  • ConfusedPilot Attacks

  • Remote Code Execution (RCE) via Copilot

  • Transient Access Control Failures

  • Automated Misinformation and Disinformation

• Worth a full read

  • Lakera - GenAI Security Readiness Report 2024

    • Key Takeaway

  • Automation Should Be Like Iron Man, Not Ultron

    • Key Takeaway

• Research Report

  • Personhood credentials: Artificial intelligence an …

• Wisdom of the week

• Contact

What I learned this week

TL;DR

• In this last installment of our miniseries, we examine the potential risks associated with Microsoft Copilot. Learn about the different ways attackers could exploit Copilot to gain unauthorized access, distribute misinformation, and perform harmful actions. This article underscores the importance of robust access controls, real-time monitoring, and ethical AI considerations in mitigating these threats » READ MORE

• A joint report from CISA, the FBI and DOD cybercrime division, highlight the continue stream of attack from Iran-based cyber actors known as Pioneer Kitten (or UNC757 or Rubidium or Lemon Sandstorm) has successfully created different persons on the criminal underground which is reselling access to affiliate of known ransomware groups such as Alpha, NoEscape or RansomHouse. This blur the line between nation states groups and the cyber criminal potentially raising some interesting questions.

• The recent Google Chrome zero-day have been attributed to a hacking group named Citrine Sleet linked to the North Korean government. Microsoft provided more information in a detailed report.

• An interesting article from Netcraft on the use of GenAI to create content for fraudulent websites. No big surprise here if you ask me as I have mentioned multiple time that social engineering and scamming will be the first threats to get the GenAI augmentation.

• I had no time to do more coding recently, but a new tool named Cursor seems to be gaining traction. Definitely something to check out.