#016 - Cyber AI Chronicle - AI Governance Principles

PRESENTED BY

Cyber AI Chronicle

By Simon Ganiere · 21^st April 2024

Welcome back!

Project Overwatch is a cutting-edge newsletter at the intersection of cybersecurity, AI, technology, and resilience, designed to navigate the complexities of our rapidly evolving digital landscape. It delivers insightful analysis and actionable intelligence, empowering you to stay ahead in a world where staying informed is not just an option, but a necessity.

Table of Contents

• What I learned this week

  • TL;DR

  • Key AI Governance Principles

• Worth a full read

  • Simple Adaptive Attacks

    • Key Takeaway

  • Is it safe to let my employees login with Google?

    • Key Takeaway

• Some more reading

• Wisdom of the week

• Contact

What I learned this week

TL;DR

• The total cost of a successful ransomware attack is often underestimated (and under-reported). UnitedHealth reported this week an initial financial loss of $872 millions and a total direct cost estimated at more than $1 billion. This is not even counting the long-cost tail: legal, possible fines, loss of revenue, etc. All of this despite them allegedly paying the ransom…and the data still being available on ransomware platform…so they might have to deal with a second wave of problems. Playing out those scenarios fully is complicated but it's worth planning for the worst case scenarios.

• In the Adversarial Machine Learning space, an interesting research paper about adaptive attack against LLMs. By combining manual prompt engineering, automated optimisation technic and leveraging any available information or capabilities an attacker is able to achieve near 100% success rates in jailbreaking even the most safety-aligned LLMS. As usual with cyber security, the ability to keep pace with the progress of the technology and the progress of the hacking techniques is a key success factor.

• This week we are still learning on AI Governance. I have reviewed and summarise a list of 10 key AI principles. The objective is to understand the underlying principles that define the minimum baseline for AI system.