wordpress blog stats
Connect with us

Hi, what are you looking for?

, ,

Microsoft Announces Automation of Risk Identification Process for Generative AI Systems

Automating AI red teaming is now a reality with Microsoft’s PyRIT, ensuring a more secure AI future.

Microsoft has introduced a new framework called PyRIT (Python Risk Identification Toolkit for generative AI) for the automation of red teaming processes or finding risks in generative AI systems, according to a blogpost by the company on February 22, 2024. Red teaming refers to a structured process of testing AI systems to find “flaws and vulnerabilities” in order to discover and manage the risks posed by generative AI. While PyRIT will not replace manual red teaming of GenAI systems, Microsoft says the toolkit will assist an AI red teamer by automating tedious tasks and help expand the engineer’s domain expertise. “PyRIT shines light on the hot spots of where the risk could be, which the security professional can then incisively explore. The security professional is always in control of the strategy and execution of the AI red team operation, and PyRIT provides the automation code to take the initial dataset of harmful prompts provided by the security professional, then uses the LLM endpoint to generate more harmful prompts,” the blog stated. Why is Microsoft automating its AI red teaming process? 1. Identifying security and responsible AI risks: Unlike traditional or classical AI systems, generative AI systems present both security as well as responsible AI risks, Microsoft informed. Responsible AI risks vary widely and mainly relate to biased output, inaccurate content, or misinformation. 2. Generative AI systems have layers of non-determinism: This means generative AI can generate different outputs for same input for varied technical reasons. The company has learned that…

Please subscribe/login to read the full story.
Written By

Curious about the intersection of technology with education, caste and welfare rights. For story tips, please feel free to reach out at sarasvati@medianama.com

Free Reads

News

The ‘Reforming Intelligence and Securing America Act’ (RISAA) is a legislation to reauthorize Section 702 of the Foreign Intelligence Surveillance Act (FISA).

News

In its submission, the Interior Ministry said the decision to impose a ban was "made in the interest of upholding national security, maintaining public...

News

Among other things, the security requirements include data encryption and regular review and updated access permissions to reflect personnel changes.

MediaNama’s mission is to help build a digital ecosystem which is open, fair, global and competitive.

Views

News

NPCI CEO Dilip Asbe recently said that what is not written in regulations is a no-go for fintech entities. But following this advice could...

News

Notably, Indus Appstore will allow app developers to use third-party billing systems for in-app billing without having to pay any commission to Indus, a...

News

The existing commission-based model, which companies like Uber and Ola have used for a long time and still stick to, has received criticism from...

News

Factors like Indus not charging developers any commission for in-app payments and antitrust orders issued by India's competition regulator against Google could contribute to...

News

Is open-sourcing of AI, and the use cases that come with it, a good starting point to discuss the responsibility and liability of AI?...

You May Also Like

News

Google has released a Google Travel Trends Report which states that branded budget hotel search queries grew 179% year over year (YOY) in India, in...

Advert

135 job openings in over 60 companies are listed at our free Digital and Mobile Job Board: If you’re looking for a job, or...

News

By Aroon Deep and Aditya Chunduru You’re reading it here first: Twitter has complied with government requests to censor 52 tweets that mostly criticised...

News

Rajesh Kumar* doesn’t have many enemies in life. But, Uber, for which he drives a cab everyday, is starting to look like one, he...

MediaNama is the premier source of information and analysis on Technology Policy in India. More about MediaNama, and contact information, here.

© 2008-2021 Mixed Bag Media Pvt. Ltd. Developed By PixelVJ

Subscribe to our daily newsletter
Name:*
Your email address:*
*
Please enter all required fields Click to hide
Correct invalid entries Click to hide

© 2008-2021 Mixed Bag Media Pvt. Ltd. Developed By PixelVJ