AI Risk Management leader Robust Intelligence and the Kelley School of Business Data Science and AI Lab (DSAIL), in collaboration with MITRE, have partnered on a database that logs risks among open source AI models.
DSAIL is an interdisciplinary group of doctoral, master’s, and undergraduate students from various majors at Indiana University that focuses on developing practical data science and AI-enabled analytics methods and systems for societally relevant applications, particularly in cybersecurity, mental health, and business intelligence. DSAIL is focused on training students in data science research processes for relevant application areas and serving as a resource for Kelley, IU, and firms to make a positive societal impact.
Thanks to a generous gift from Robust Intelligence in Summer 2023, DSAIL undergraduate students and Robust Intelligence embarked on a partnership to begin collecting open-source AI models from Hugging Face and assessing their source code for vulnerabilities, aiming to address the growing importance of AI risk management.
Sagar Samtani
The partnership’s research outcomes were integrated into the AI Risk Database, a system that provides capabilities for organizations to search, sort, and browse risks associated with AI models. The research results were published in IEEE Intelligence and Security Informatics (ISI) and presented at DEFCON AI Village. Additionally, the students contributed to a White Paper to be part of NIST’s AI Risk Management Framework. Collaborations like this and others can significantly impact the fields of AI ethics and security.
Sagar Samtani, associate professor of Information Systems and the director of the lab, emphasizes core values such as integrity, work ethic, teamwork, service, problem-solving, critical thinking, accountability, curiosity, passion, diversity, respect, and perseverance.
As the school’s first recipient of a prestigious CAREER Award from the National Science Foundation and the principal investigator on the research project the award supports, Sagar understands the importance of collaboration with organizations to advance AI ethics and security.
“These projects aim to develop integrated AI-enabled analytics research and education around important topics in cyber threat intelligence, including modeling adversarial behaviors, vulnerability management, and open-source software security, ” Samtani said.
