• Explore
    • Contact Us
  • Faculty
  • Research
    • Research Areas
    • Research Centers
  • Graduate Degrees
    • Computer Science Programs
    • Current Graduate Students
  • Undergraduate Degrees
  • News & Events
    • News
    • Seminar Series
    • Distinguished Lecture Series
    • Research Showcase
  • Apply Now
    • Undergraduate Admissions
    • Graduate Admissions
    • Faculty Candidates

ICS Partnership with AI2 Leads to a New Toolkit and Best Demo Paper Award

November 19, 2019

Thanks to the partnership between the Donald Bren School of Information and Computer Sciences (ICS) and the Allen Institute for Artificial Intelligence (AI2), Assistant Professor of Computer Science Sameer Singh and two ICS undergraduate students, Jens Tuyls and Junlin Wang, were part of a team awarded the Best Demo Paper at the 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP 2019). The paper, “AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models,” is a collaboration with AI2 researchers Eric Wallace, Sanjay Subramanian and Matt Gardner, and everyone was on hand at the conference in Hong Kong to receive the award.

Machine learning models for NLP have become complex, making them very difficult to understand. According to the team, this can “leave researchers and practitioners scratching their heads asking, why did my model make this prediction?”

The toolkit they’ve developed makes it easy for researchers to apply standard interpretation techniques so they can better understand what is going on inside their models. AllenNLP Interpret offers a suite of such techniques applicable to most models, APIs for developing new interpretation methods, and reusable front-end components for visualizing the interpretation results. In announcing the Best Demo Paper award, the selection commitee acknowledged that “since the need to better understand notoriously opaque neural network systems is huge, the system is likely to stimulate more research.”

The project website demonstrates the toolkit’s flexibility and utility by implementing live demos for five interpretation methods on a variety of models and tasks.

— Shani Murray

« Professor Regan and Ph.D. Student Reza Asadi Win Best Paper Award
Developing a Data Analytics Course for Low-Income High Schools »

Latest news

  • HackUCI 2021: Award-Winning Hacks from Home March 3, 2021
  • UCI Students Cultivate Culture of Innovation with New VC Fund March 3, 2021
  • Alumni Chapter’s Lunch & Learn Panel Discussion Showcases Black Superstar Leaders in ICS February 23, 2021
  • ICS Researchers Publish Novel Paper on System Design for Virtual Beings February 18, 2021
  • Professor Amiri Sani’s Research Group Wins 2020 Android Security and PrIvacy REsearch (ASPIRE) Award February 12, 2021
  • © 2021 UC Regents
  • Feedback
  • Privacy Policy