• Explore
    • Contact Us
  • Faculty
  • Research
    • Research Areas
    • Research Centers
  • Graduate Degrees
    • Computer Science Programs
    • Current Graduate Students
  • Undergraduate Degrees
  • News & Events
    • News
    • Seminar Series
    • Distinguished Lecture Series
    • Research Showcase
  • Apply Now
    • Undergraduate Admissions
    • Graduate Admissions
    • Faculty Candidates

Machine Learning Street Talk Podcast: “NLP Benchmarks & ML DevOps Interoperability With Yasaman Razeghi and Prof. Sameer Singh”

April 8, 2022

This week we speak with Yasaman Razeghi and Prof. Sameer Singh from UC Irvine. Yasaman recently published a paper called “Impact of Pretraining Term Frequencies on Few-Shot Reasoning” where she demonstrated comprehensively that large language models only perform well on reasoning tasks because they memorize the dataset. For the first time she showed the accuracy was linearly correlated to the occurrence rate in the training corpus, something which OpenAI should have done in the first place!

We also speak with Sameer who has been a pioneering force in the area of machine learning interpretability for many years now, he created LIME with Marco Riberio and also had his hands all over the famous Checklist paper and many others.

We also get into the metric obsession in the NLP world and whether metrics are one of the principal reasons why we are failing to make any progress in NLU.

Watch the podcast on YouTube or listen to it on Anchor.

« ICS Graduate Programs in Statistics and Computer Science Among Top 20 for Public Universities
ICS Researchers Win Best Paper Award at Eurosys 2022 »

Latest news

  • Identifying the Building Blocks of Attention in Deep Learning March 21, 2023
  • Faculty Spotlight: Jennifer Wong-Ma and the Power of Community March 20, 2023
  • Computer Science Ph.D. Candidate Takami Sato Named Public Impact Fellow March 14, 2023
  • Irani Builds New Collaborations as Associate Director of the Simons Institute March 6, 2023
  • UC Irvine Partners With Linux Foundation to Welcome New Open Source Projects from Peraton Labs to Scale 5G Security March 3, 2023
  • © 2023 UC Regents
  • Feedback
  • Privacy Policy