|
Hello Everyone,
Just a reminder that today's seminar at 1:05pm will feature Professor Dimitris
Papailiopoulos, who will be presenting on "Looped
Transformers as Programmable Computers".
Feel free to read his abstract below! Like usual, it will be in room 3310 or on zoom.
Hope you can attend!
Abstract:
"In this talk, I will present an exploration of transformer networks as programmable computers, highlighting their capacity for algorithmic reasoning. I will discuss looped transformers as universal computers, demonstrating how they can be programmed with specific
weights to execute general-purpose programs. Next, I will talk about some preliminary thoughts on setting up a "Turing Machine Test" that assesses the computational abilities of frozen LLMs like GPT4, with the goal to get insights into their computational
abilities. Finally, weâll explore the emergence of algorithmic properties in LMs through the lens of simple arithmetic case studies."
Best,
Lauren Neudorf
Program Manager, MadPL Research Group
University of Wisconsin-Madison
Department of Computer Sciencesâ
(716) 704-4463
(she/her/hers)
|
![[Computer Systems Lab]](http://www.cs.wisc.edu/pics/csl_logo.gif){kind=logo}