Next week's seminar will feature
Professor Dimitris Papailiopoulos, who will be presenting on "Looped
Transformers as Programmable Computers"
Feel free to read his abstract below! Like usual, it will be in room 3310 at 1:05pm or on
zoom.
Hope you can attend!
Abstract:
"In this talk, I will present an exploration of transformer networks as programmable computers, highlighting their capacity for algorithmic reasoning. I will discuss looped transformers as universal computers, demonstrating how they can be programmed with specific
weights to execute general-purpose programs. Next, I will talk about some preliminary thoughts on setting up a "Turing Machine Test" that assesses the computational abilities of frozen LLMs like GPT4, with the goal to get insights into their computational
abilities. Finally, weâll explore the emergence of algorithmic properties in LMs through the lens of simple arithmetic case studies."
Best,
![[Computer Systems Lab]](http://www.cs.wisc.edu/pics/csl_logo.gif){kind=logo}