TokenTour: Tracing LLM Conversations from Messages to Tokens and KV Cache

Liwen Fan (School of Data Science, Fudan Universiy), Yu Zhang (Department of Computer Science, University of Oxford), Yuheng Zhao (School of Data Science, Fudan Univerisity), Siming Chen (School of Data Science, Fudan University)