Thought this was an interesting graphic from the EAGLE blog post. It made me wonder if certain sampling methods have been shown to work better for certain tasks.

Does anyone know of any work looking at trends in the output token probability distribution by task type? (or similar)

Source: https://sites.google.com/view/eagle-llm

Google

EAGLE

by Yuhui Li, Fangyun Wei, Chao Zhang, and Hongyang Zhang, December 8, 2023
Vector Institute, University of Waterloo, Peking University, Microsoft Research
[Code with Apache-2.0] [EAGLE-1 Paper] [EAGLE-2 Paper]