[right, so it's not a hard problem to solve, but it involves a data structure different from the norm of the huggingface library -- although note the library does already support ragged evaluation [the beam code