Gives a single extension point for per-call context (positions, sequence IDs, masks) as multi-sequence batching grows, without having to churn every model's Forward signature again.
Gives a single extension point for per-call context (positions, sequence IDs, masks) as multi-sequence batching grows, without having to churn every model's Forward signature again.