Tag: transformers

All the articles with the tag "transformers".

• HuggingFace's greedy decoding isn't always greedy

  11 Jul, 2026

  My inference engine diverged from HF generate() at token 3. Three independent forward passes outvoted the wrapper. The bug was a repetition penalty shipped in the checkpoint's generation_config, applied even under do_sample=False.