Oossa

Amazon SageMaker adds custom sequence lengths to serverless fine‑tuning

SageMaker AI now lets users set token limits up to 16K when fine‑tuning open‑weight models in serverless jobs.

NoteBy Published by Oossa: 1 min read

Amazon SageMaker AI announced that its serverless model customization jobs can now accept user‑defined sequence lengths. Previously the jobs ran with a fixed token count. Users can now set dataset_max_len for SFT and DPO jobs, or max_prompt_length and max_response_length for RFT jobs, up to the model’s published maximum—often 16,000 tokens. The feature is live in US East (N. Virginia), US West (Oregon), Asia Pacific (Tokyo) and Europe (Ireland).

Why it matters

Developers can fine‑tune large language models on longer documents without writing custom training code.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.