Skip to content

[MOSH-2320]: Update API docs for worker number exposure#240

Merged
jli-together merged 2 commits intomainfrom
jli/eval-worker
Apr 10, 2026
Merged

[MOSH-2320]: Update API docs for worker number exposure#240
jli-together merged 2 commits intomainfrom
jli/eval-worker

Conversation

@jli-together
Copy link
Copy Markdown
Contributor

@jli-together jli-together commented Apr 9, 2026

@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 9, 2026

✱ Stainless preview builds

This PR will update the togetherai SDKs with the following commit messages.

go

feat(api): add num_workers parameter to eval evaluation parameters

openapi

feat(api): add num_workers field to evaluation models

python

feat(api): add num_workers parameter to eval create parameters

terraform

chore(internal): regenerate SDK with no functional changes

typescript

feat(api): add num_workers parameter to evals model/judge requests
togetherai-openapi studio · code

Your SDK build had at least one "note" diagnostic.
generate ✅

⚠️ togetherai-python studio · code

Your SDK build had a failure in the lint CI job, which is a regression from the base state.
generate ⚠️build ✅lint ❗test ⏭️

pip install https://pkg.stainless.com/s/togetherai-python/76ffcacd3dcd8af7de0d09232230e6ea322343ec/together-2.7.0-py3-none-any.whl
togetherai-go studio · code

Your SDK build had at least one "note" diagnostic.
generate ✅build ⏭️lint ✅test ✅

go get github.com/stainless-sdks/togetherai-go@d061b9da29801d5f77ceaa4572868615af9ae285
⚠️ togetherai-typescript studio · code

Your SDK build had at least one "warning" diagnostic.
generate ⚠️build ✅lint ✅test ✅

npm install https://pkg.stainless.com/s/togetherai-typescript/c61a7c1cc7eafa0913d853e993992961cc38ebaf/dist.tar.gz
togetherai-terraform studio · code

Your SDK build had at least one "note" diagnostic.
generate ✅lint ✅test ✅


This comment is auto-generated by GitHub Actions and is automatically kept up to date as you push.
If you push custom code to the preview branch, re-run this workflow to update the comment.
Last updated: 2026-04-10 17:17:56 UTC

openapi.yaml Outdated
type: integer
minimum: 1
description: "Number of concurrent workers for inference requests. Overrides the default concurrency for this model. Useful for tuning throughput when using proxy endpoints (e.g. OpenRouter) or rate-limited external APIs."
example: 9
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the examples are a bit weird, maybe we can just say 5

@jli-together jli-together merged commit 24843d3 into main Apr 10, 2026
3 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants