Model Test Timeout
ProxAI tests models to determine availability before returning them in
px.models.list_models() or similar API calls. If a model doesn’t respond
within the timeout, it’s marked as failed.
- By default,
model_test_timeoutis 25 seconds.
If you want to set a custom timeout, you can use the model_test_timeout
parameter:
px.connect(model_test_timeout=60)This can be useful for models that take longer to initialize or slower network connections.
Last updated on