Is your feature request related to a problem?
Evaluation 2.0 runs within Kaapi, eliminating the need to wait on OpenAI for job completion. This creates an opportunity to notify external consumers immediately when an evaluation finishes, rather than having them poll for status.
Describe the solution you'd like
- Add support for an optional
callback_url parameter when triggering an evaluation run.
- Store the
callback_url alongside the evaluation run record.
- Trigger a webhook event to the provided
callback_url with the evaluation result/status payload upon completion.
Is your feature request related to a problem?
Evaluation 2.0 runs within Kaapi, eliminating the need to wait on OpenAI for job completion. This creates an opportunity to notify external consumers immediately when an evaluation finishes, rather than having them poll for status.
Describe the solution you'd like
callback_urlparameter when triggering an evaluation run.callback_urlalongside the evaluation run record.callback_urlwith the evaluation result/status payload upon completion.