Is your feature request related to a problem?
There is currently no way to save assessment configurations like we do for llm-call configurations, limiting reusability. This is a problem because it hinders efficient assessment processes across different assessment calls or submissions.
Describe the solution you'd like
- Extend the existing Configuration & Versioning module to support assessment configuration blobs.
- Allow clients to save their entire assessment configuration with all sub-modules included.
- Ensure compatibility with pre-filter modules and assessment/feedback modules.
- Support both batch and response modes in a response agnostic manner.
Is your feature request related to a problem?
There is currently no way to save assessment configurations like we do for llm-call configurations, limiting reusability. This is a problem because it hinders efficient assessment processes across different assessment calls or submissions.
Describe the solution you'd like