Currently, the /evaluate response definition is under-documented and under-defined. In Lambda Feedback, we require multiple formats for the same feedback, and it is unclear how this should be returned.
For example, in Lambda Feedback with the pre-submission feedback, we return:
responseSympy: x+y responseLatex: x+y
How should this be handled?
The current response example:
[ { "feedbackId": "fb-1", "title": "Clarify your definition", "message": "Your explanation of polymorphism is generally correct, but it would help to distinguish between subtype polymorphism and parametric polymorphism.", "suggestedAction": "Add one or two concrete examples of polymorphism in Java, e.g., method overriding.", "awardedPoints": 2.5, "criterion": { "criterionId": "crit-1", "name": "Correctness", "context": "The solution produces correct results for the specified problem.", "maxPoints": 10 }, "target": { "artefactType": "TEXT", "format": "plain", "locator": { "type": "span", "startIndex": 0, "endIndex": 120 } } }, ]
Currently, the
/evaluateresponse definition is under-documented and under-defined. In Lambda Feedback, we require multiple formats for the same feedback, and it is unclear how this should be returned.For example, in Lambda Feedback with the pre-submission feedback, we return:
responseSympy: x+y responseLatex: x+yHow should this be handled?
The current response example:
[ { "feedbackId": "fb-1", "title": "Clarify your definition", "message": "Your explanation of polymorphism is generally correct, but it would help to distinguish between subtype polymorphism and parametric polymorphism.", "suggestedAction": "Add one or two concrete examples of polymorphism in Java, e.g., method overriding.", "awardedPoints": 2.5, "criterion": { "criterionId": "crit-1", "name": "Correctness", "context": "The solution produces correct results for the specified problem.", "maxPoints": 10 }, "target": { "artefactType": "TEXT", "format": "plain", "locator": { "type": "span", "startIndex": 0, "endIndex": 120 } } }, ]