Skip to content

Test results of BAT #6

Description

@apple-yinhan

I found that for BAT, the perception part has valid scores but reasoning part is 0.00

I wonder why? Because BAT is never trained with MCQA, so it can not generate valid answers, therefore it would always be 0.00, how can you get valid numbers for BAT?

Thanks.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions