Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Batch testing is available from source code or as a downloadable executable zipped. The format of the command to run the batch test is:
batchtesting.exe input.tsv https://YOUR-HOST.azurewebsites.net ENDPOINT-KEY out.tsv
Param | Expected Value |
---|---|
1 | name of tsv file formatted with TSV input fields |
2 | URI for endpoint, with YOUR-HOST from the Publish page of the QnA Maker portal. |
3 | ENDPOINT-KEY, found on Publish page of the QnA Maker portal. |
4 | name of tsv file created by batch test for results. |
Use the following information to understand and implement the TSV format for batch testing.
TSV input fields
TSV input file fields | Notes |
---|---|
KBID | Your KB ID found on the Publish page. |
Question | The question a user would enter. |
Metadata tags | optional |
Top parameter | optional |
Expected answer ID | optional |
TSV output fields
TSV Output file parameters | Notes |
---|---|
KBID | Your KB ID found on the Publish page. |
Question | The question as entered from the input file. |
Answer | Top answer from your knowledge base. |
Answer ID | Answer ID |
Score | Prediction score for answer. |
Metadata tags | associated with returned answer |
Expected answer ID | optional (only when expected answer ID is given) |
Judgment label | optional, values could be: correct or incorrect (only when expected answer is given) |