@@ -394,6 +394,7 @@ The test content depends on the used test method.
## Compile Test
The compile test do not need a test content (therefore the test content will be ignored).
## Black Box Test
...
...
@@ -401,11 +402,15 @@ Test content is an array of strings, every line is trimmed to remove the trailin
If the first line with text starts with a '**$**' sign then the following text in this string are the console arguments that should be injected when the user program is called (escaping is the via "..." like in the normal shell/cmd).
* A line starting with a '**<**' in meant to be written to the user programs stdin (input stream) all whitespaces before the first and after the last character will be removed (trimmed).
* A line starting with a '**>**' is expected to be outputted from the users program (stdout, output stream) all whitespaces before the first and after the last character will be removed (trimmed).
* A line containing just a '**\***' is used as a wildcard that matches every output
* A line containing just '**EOT**' indicates the end of the test (written after the program terminated) use this to separate output that was written after the test ended... (empty test --> program should output nothing)
* A line starting with '**error:**' is output from the error stream (this can be used as debug but will also contain exceptions)
* The first line starting with '**exit**' is interpreted as the expected program exit code (the following integer number). If the following text is not a number then the exit code is not checked.
**Note**: Both **exit** and **$** can slow down testing because we need two full iterations through the test content to check if there are lines with these starting strings (**$** needs to be the first line (the first line with text) the performance impact is not that big as **exit**).
**All other lines are ignored.**
...
...
@@ -489,6 +494,7 @@ The Runner needs to return result code to indicate the result of the test run.
***4** - memory limit hit
***5** - disk limit hit
***50** - compile error
***51** - test content read timeout
***100** - some error occurred before or after executing the users program
