Mercurial > repos > shellac > sam_consensus_v3
comparison env/lib/python3.9/site-packages/cwltool/schemas/v1.2.0-dev4/CONFORMANCE_TESTS.md @ 0:4f3585e2f14b draft default tip
"planemo upload commit 60cee0fc7c0cda8592644e1aad72851dec82c959"
| author | shellac |
|---|---|
| date | Mon, 22 Mar 2021 18:12:50 +0000 |
| parents | |
| children |
comparison
equal
deleted
inserted
replaced
| -1:000000000000 | 0:4f3585e2f14b |
|---|---|
| 1 # Common workflow language conformance test suite | |
| 2 | |
| 3 The conformance tests are intended to test feature coverage of a CWL | |
| 4 implementation. It uses the module cwltest from https://github.com/common-workflow-language/cwltest/. | |
| 5 | |
| 6 ## Usage | |
| 7 | |
| 8 ``` | |
| 9 $ ./run_test.sh | |
| 10 --- Running conformance test draft-3 on cwl-runner --- | |
| 11 Test [49/49] | |
| 12 All tests passed | |
| 13 ``` | |
| 14 | |
| 15 | |
| 16 ## Options | |
| 17 | |
| 18 RUNNER=other-cwl-runner | |
| 19 | |
| 20 The CWL implementation to be tested. | |
| 21 | |
| 22 -nN | |
| 23 | |
| 24 Run a single specific test number N. | |
| 25 | |
| 26 EXTRA=--parallel | |
| 27 | |
| 28 Extra options to pass to the CWL runner | |
| 29 | |
| 30 For example, to run conformance test 15 against the "cwltool" | |
| 31 reference implementation with `--parallel`: | |
| 32 | |
| 33 ``` | |
| 34 $ ./run_test.sh RUNNER=cwltool -n15 EXTRA=--parallel | |
| 35 Test [15/49] | |
| 36 All tests passed | |
| 37 ``` | |
| 38 | |
| 39 ## Notes | |
| 40 | |
| 41 _NOTE_: For running on OSX systems, you'll need to install coreutils via brew. This will add to your | |
| 42 system some needed GNU-like tools like `greadlink`. | |
| 43 | |
| 44 1. If you haven't already, install [brew](http://brew.sh/) package manager in your mac | |
| 45 2. Run `brew install coreutils` |