comparison env/lib/python3.9/site-packages/cwltool/schemas/v1.2.0-dev4/CONFORMANCE_TESTS.md @ 0:4f3585e2f14b draft default tip

"planemo upload commit 60cee0fc7c0cda8592644e1aad72851dec82c959"
author shellac
date Mon, 22 Mar 2021 18:12:50 +0000
parents
children
comparison
equal deleted inserted replaced
-1:000000000000 0:4f3585e2f14b
1 # Common workflow language conformance test suite
2
3 The conformance tests are intended to test feature coverage of a CWL
4 implementation. It uses the module cwltest from https://github.com/common-workflow-language/cwltest/.
5
6 ## Usage
7
8 ```
9 $ ./run_test.sh
10 --- Running conformance test draft-3 on cwl-runner ---
11 Test [49/49]
12 All tests passed
13 ```
14
15
16 ## Options
17
18 RUNNER=other-cwl-runner
19
20 The CWL implementation to be tested.
21
22 -nN
23
24 Run a single specific test number N.
25
26 EXTRA=--parallel
27
28 Extra options to pass to the CWL runner
29
30 For example, to run conformance test 15 against the "cwltool"
31 reference implementation with `--parallel`:
32
33 ```
34 $ ./run_test.sh RUNNER=cwltool -n15 EXTRA=--parallel
35 Test [15/49]
36 All tests passed
37 ```
38
39 ## Notes
40
41 _NOTE_: For running on OSX systems, you'll need to install coreutils via brew. This will add to your
42 system some needed GNU-like tools like `greadlink`.
43
44 1. If you haven't already, install [brew](http://brew.sh/) package manager in your mac
45 2. Run `brew install coreutils`