# Common workflow language conformance test suite

The conformance tests are intended to test feature coverage of a CWL
implementation.  It uses the module "cwltool.cwltest" from the cwltool
reference implementation.

## Usage

```
$ ./run_test.sh
--- Running conformance test draft-3 on cwl-runner ---
Test [49/49]
All tests passed
```

By default, `run_test.sh` will test `cwl-runner` in $PATH against the current
stable CWL draft.

## Options

RUNNER=other-cwl-runner

The CWL implementation to be tested.

DRAFT=draft-N

The CWL draft to be tested.

-nN

Run a single specific test number N.

For example, to run conformance test 15 of draft-2 against the "cwltool"
reference implementation:

```
$ ./run_test.sh RUNNER=cwltool DRAFT=draft-2 -n15
Test [15/49]
All tests passed
```

## Notes

_NOTE_: For running on OSX systems, you'll need to install coreutils via brew. This will add to your
system some needed GNU-like tools like `greadlink`.

1. If you haven't already, install [brew](http://brew.sh/) package manager in your mac
2. Run `brew install coreutils`