Hi all
I am really new into REANA, so it could be that my following question is very basic.
I am trying to create a very simple workflow in yadage following this tutorial [1] but I am getting an error that I dont understand. If it is worth mentioning, with simple workflow syntax another test job run perfectly [2].
This is the content of my reana.yml:
version: 0.7.2
inputs:
files:
- scripts/steps.yaml
- scripts/workflow.yaml
workflow:
type: yadage
file: scripts/workflow.yaml
My script/workflow.yaml is:
stages:
- name: runNano
dependencies: [init]
scheduler:
scheduler_type: singlestep-stage
parameters:
maxEvents: '1000'
#maxEvents: {step: init, output: '1000'}
outputFile: '{workdir}/output_simulation.root'
step: {$ref: 'scripts/steps.yaml#/runNano'}
and my scripts/steps.yaml is:
runNano:
process:
process_type: 'interpolated-script-cmd'
interpreter: bash
script: |
source /opt/cms/cmsset_default.sh
cd /home/cmsusr/CMSSW_5_3_32/src/
eval `scramv1 runtime -sh`
cmsRun Analyzer/AOD2NanoAOD/configs/simulation_cfg.py maxEvents={maxEvents} outputFile={outputFile}
environment:
environment_type: 'docker-encapsulated'
image: gitlab-registry.cern.ch/algomez/cms-open-data
imagetag: master
publisher:
publisher_type: iterpolated-pub
publish:
outputFile: '{outputFile}'
and this is the error that I am getting when I try to run reana-client create -w opendatatest:
Cannot create workflow opendatatest:
{'scheduler_type': 'singlestep-stage', 'parameters': [{'key': 'maxEvents', 'value': '1000'}, {'key': 'outputFile', 'value': '{workdir}/output_simulation.root'}], 'step': {'process': {'process_type': 'interpolated-script-cmd', 'interpreter': 'bash', 'script': 'source /opt/cms/cmsset_default.sh\ncd /home/cmsusr/CMSSW_5_3_32/src/\neval `scramv1 runtime -sh`\ncmsRun Analyzer/AOD2NanoAOD/configs/simulation_cfg.py maxEvents={maxEvents} outputFile={outputFile}\n'}, 'environment': {'environment_type': 'docker-encapsulated', 'image': 'gitlab-registry.cern.ch/algomez/cms-open-data', 'imagetag': 'master', 'resources': [], 'envscript': '', 'env': {}, 'workdir': None, 'par_mounts': []}, 'publisher': {'publisher_type': 'iterpolated-pub', 'publish': {'outputFile': '{outputFile}'}}}} is not valid under any of the given schemas
Failed validating 'oneOf' in schema['properties']['stages']['items']['properties']['scheduler']:
{'oneOf': [{'$ref': 'scheduler/singlestep-stage-schema.json#'},
{'$ref': 'scheduler/multistep-stage-schema.json#'},
{'$ref': 'scheduler/jq-stage-schema.json#'}],
'type': 'object'}
On instance['stages'][0]['scheduler']:
{'parameters': [{'key': 'maxEvents', 'value': '1000'},
{'key': 'outputFile',
'value': '{workdir}/output_simulation.root'}],
'scheduler_type': 'singlestep-stage',
'step': {'environment': {'env': {},
'environment_type': 'docker-encapsulated',
'envscript': '',
'image': 'gitlab-registry.cern.ch/algomez/cms-open-data',
'imagetag': 'master',
'par_mounts': [],
'resources': [],
'workdir': None},
'process': {'interpreter': 'bash',
'process_type': 'interpolated-script-cmd',
'script': 'source /opt/cms/cmsset_default.sh\n'
'cd /home/cmsusr/CMSSW_5_3_32/src/\n'
'eval `scramv1 runtime -sh`\n'
'cmsRun '
'Analyzer/AOD2NanoAOD/configs/simulation_cfg.py '
'maxEvents={maxEvents} '
'outputFile={outputFile}\n'},
'publisher': {'publish': {'outputFile': '{outputFile}'},
'publisher_type': 'iterpolated-pub'}}}
Failed validating 'oneOf' in schema['properties']['stages']['items']['properties']['scheduler']:
{'oneOf': [{'$ref': 'scheduler/singlestep-stage-schema.json#'},
{'$ref': 'scheduler/multistep-stage-schema.json#'},
{'$ref': 'scheduler/jq-stage-schema.json#'}],
'type': 'object'}
On instance['stages'][0]['scheduler']:
{'parameters': [{'key': 'maxEvents', 'value': '1000'},
{'key': 'outputFile',
'value': '{workdir}/output_simulation.root'}],
'scheduler_type': 'singlestep-stage',
'step': {'environment': {'env': {},
'environment_type': 'docker-encapsulated',
'envscript': '',
'image': 'gitlab-registry.cern.ch/algomez/cms-open-data',
'imagetag': 'master',
'par_mounts': [],
'resources': [],
'workdir': None},
'process': {'interpreter': 'bash',
'process_type': 'interpolated-script-cmd',
'script': 'source /opt/cms/cmsset_default.sh\n'
'cd /home/cmsusr/CMSSW_5_3_32/src/\n'
'eval `scramv1 runtime -sh`\n'
'cmsRun '
'Analyzer/AOD2NanoAOD/configs/simulation_cfg.py '
'maxEvents={maxEvents} '
'outputFile={outputFile}\n'},
'publisher': {'publish': {'outputFile': '{outputFile}'},
'publisher_type': 'iterpolated-pub'}}}
Do you have any suggestion on what am I doing wrong?
Thanks a lot for the help.
cheers,
[1] Reproducible analyses
[2] REANA