evalp should have an option to run only for new jobs?
I found it useful to have evalp running only for jobs for which solutions_pvalues.csv has not been yet generated. It is useful when I want to run it only for new jobs and avoid sometimes lengthy re-calculation of all other jobs. Of course, sometimes I do want to recalculate all p-values, so this should be an option.
For now I did it by copying the script and changing the appropriate lines to:
[ -f solutions_pvalues.csv ] || Rscript $PVALUE_SCRIPT solutions.csv cam_score;
[ -f solutions_pvalues.csv ] || python $HISTOGRAM_SCRIPT solutions.csv histogram.png;
but this would never re-calculate the p-values, even if user wants.
Edited by Jan Kosinski