我试图尽可能地简化我的问题,但仍然出现错误。
整个想法是我想执行(在更复杂的工作流程中)命令:
gmx mdrun -nt 12 -deffnm emin -cpi
在集群上。为此,我有一个带有 GROMACS 和 Snakemake 的 conda 环境。
以传统方式,我有工作脚本(
tradition_jon.sh
):
#!/bin/bash
#SBATCH --partition=uds-hub
#SBATCH --nodes=1
#SBATCH --cpus-per-task=12
#SBATCH --mem=5000
#SBATCH --time=15:00
#SBATCH --job-name=reproduce_error
#SBATCH --output=reproduce_error.o
#SBATCH --error=reproduce_error.e
gmx mdrun -nt 12 -deffnm emin -cpi
并且在
sbatch tradition_jon.sh
之后一切都按预期工作。但是,如果我尝试改用 Snakemake,问题就开始了。
我的
Snakefile
是:
rule gmx:
input:
tpr = "emin.tpr"
output:
out = 'emin.gro'
shell:
'''
gmx mdrun -nt 12 -deffnm emin -cpi
'''
我的
job.sh
:
#!/bin/bash
snakemake \
--jobs 10000 \
--verbose \
--debug-dag \
--latency-wait 50 \
--cluster-cancel scancel \
--rerun-incomplete \
--keep-going \
--cluster '
sbatch \
--partition=uds-hub \
--nodes=1 \
--cpus-per-task=12 \
--mem=5000 \
--time=15:00 \
--job-name=reproduce_error \
--output=reproduce_error.o \
--error=reproduce_error.e '
在
./job.sh
之后,GROMACS的错误(写在reproduce_error.e
上)是:
Program: gmx mdrun, version 2022.2-conda_forge
Source file: src/gromacs/taskassignment/resourcedivision.cpp (line 220)
Fatal error:
When using GPUs, setting the number of OpenMP threads without specifying the
number of ranks can lead to conflicting demands. Please specify the number of
thread-MPI ranks as well (option -ntmpi).
For more information and tips for troubleshooting, please check the GROMACS
website at http://www.gromacs.org/Documentation/Errors
我观察到在
snakemake
的输出中写了一个不同的shell(#!/bin/sh
)。但老实说,我不知道这是否是问题所在,如果是这样,我也不知道如何解决:
Jobscript:
#!/bin/sh
# properties = {"type": "single", "rule": "gmx", "local": false, "input": ["emin.tpr"], "output": ["emin.gro"], "wildcards": {}, "params": {}, "log": [], "threads": 1, "resources": {"mem_mb": 1000, "mem_mib": 954, "disk_mb": 1000, "disk_mib": 954, "tmpdir": "<TBD>"}, "jobid": 0, "cluster": {}}
cd '/home/uds_alma015/GIT/BindFlow/ideas/reproduce error' && /home/uds_alma015/.conda/envs/abfe/bin/python3.9 -m snakemake --snakefile '/home/uds_alma015/GIT/BindFlow/ideas/reproduce error/Snakefile' --target-jobs 'gmx:' --allowed-rules 'gmx' --cores 'all' --attempt 1 --force-use-threads --resources 'mem_mb=1000' 'mem_mib=954' 'disk_mb=1000' 'disk_mib=954' --wait-for-files '/home/uds_alma015/GIT/BindFlow/ideas/reproduce error/.snakemake/tmp.lfq5jq4u' 'emin.tpr' --force --keep-target-files --keep-remote --max-inventory-time 0 --nocolor --notemp --no-hooks --nolock --ignore-incomplete --rerun-triggers 'software-env' 'params' 'input' 'mtime' 'code' --skip-script-cleanup --conda-frontend 'mamba' --wrapper-prefix 'https://github.com/snakemake/snakemake-wrappers/raw/' --latency-wait 50 --scheduler 'ilp' --scheduler-solver-path '/home/uds_alma015/.conda/envs/abfe/bin' --default-resources 'mem_mb=max(2*input.size_mb, 1000)' 'disk_mb=max(2*input.size_mb, 1000)' 'tmpdir=system_tmpdir' --mode 2 && touch '/home/uds_alma015/GIT/BindFlow/ideas/reproduce error/.snakemake/tmp.lfq5jq4u/0.jobfinished' || (touch '/home/uds_alma015/GIT/BindFlow/ideas/reproduce error/.snakemake/tmp.lfq5jq4u/0.jobfailed'; exit 1)
附言ChatGPT 围绕这个问题展开讨论 :-)