help
help > HPC Help
Apr 22, 2024 05:04 PM | Collin Wilson
HPC Help
Hello,
I am an HPC analyst helping a user optimize their HPC workflow with CONN. There are two main issues:
- Their parallel configuration seems to be lauching a single core
job for each subject; this is not ideal as it puts stress on the
schedule and they end up waiting for jobs that take <10m to
complete. Can CONN jobs be configured to say launch X jobs each
with Y cores processing Z subjects?
- The output produces hundreds of thousands of files - can these
results files be consolidated somehow? Users have a file number
quota due to filesystem limitations.
Many thanks for your assistance!
Collin
Threaded View
Title | Author | Date |
---|---|---|
Collin Wilson | Apr 22, 2024 | |
Alfonso Nieto-Castanon | Apr 25, 2024 | |
Collin Wilson | Apr 26, 2024 | |
Alfonso Nieto-Castanon | Apr 27, 2024 | |
Collin Wilson | Apr 23, 2024 | |