help > HPC Help
Apr 22, 2024  05:04 PM | Collin Wilson
HPC Help

Hello,


I am an HPC analyst helping a user optimize their HPC workflow with CONN. There are two main issues:



  1. Their parallel configuration seems to be lauching a single core job for each subject; this is not ideal as it puts stress on the schedule and they end up waiting for jobs that take <10m to complete. Can CONN jobs be configured to say launch X jobs each with Y cores processing Z subjects?
  2. The output produces hundreds of thousands of files - can these results files be consolidated somehow? Users have a file number quota due to filesystem limitations.

Many thanks for your assistance!


Collin

Threaded View

TitleAuthorDate
HPC Help
Collin Wilson Apr 22, 2024
Alfonso Nieto-Castanon Apr 25, 2024
Collin Wilson Apr 26, 2024
Alfonso Nieto-Castanon Apr 27, 2024
Collin Wilson Apr 23, 2024