sdm-help-list > Don't see Jackknife Analysis option
Showing 1-5 of 5 posts
Display:
Results per page:
Jul 13, 2023  01:07 PM | Jonah Shepherd - Fresno State
Don't see Jackknife Analysis option

Hello everyone,


I do not see the checkbox/option to perform a jackknife sensitivity analysis in the SDM version 6.22 for Windows 64 anywhere. 

Jul 26, 2023  09:07 AM | Lydia Fortea - Instituto de Investigaciones Biomédicas August Pi i Sunyer (IDIBAPS)
RE: Don't see Jackknife Analysis option

Hello, 


The new software SDM-PSI has no option for the jackknife analysis. However, you can conduct it by adding a new column per study where the study has a 0 value and the rest 1 in the sdm_table. Then you perform a meta-regression of every column.


 


Best,


Lydia

Jan 16, 2025  06:01 PM | Bryn Evohr
RE: Don't see Jackknife Analysis option

Hi Lydia,


I attempted to follow these instructions to conduct a jackknife analysis, creating the number of columns as I have studies with all 1s and a 0 for each study. However, I can only enter 4 variables into the meta-regression at a time and I have more studies than that in the meta-analysis. Is there a way to conduct this jackknife analysis at once, or do I need to perform a separate meta-regression for each study, or each batch of 4 studies? Thank you for your assistance!


Best,


Bryn

Feb 17, 2025  10:02 AM | Lydia Fortea - Instituto de Investigaciones Biomédicas August Pi i Sunyer (IDIBAPS)
RE: Don't see Jackknife Analysis option

Dear Bryn, 


You should conduct the meta-regressions separately for each study and then compare whether the results remain consistent across meta-regressions.


Best,


Lydia

Mar 7, 2025  07:03 PM | Orsi Lanyi
RE: Don't see Jackknife Analysis option

Hello Lydia,


I'm trying to run a jackknife sensitivity analysis by implementing multiple linear models, as per your suggestion above. I've set up dummy variables for each article, where all articles are coded as 1 except for the excluded study, which is coded as 0.


However, I have some questions regarding how to properly run and interpret the analysis:
1. Should I define a model and hypothesis, or use these variables as filters in the linear model?



  • I tried running the analysis by selecting the variable (e.g. study_1_excluded) as a model predictor and setting the hypothesis to 1 (as per the GUI baseline recommendation). However, this resulted in an error: "ERROR: matrix is singular Default GSL error handler invoked"

  • If this error is due to the lack of variance in the dummy variable (since only one study differs) how should I run the Leave-one-out analysis?

  • Should I instead use the filter variable option in the GUI instead?


2. Could you please elaborate on how the linear model is calculated in this specific case?



  • Since only one study has a different value, does the model still perform the regression at each voxel?

  • How does SDM calculate the voxel-wise slope (β1eta_1) when one group consists of just one study?


3. Interpreting the Results:



  • What does a significant β1eta_1 coefficient indicate in this context?

  • If a voxel has a large β1eta_1, should I conclude that the omitted study strongly influenced that region?

  • Would it be better to compare the intercept maps (across different LOO runs) instead of focusing on the slopes?


I appreciate any guidance you can provide on best practices for running LOO sensitivity analysis using meta-regression in SDM.


I used the SDM Linux version: v6.21
Thank you so much!