When a probability value is below the α level, the effect is statistically significant and the null hypothes is is rejected. However, not all statistically significant effects should be treated the sa...When a probability value is below the α level, the effect is statistically significant and the null hypothes is is rejected. However, not all statistically significant effects should be treated the same way. For example, you should have less confidence that the null hypothesis is false if p = 0.049 than p = 0.003. Thus, rejecting the null hypothesis is not an all-or-none proposition.
