What options are there when you do not find significance, despite basing your work on a solid theory?

Posted on March 25, 2012

2


In statistics, if something is significant then it means it is not likely to have happened by chance, if the data produce an insignificant  result we must accept the null hypothesis and admit that we have found absolutely nothing. But have we found nothing? Just because SPSS tells us the value of some test is under 0.whatever that apparently makes our research worthless, but thinking about what significance means in the real world, our research can still be relevant and important to other psychologists, adding to the research in that field.

But if your research is based on a solid theory, then it should probably produce statistical significance and so no significance means the researcher has two things to consider-

Firstly, you can assume that you must have made an error in data collection or analysis, overlooked outliers, errors with measures and validity, unfair population sample etc. Any number of things could affect the significance of your results. So the best thing to do would be to repeat the experiment again and hope for significance. Secondly, if after repeated experiments you still find no significance then maybe you haven’t made any errors at all, and now you should question the theory itself. Is the theory really that solid? A solid theory is a theory that is the best for now at explaining why and how something happens, but that doesn’t mean it is true. The most well known and obvious example here would be the theory of evolution, supported by a lot of evidence and makes the most sense out of any other theories for why we are here, yet it’s still only a theory and any one piece of strong opposing evidence could destroy the whole theory. A piece of research finding no significance could also disprove a solid theory, so maybe this solid theory needs to be revised or scrapped altogether as a result of your insignificant research, in which case get it published immediately!

Posted in: Uncategorized