Mattan S. Ben-Shachar

An updated version of this post  (with all the code the isn't rendered here)  can be found here>> So you've run an ANOVA and found that your residuals are neither normally distributed, nor homogeneous, or that you are in violation of any other assumptions . Naturally you want to run some a-parametric analysis... but how? In this post I will demonstrate how to run a permutation test ANOVA (easy!) and how to run bootstrap follow-up analysis (a bit more challenging) in a mixed design (both within- and between-subject factors) ANOVA. I've chosen to use a mixed design model in this demonstration for two reasons: I've never seen this done before. You can easily modify this code (change / skip some of these steps) to accommodate purely within- or purely between-subject designs. Permutation ANOVA Running a permutation test for your ANOVA in R is as easy as... running an ANOVA in R, but substituting aov with aovperm from the permuco package . library(pe...

An updated version of this post can be found here>> Much has been said about how the game of Quidditch is ruined by the scoring system - specifically how it makes no sense that the snitch is worth 150 points  and  that catching it ends the game [ 1 , 2 , 3 ]. Most of these arguments seem to revolve around the claim that it is nearly impossible to win a match of Quidditch without catching the snitch. Is this true? Let's try and answer this question formally using statistics and R simulations: What is the probability of winning a Quidditch match without catching the snitch? Victor Krum caught the snitch for Bulgaria, but Ireland still won (1994 World cup)

An updated version of this post  (with all the code the isn't rendered here)  can be found here>> Game of Chefs is an Israeli reality cooking competition show, where chefs compete for the title of "Israel's most talented chef". The show has four stages: blind auditions, training camp, kitchen battles, and finals. Here I will examine the 4th season's ( Game of Chefs: Confectioner ) inter-rater reliability in the blind auditions, using some simple R code. The Format In the blind auditions, candidates have 90 minutes to prepare a dessert, confection or other baked good, which is then sent to the show's four judges for a blind taste test. The judges don't see the candidate, and know nothing about him or her, until after they deliver their decision - A "pass" decision is signified by the judge granting the candidate a kitchen knife; a "fail" decision is signified by the judge not granting a knife. A candidate who receives a ...

An updated version of this post can be found here>> ... or how I stopped trusting standardized coefficients. Say you want to know how perceived importance of job security is related to feelings of job satisfaction. Let's also say that you suspect that this relationship might differ between Gen-X-ers and millennials with their MTV and their hip-hop. So you conduct a survey, asking 100 Gen-X-ers and 100 millennials to rank how important they think job security is when job searching and their current job satisfaction. You then plug your data into a 2-step hierarchical regression to test the moderating effect of Generation on the effect of Job Security in your favorite stats program (If you're a Gen-X-er, SPSS. If you're a millennial, or a reasonable human being, R). You find: Step 1: Term Estimate SE t Value p-value (Intercept) 4.400 0.39 11.20 <.001 Group [Millennial] 0.575 ...

An updated version of this post can be found here>> When you assume   you make an ass out of you and me. We all know the assumptions of linear regression. Or at least we think we do. I mean, we learned them at some point, right? Well - at the very least we definitely know that there are assumptions!