Children from the wealthiest backgrounds are three times more likely to take music classes out of school hours than those from the poorest families and there is a 20 percent participation gap in sport, new research shows.