“Why don’t you get a job?” – that was the immediate question an elderly Indian man in Loughborough asked me last week as I hurried through the town centre clad in my saffron robes.