Rather than deserting him in droves, the comedian has seen a boom in both his X and Instagram followers since making the controversial joke.