when they ask to roll

Well there is your problem. Players shouldn’t be asking for rolls, DMs tell players what rolls are needed so they can describe the scene playing out based on them.