Why is My Policy Sending Me Emails But Not Taking Action on Content/Users/Apps?

In order to automate the actions you'd like to take on your policies, you need to set up automatic remediation. See our policy setup guide here.