Changed from bug to feature request. The UI for this was always rough and not something intended to be universally useful. Could certainly be improved, but we are not trying to claim that this can work for absolutely any kind of permission.