Setup -> Support -> Escalation Rules
I do most of my alerting through there, no 3rd party plugins or such. For example:
Department: Managed Support
Status: Open
Priority: High
Time Elapsed: 5 minutes
-> Notify Admins: Pagerduty
I have added an Administrator called Pagerduty with my...