One of the features of RHQ 4 (I think it was hidden in RHQ 3 already) is alerting on Call time data (aka Response time data). This code was contributed by Frank Brüseke quite some time ago (thanks again, Frank).
By default that feature is hidden (inRHQ 3 only; RHQ 4 has it enabled by default), so you first have to enable it in the system settings:
System settings
Now (and don't forget to enable the gathering of call time data) when you go to a resource that has calltime data (e.g. stateless session beans or web apps), you can define alerts on call time data. In the first step, you select one of the two available options:
Add alert condition
Here you can select crossing/matching of a threshold or change of a calltime value. In the last step you need to provide the call time entry to check and some reference values:
Select condition values and comparator
In the last section you can also give a regular expression on what to alert; this allows you limit e.g. the methods that will be checked for SLSBs or the URLs for web applications.
As always: please provide feedback. When the feedback is positive, we may un-hide this feature for future versions of RHQ.