You can access the "Configure Apache RLimits" interface in WHM here:
WHM » Service Configuration » Apache Configuration » Memory Usage Restrictions
To learn how to modify the directive visit Apache's official documentation here:
How to Configure Apache's RLimits Directive from the WHM Interface
