After trying various performance monitoring tools over the years, I found that Performance Co-Pilot (PCP) provides tons of useful data.

Monit is a tried-and-true monitoring daemon that is easy to deploy. Add it to OpenShift to make monitoring even easier.