I was just reading an article entitled Testing for Performance. In the sidebar the editor pulled out this quote. "When modeling, remember that not all performance testing is focused on the end-user response times. Sometimes there are better measures than end-user response time."
I'll have to say that I (almost violently) object to this statement. There is nothing more important than the end-users time and if you're not focused on that than you are doing your clients a disservice. In my books, end-user experience is king and if there is anything that will destroy the user experience it is poor response times. IMHO, your goal is to waste as little of the users time as is possible given your hardware/budget constraints.
Hi Kirk, I strongly object to your "violent" objection. You seem to miss
the point that there our trade offs to be made and focusing solely on the
end user response time can result in the team losing site of the
scalability requirements of the application. XPE and SPE recognize this and
also recognize that you cannot please all the users all the time. You need
to balance the needs of many different parties and user groups. It would be
silly and naive to attempt to reduce every single use case response time as
each tune-up could have the potential to invalidate previous gains and you
would be in a endless loop. Have you every considered (or seen) cases were
the speedy execution of one particular use case has a negative knock on
effect to others executing concurrently or shortly thereafter. The focus is
still on the end user response times but in an responsible and intelligent
manner.
Hi William,
Hi all,
I agree in general that response time is king. I remember that I've seen a
slide by Google where they said that a a few hundred milliseconds cost them
20% (or so) page clicks.