We are big fans of
By sitting real users down in front of software, and video recording them
performing tasks with soon-to-be-production software, we have learned
a great deal.
It is a cheap way to quickly learn what is hard and/or easy for people
We are also big fans of testing.
While exhaustive testing is typically practically impossible, due to the complexity of
the software, and the immensity of the range of possible inputs and internal
conditions, realistic systematic testing is very useful and possible.
We advise creation of a comprehensive testing matrix, spanning normal, error and
Testing should then consist of complete regression tests
(i.e., a comprehensive execution of all tests in the testing matrix)
scheduled at regular intervals or for major version releases
and reduced scope testing for minor version releases.