February 6, Novell Inc.
Let's Start
Make it a requirement that software come with a manifest
declaring all the files it loads, reads, modifies & executes
including version dependencies, please...
identifying all the network ports it opens or listens on
and what it's doing with them!
explaining all the command line arguments and showing examples that make sense
telling you about all the configuration file tokens it thinks it understands, and what they do

Now you can build a test plan, and even inspect the code