How to test framework systems that have varying usage is something we've hit with the RHQ project. Plugins to the platform could expose many types of data at varying frequencies and scales and so we've developed a flexible framework for performance testing. The nice thing about this system is its relative simplicity. We were able to create a standard RHQ plugin that can simulate large complex inventories of resources with just a few settings. How many server resources? How many child resources for each of those and what kinds of metrics and other data do they expose.
read more...