Intrusion Detection Testing and Benchmarking Methodologies

Nicholas Athanasides, Randal Abler et al, "Intrusion Detection Testing and Benchmarking Methodologies", Georgia Institute of Technology, Proceedings of the First IEEE International workshop on Information assurance (IWIA '03)

The authors discuss the existing tools and testing methodologies for performing benchmark testing of intrusion detection systems. Based on their study they propose the use of an open source environment to execute the testing.

Environments discussed include:

1. DARPA Environment
2. LARIAT environment

In addition the authors have also listed the test suite and the tools that could be used

1. Nidsbench and IDS Wakeup
2. IDSwakeup
3. Flame Thrower
4. WebAvalanche/ WebReflector
5. Tcpreplay
6. Fragrouter
7. Hping2
8. Iperf

- Issues in generating realistic evaluation environments are also discussed

- Examples of IDS Evaluation environments include:

1. DARPA Like Environment
2. Custom Software
3. Advanced security audit trail analysis on Unix
4. Vendor Independent testing lab
5. Trade magazine evaluation