What tests do we need for single threaded?

[petergarnaes]

• 60 lookup 20 insert 20 remove vs. load factor
• 80 lookup 10 insert 10 remove vs. load factor
• 90 lookup 5 insert 5 remove vs. load factor

This is the metric repports mostly include, maybe some memory usage, but I don't know if it is relevant or the trouble worth.... Mybe we could also have:

• Nr. of insert in same bucket vs. speed (already done)
• Individual speeds of instructions? (other repports don't have this)
• Any other?

[petergarnaes]

I think individual speeds of instructions is a bad test to do, because their speed are dependent on how full the hash map are and such. And even if you decide how to tackle that, should you measure the average time it takes for one or more instructions?