Please see comments
When apache is used in worker mode and PKCS#11 engine, its performance is significantly worse than when the engine is not used at all. The problem is only in worker mode, not in pre-fork mode. The problem gets worse with increasing number of threads per process.