For a little while I’ve been keeping a set of JMH performance benchmarks for Orekit. I run it with Jenkins and the JMH Report Plugin to make nice graphs. It measures performance of a few selected features and produces graphs. For example, this one that shows (with some clicking) a side effect of merging the data-context branch is propagating an OEM ephemeris had a speedup of ~2.
Would the Orekit community be interested in a set of performance benchmarks? It will be a small set initially, but we can grow it. There have been a few performance related questions recently and this would be a tool for developers so we can know what improves performance and what doesn’t. Performance is goal number 3 for Orekit and this could provide some data to support that goal.
The biggest cost would probably be running the benchmarks routinely. The small set I have take about an hour to run and noting else can run on the machine at the same time or else it creates errors in the measurement. (That’s what makes all the bumps in the graph above.)