Jmh benchmark

[fmcarvalho]

To run spring-comparing-template-engines with JMH on you local machine just run:

mvn clean install

And then:

java -cp target\template-engines.jar;target\classes org.openjdk.jmh.Main -f 1 -r 5 -w 5 -i 4 -wi 4

NOTICE use : or; as classpath separator depending on whether you are in linux or windows.

There is an issue with maven-shade-plugin configured according to JMH that is not including this project's classes (com.jeroenreijn.examples) in the resulting jar, i.e. template-engines.jar. That's why I am providing the jar and the target\classes in classpath. Otherwise, it would be possible to run with java -jar target\template-engines.jar.

Usually I run JMH with -f 1 -r 5 -w 5 -i 4 -wi 4 which is fair enough to collect consistent results. Yet, you may change it accordingly:

• -f - How many times to fork a single benchmark.
• -r - Minimum time to spend at each measurement iteration in seconds.
• -w - Minimum time to spend at each warmup iteration in seconds
• -i - Number of measurement iterations
• -wi - Number of warmup iterations

NOTICE We have here 18 templates correctly measured, missing only JSP which does not produce HTML output because Spring MVC Test doesn't run that servlet container (https://stackoverflow.com/a/37749746/1140754)

Next, you have the results collected in my machine (Intel(R) Core(TM) i7-8565U CPU @ 1.80GHz, Windows 10 Pro, JDK 17.0.2, Java HotSpot(TM) 64-Bit Server VM):

Benchmark                        Mode  Cnt      Score       Error  Units
LaunchJMH.benchmarkChunk        thrpt    4   7005,888 ±   662,273  ops/s
LaunchJMH.benchmarkFreemarker   thrpt    4   7874,883 ±   531,991  ops/s
LaunchJMH.benchmarkGroovy       thrpt    4     10,680 ±    14,304  ops/s
LaunchJMH.benchmarkHandlebars   thrpt    4    515,719 ±    62,625  ops/s
LaunchJMH.benchmarkHtmlFlow     thrpt    4  18042,021 ±  8619,886  ops/s
LaunchJMH.benchmarkHttl         thrpt    4   1347,726 ±  1252,651  ops/s
LaunchJMH.benchmarkIckenham     thrpt    4   2996,950 ±   682,017  ops/s
LaunchJMH.benchmarkJade         thrpt    4     72,926 ±    12,907  ops/s
LaunchJMH.benchmarkJsp          thrpt    4  32665,717 ± 29053,124  ops/s
LaunchJMH.benchmarkKotlinxHtml  thrpt    4  13283,696 ±  1150,034  ops/s
LaunchJMH.benchmarkLiqp         thrpt    4   1588,033 ±    83,760  ops/s
LaunchJMH.benchmarkMustache     thrpt    4   4331,608 ±   231,817  ops/s
LaunchJMH.benchmarkPebble       thrpt    4   2192,795 ±    80,917  ops/s
LaunchJMH.benchmarkRocker       thrpt    4  16590,245 ±   987,612  ops/s
LaunchJMH.benchmarkRythm        thrpt    4   7196,728 ±   403,504  ops/s
LaunchJMH.benchmarkScalate      thrpt    4    702,525 ±   348,521  ops/s
LaunchJMH.benchmarkThymeleaf    thrpt    4   1714,108 ±   184,021  ops/s
LaunchJMH.benchmarkTrimou       thrpt    4   9303,166 ±  1352,217  ops/s
LaunchJMH.benchmarkVelocity     thrpt    4   1645,852 ±   169,948  ops/s

[fmcarvalho]

@jreijn Any update about this?

[fmcarvalho]

@jreijn Any news about this PR?