Testing of re.optimize_kl
Currently the re.optimize_kl
and re.OptimizeVI
features remain largely untested. Only the demos ensure that optimize_kl
runs through as intended for one specific configuration. We should at least add tests verifying that the different configurations produce the intended outcomes and that the update rules behave as expected.