Overview Implemented environments: Hypergrids Sequence Environments Bayesian Networks Structure Learning Ising Models Phylogenetic Trees