We investigate the structure and the relaxation dynamics of complex hierarchical systems from a variational point of view. First, an additional argument for the use of the ultrametric caricature to describe disordered systems is provided. Focusing on ultrametric models, we show that two relevant...