The time-series nature of mortality rates lends itself to processing through neural networks that are specialized to deal with sequential data, such as recurrent and convolutional networks. Although appealing intuitively, a naive implementation of these networks does not lead to enhanced...