Data Clustering With Actuarial Applications

Data clustering refers to the process of dividing a set of objects into homogeneous groups or clusters such that the objects in each cluster are more similar to each other than to those of other clusters. As one of the most popular tools for exploratory data analysis, data clustering has been applied in many scientific areas. In this paper, we give a review of the basics of data clustering, such as distance measures and cluster validity, and different types of clustering algorithms. We also demonstrate the applications of data clustering in insurance by using two scalable clustering algorithms, the truncated fuzzy c-means (TFCM) algorithm and the hierarchical k-means algorithm, to select representative variable annuity contracts, which are used to build predictive models. We found that the hierarchical k-means algorithm is efficient and produces high quality representative variable annuity contracts