The UC Cliometric History Project and Formatted Optical Character Recognition

In what ways — and to what degree — have universities contributed to the long-run growth, health, economic mobility, and gender/ethnic equity of their students' communities and home states? The University of California ClioMetric History Project (UCCHP), based at the Center for Studies in Higher Education, extends prior research on this question in two ways. First, we have developed a novel digitization protocol — formatted optical character recognition (fOCR) — which transforms scanned structured and semi-structured texts like university directories and catalogs into high-quality computer-readable databases. We use fOCR to produce annual databases of students (1890s to 1940s), faculty (1900 to present), course descriptions (1900 to present), and detailed budgets (1911-2012) for many California universities. Digitized student records, for example, illuminate the high proportion of 1900s university students who were female and from rural areas, as well as large family income differences between male and female students and between students at public and private universities. Second, UCCHP is working to photograph, process with fOCR, and analyze restricted student administrative records to construct a comprehensive database of California university students and their enrollment behavior. This paper describes UCCHP's methodology and provides technical documentation for the project, while also presenting examples of the range of data the project is exploring and prospects for future research