Certain problems in physics and chemistry lead to the definition of a class of stochastic processes. Although they are not Markovian they can be treated explicitly to some extent. In particular, the probability distribution for large times can be found. It is shown to obey a master equation. This demonstrates how a non-Markovian process can be approximated on a course time scale by a Markov description. The conditions for this approximation to be valid are discussed.