We first establish a general version of the Birkhoff Ergodic Theorem for quasi-integrable extended real-valued random variables without assuming ergodicity. The key argument involves the Poincaré Recurrence Theorem. Our extension of the Birkhoff Ergodic Theorem is also shown to hold for asymptotic mean stationary sequences. This is formulated in terms of necessary and sufficient conditions. In particular, we examine the case where the probability space is endowed with a metric and we discuss the validity of the Birkhoff Ergodic Theorem for continuous random variables. The interest of our results is illustrated by an application to the convergence of statistical transforms, such as the moment generating function or the characteristic function, to their theoretical counterparts.