Asymmetric damage segregation (ADS) is ubiquitous among unicellular organisms: After a mother cell divides, its two daughter cells receive sometimes slightly, sometimes strongly different fractions of damaged proteins accumulated in the mother cell. Previous studies demonstrated that ADS provides a selective advantage over symmetrically dividing cells by rejuvenating and perpetuating the population as a whole. In this work we focus on the statistical properties of damage in individual lineages and the overall damage distributions in growing populations for a variety of ADS models with different rules governing damage accumulation, segregation, and the lifetime dependence on damage. We show that for a large class of deterministic ADS rules the trajectories of damage along the lineages are chaotic, and the distributions of damage in cells born at a given time asymptotically becomes fractal. By exploiting the analogy of linear ADS models with the Iterated Function Systems known in chaos theory, we derive the Frobenius–Perron equation for the stationary damage density distribution and analytically compute the damage distribution moments and fractal dimensions. We also investigate nonlinear and stochastic variants of ADS models and show the robustness of the salient features of the damage distributions.