A Riemannian metric gives rise to geodesics. As unparameterised curves, at each point there is one geodesic in every direction. Does this arrangement of curves determine the metric and will any such arrangement of curves determine a metric? These are classical questions considered, for example, by Roger Liouville in 1889 who made considerable progress in two dimensions. This talk will discuss these questions in two and three dimensions, mostly based on joint work with Robert Bryant and Maciej Dunajski.