We extend the results of Hamkins and Thomas concerning the malleability of automorphism tower heights of groups by forcing. We show that any reasonable sequence of ordinals can be realized as the automorphism tower heights of a certain group in consecutive forcing extensions or ground models, as desired. For example, it is possible to increase the height of the automorphism tower by passing to a forcing extension, then increase it further by passing to a ground model, and then decrease it by passing to a further forcing extension, and so on, transfinitely. We make sense of the limit models occurring in such a sequence of models. At limit stages, the automorphism tower height will always be 1.