We show that the automorphism groups of right-angled Artin groups whose defining graphs have at least three vertices are not relatively hyperbolic. We then show that the outer automorphism groups are also not relatively hyperbolic, except for a few exceptional cases. In these cases, the outer automorphism groups are virtually isomorphic to either a finite group, an infinite cyclic group or $\mathrm {GL}_2(\mathbb {Z})$.