I have done a similar switch (I ended up doing part of nursing school then kept audiology).
From someone who looked at the FNP and PA rabbit holes after getting my AuD, I can tell you this.
I had a pre-med bachelor's degree and every PA program still wanted me to retake classes from undergrad...