Yep: I sort of thought as well that Goff was speaking about not starting that game.
But pretty quickly it became obvious that the comment had a much wider meaning. And of course McVay knew it since he had talks with Goff.
IMO..... Goff knew of McVay's interest in Wolford, he knew he had not been performing (especially the horrific turnovers), and felt insecure in his job.
On the other hand, McVay's decision to want a different QB had (just in my speculation) far deeper roots than in his on-field performance. I don't know what they were. But the obvious disdain McVay had for Goff could no longer be hidden. And Goff HAD to have felt it.
No choice but to make a big change.