For Fisher, and for many others, "trust me" really means that they have no logical answers or solutions, so we should simply take it for granted that they'll figure it out, or that they know what they're doing and it is the height of folly to question them. Depending on the one who utters the words, it could just be arrogance (Fisher for instance), or deep insecurity.
I grew really tired of Fisher's sly smile that said, "I know things you mere mortals don't know, so pay no attention to what you actually see happening". And of course, he didn't.