I completely agree. For one, it would continue the NFL's trend towards "player safety" (not to mention the officials who, likely, might be more susceptible to heat-related issues).
The other thing, as you personally alluded to, is that I believe it'd make for a better fan experience. Watching the game on TV, I got the impression that there were ALOT of empty seats in the stadium. At first, I was a little surprised to see this because I felt that this was going to be a good matchup. But then again, I don't think that I would've enjoyed myself in those conditions.