Sixth Sense: What if all the ghosts (including Bruce Willis) don't exist?

What if Cole is just a deeply disturbed little boy? What if all the scenes with Bruce Willis and his wife are just backstory Cole invented to justify his delusions, as schizoids of prone to do? Isn't it odd that the movie still makes sense in this context?