Didn't he once say something about how "we" laid seige to hell? I think I pictured in my head that there were other angels on back up but that obviously Castiel was the only one who found Dean and brought him out.