In my experience, drivers are pricks for the most part and are almost always running behind schedule, so they sometimes spend waay too little time at the bus stop. After it's happened to you a few times, you just wanna stay on the safe side. There, a little less complicated and perhaps more practical explanation :)