So what are we to do about it?
Well, there's creating more bus-only lines but that'll piss off businesses who are concerned about the loss of potential car-driving customers. See the fracas about creating a bus only lane down Geary. Then there's eliminating some stops but that'll bring out the protestors and cries of racism. As for speeding up the collection of fares that would mean either hiring more people or buying new machines. That would cost money, money we don't really have.
In other words, good luck with all that.