A few years ago, I remember seeing a video of Ray Kurzweil discussing how linear programming was an example of how software (algorithms) - independent of hardware - is also getting faster (exponentially) over time. He referenced a paper on this topic I believe that showed the historical speed increase on constant hardware.
I can't seem to find this paper, however. Is anyone aware of it?