For nearly three decades, the web has been designed around a simple assumption:humans read pages, and machines index them.