It would take you longer at the library.
With paper or microforms, I mean.
You'd have to get out of your chair, walk to the shelf, and select them. Walk back. Turn pages, thread microfilm, etc.
The library would be better exercise, but more time-consuming, unless you used electronic databases. Electronic databases would get you about the same result for your four hours. But you'd still have to walk into the building.