There should be a coffee/tea stand in the library all the time. Not just during finals.
There is always a hot water tap downstairs. If you head down to the break room area, you’ll find a hot water tap ready to make your tea, cocoa, and instant coffee.