According to the relevant regulations, you can borrow a certain number of books at a time with a library card.
Handling a library card generally includes two parts: the cost (non-refundable) and the deposit (refundable). The main purpose of the deposit is to prevent the book from being returned. As long as you return the book properly, the final deposit will be returned to you.
If you choose to study in the library, you don't need a library card, just a reading card. Generally speaking, you only charge a fee for a library card, but you can't borrow books. Some libraries also open free reading.
The details vary from library to library. I suggest you bring your ID card and go to the library service desk to ask about the relevant regulations.