First, let's see if the other person is the same sex or the opposite sex. If you are of the opposite sex and have feelings, you must go if you are invited to read a book. Just say I have books I want to read, too. If not, just use a bunch of excuses.

If you are gay, it's up to you. No, if you want to go, just say go together. If you don't want to go, say something.

I hope it helps you.