If you want to study in the library, go ahead. Don't think that you will be isolated and excluded. Back in the dormitory, you are still roommates. As long as you communicate with everyone more, your friendship will not be broken. School is a place to study. Although universities can be relatively free, they cannot stifle everyone's motivation to learn. You can also discuss going to the library to read books. Think about your old parents. Whether your family is rich or not, think more about them.