Of course, science and engineering students in universities have to study advanced mathematics and other subjects, and your finance major (I don't know what your major is) is also compatible with liberal arts in some universities, so mathematics is not that important. Of course, some mathematics related to finance must be learned, such as advanced mathematics, linear algebra and probability statistics. These mathematics are trivial for students majoring in mathematics, so don't worry. None of this is too difficult.
As for you saying that you can learn less math, there seems to be no more. Finance needs to learn some basic subjects about mathematics.