No, not math. It's just math.
Now, of course, you can see the answer: Richard Muller's answer is that physics is mainly mathematics? The author is Richard Muller, and his answer is an expert's opinion, which cannot be taken lightly.
However, as I will explain here, the view that mathematics is only a tool is untenable. The reason is that to do anything in physics, you need to define some primitive concepts, which is inseparable from a deep mathematical foundation. So allow me to give you some examples. Mathematics is not a tool, but the only way to discuss the problems you need to discuss. We will go to Wikipedia to see if we can define some primitive concepts without mathematics. Let me start with the concept of field, because field is everywhere in physics.
Every term needed to define a "domain" is marked in bold in an attempt to define it. So we have the first sentence:
In physics, a field is a physical quantity, expressed by a number or tensor, which has a value for every point in time and space.
But what exactly is a physical quantity? That must be
Quantity:
Quantity is an attribute that can exist in quantity or size. The comparison of quantity can be expressed by "more", "less" and "etc", and a numerical value can also be specified by the unit of measurement.
It must also be one.
Physical quantity:
Ah, much better, because it contains the word "physics" ... Oh, wait ... In order to make you say less sentences written in bold, here is the table of contents of this page, trying to define a physical quantity:
Okay, back to the first sentence. Let's ignore numbers and scalars, because they are obviously mathematical concepts. Let's move on to the next one:
Obviously, the word value is an overloaded word, which means that many different things can be expressed according to the context. So let's use Wikipedia to disambiguate:
Is it used in the relevant sense of ethics? number
Is it used in a sense related to economics? number
Is it used in a tonal sense? number
Is it used in the sense related to computer science? number
Is it used in a semiotic sense? number
Is it used for the relevant meaning of note duration? number
In Mr. Spock's words, when you can rule out all options, the rest must be the right one.