Number is the attribute of matter, a quantitative form and a spiritual activity of human beings, but it cannot exist alone without matter.
In fact, in the period of natural philosophy in ancient Greece, the Bitgora school of idealism in southern Italy made such an ideological mistake, thinking that "number" is material and the source of the world.
There is something wrong with your formulation. Mathematics is human's thinking activity, but mathematics cannot be separated from matter.