(1) Let the two sides of a right triangle be A and B (A > B).

A+B = 5A2+B2 = 13，

① Square the two sides—② Get ab=6,

(a-b)2=(a+b)2-4ab= 1，

∴a-b= 1，

Therefore, the area of the small square is 1.

(2)