If they were mathematical constructs, they'd be abstract. Since they're physical structures, they're manifest. Since math wasn't invented to describe nature until man came along, all that there was was physical structures subject to forces. We invented math to be able to quantify those physics. You don't get to manipulate the meaning of words to suit your ideas.