This, I think, is where the line between science and philosophy becomes a little harder to see clearly.
Personally, I look at it like this. The universe is not dependant on our perception of it. However, the way we describe the universe is. Additionally, we are clever enough to realize that our perceptions are sometimes scientifically incorrect, in which case we discard them in favour of the new understanding we have gained, which you might describe as a more "refined" perception.
I agree that perception itself is an aspect of the universe, because as perceiving beings, we are in it. It is an important aspect in the sense that the only way we can actually look at it is through a pair of glasses tinted with our own idiosyncratic way of perceiving it as human beings.
In that sense, the size of the golfball is irrelevant, or moot, unless there is someone there to describe it in reference to something else. Nevertheless, the golf ball, assuming it is made of matter, will contain the same number of protons, neutrons and electrons (and so would it's penis) whether anyone is here to perceive it or not.
As for relativity, if you were to imagine a universe in which there was nothing but time, the question "how long does this or that take" would be just as meaningless as asking how big the golf ball is. As human beings, we know time goes by. Sometimes it even seems to slow down and speed up depending on what we are doing. That is a matter of perception. But regardless of those perceptions, an electron will still orbit the nucleus of an atom at the same rate it always has, and if you were to measure how many times it did that before the light from the sun gets to earth, you'd get the same result each time regardless of whether you were having a good or a bad day at work
