Not entirely true. Let's say you observe two opposite area's in the sky. You focus on a certain redshift (i.e. time in the past). The further back into the past you go, the farther away these points in the sky currently are, but also the farther apart these points were at the time the light you are observing was emitted. I think this may be so right up to the inflationary era. In other words, the farther away we look, the larger the universe we observe. And this interpretation breaks down in a big crunch universe, as I already said. Or in a static universe.