People have limited time to put into personal interests, and most people aren't scientists. A lot of people aren't interested in science, but that's not the same as saying they necessarily find it boring. The same could be said for arts or sport.
That actually just about conveys the truth of the matter.
As a layman I have always been enthralled with the cosmological sciences, without having the learning or expertise to understand it to its full meaning.
Finally around 35, 40 years ago I took things into my own hands and started to read reputable material on such things, starting from the more basic information specifically printed for lay people, progressing to books such as Hawking's BHoT, Paul Davis's "Superforce", and as my understanding matured to books such as Thorne's BH's and Time Warps, along the way finding forums such as the now defunct ABC's Science forum and a couple of others.
Over the last few years at my annual old boys reunions, I am known for getting the subject matter around to space, cosmology etc. The reactions to my knowledge [as still limited as that is] to their ears is amazing. I have many questions fired back at me, [thankfully up until now, I have been able to answer all] re BH's the BB, "It's only a theory" type of remark etc.
My ex school mates are obviously in awe and quite taken aback by our present knowledge of space, astronomy, Cosmology, GR etc, but as James has said they are into other things, and as yet, have not got the fire in their bellies to take it any further.
But I can say categorically, that the interest from them has become so pronounced, that now I do not have to take any "lead" into scientific discussions. It is done for me.