Feel like you'll lose friends?

My wife and I are in our late twenties, which feels like the prime pregnancy time for most people. Already, we've had 3 pregnancies in our friend group and 4 more are wanting/ trying to get pregnant.

We're not planning on having kids, and we feel like our current friend group is going to change so much within the next few years due to all the babies and toddlers that are going to be around. We don't hate kids, but I don't want them at dinners, movie nights, hangouts, etc, but I know that's really not possible moving forward.

What's even worse is we bought a house with a pool and it's already been joked about how now there's a prefect summer hangout spot where the kids can swim in the future.

I feel like we're going to grow distant to our current friends and either going to have to find all new friends or deal the all the babies and baby talk, does anyone else feel this way?