It's already difficult to feed 8 billion people. We'll just add it to the debt and no one will notice because they're too busy watching the billionaire space race on TV.
Unpredictable weather, man made toxins polluting the planet, losing the war against the microbes and nuclear annihilation are likely part of the mix as well. Yet to be seen is how aggressively the Empire works to control population when they are masters of the universe....it is highly likely that they will decide that having children requires a permit.