Not all of the Wilds will be bad places; but the places that will survive the War and the Collapse in relatively good shape will usually be the focal points of pocket empires, and, after some time, will be in the center of tiny pockets of "Frontier"-type areas in the middle of the "Wilds". Expansion and maintaining starflight capabilities are two of the few defences such a world could have against raiders - and a world in good shape (i.e. TL7+, Starport-C+, a large population, not failing/doomed and enough to eat) in the wilds will attract ALOT of raiders.
Ofcourse, some places will simply be left virtually untouched due to an unimportant location (so far less chance of "Black War" strikes), low TL/starport (so they would be far less important to control in the War and, in a Virus-based universe, would probably be left untouched by the Virus as there will be no computers for it to possess), and a low population (again, making them less central to the War, but a population digit of 3 or more would probably be required for sustainability). So you'll have those pastoral backwaters that don't attract too many raiders (nothing worth stealing) and might, over time, recover quite quickly.
The Wilds are the Wildcards of Hard Times/TNE - sure, most will be the hells I've described earlier, but some would not.