Hans, keeping the black hole at the centre of the asteroid would be like balancing a pencil on its point. The slightest movement would bring it into contact with the rock, which it would then devour.
It attracts and is attracted to the surrounding rock by gravity and a thought experiment will show what happens:
Forgetting its initial entry and associated movement complications, including how it came to rest, let's assume the hole begins stationary in the exact centre of a spherical planetoid. All the rock around it is crushed and absorbed - out to the 20G radius (using Aramis' figures). As the rock is pulled toward the hole, the hole is pulled toward the rock. Flaws in the rock will ensure that rock in one direction is broken away and absorbed quicker than another direction, so the hole will tend to bounce around in an ever-growing irregular cavity within the planetoid, devouring rock as it goes. Whilst it remains in the cavity it will provide an erratic gravitational field, but it won't stay inside for long. I'm not sure how long without doing more maths than I care to, but the hole's appetite will increase as it grows, and I suspect that it will soon burst out of the planetoid and then burrow back in again, repeating this numerous times in an erratic gravitational dance with the remnants of the planetoid. Not the sort of place I'd build a mansion...
Sorry Hans, you can have what you want IYTU, but in reality it won't explain that extra gravity. (Also, in reality, as opposed to Traveller, a Size 1 world won't support a breathable atmospheric pressure either, but even I turn a blind eye to that).
Black holes are out since they have an insatiable appetite, but I'm not sure whether 'neutronium' is unstable and reverts once the gravity that formed it is removed, and likewise I'm not sure about the stability of white dwarf material - maybe someone else could clarify?
I gather that WD material is thought to crystallize as it cools, but I dunno whether the crystal structure is something that would hold it together if high gravity conditions were removed.
If white dwarf material is stable in zero-G, you could have your vanishingly rare event as a stellar collision that shatters a white dwarf. The pieces cool much quicker than a whole star and have long-since cooled to black dwarf material. A piece has entered a starsystem as a captured body and has accreted local material (including gases) to form a planetoid around the black dwarf core.
Depends on the stability of WD material, but perhaps makes a more plausible core than the black hole. You'll need a better armchair astrophysicist than me to be sure.
Hope that helps.
PS. Somewhere not a million light-years from that planetoid, there are some black dwarf remnants that would make extremely well-armoured planetoid ships for players with munchkin tendencies...