How do most people handle installing these replacements? Do you just solder them in place and let them dangle by the leads? Do you tape them down? Make brackets so they mount like the originals?
Adhesives on most tapes just end-up a delayed-reaction MESS. In general, tape should be avoided.
Back THEN, they also had "Cambric" (woven-tube linen) and waxed linen lacing cord.
Here and NOW we have a dozen flavours of tie-wrap and more-yet of shrink-tubing.
Add a rod here and there of insulating material as stiffener - strips of Formica/Micarta, re-purposed chopstick, Bamboo BBQ skewers, lengths of cut weed-wacker line Kevlar... wotever.. and use the shrink-tubing & tiewraps to brace them to each other or to other suitable components.
BIG caps, such as electrolytics, either the proper clamps, conduit clamps, or angle-brackets and hose clamps can serve.
Unlike a motorcar, boat, or aircraft, there isn't often much in the way of vibration to be dealt with. Even so, the goal is to immobilize so they don't vibrate and fracture the leads nor rub-through insulation or even markings.