If anyone else out there ever needs to know, there are 2 ways to remove the taper attachment.
#1 Remove the 4 bolts holding taper attachment to the cross slide, pull out a few inches, remove set screw, jack with it a few more minutes, decide you are doing it wrong, put the 4 bolts back in. Go to front of machine, remove compound, remove cross slide knob, remove cross slide screw nut retainer, remove tapered jib, remove cross slide. Put a rolling cart under taper attachment, remove the 4 bolts again, slide TA straight back (with cross slide screw still attached), when you have enough room unscrew the nut off the shaft, then pull unit all the way out of the machine.
#2.Remove the 4 bolts holding taper attachment to the cross slide, pull out a few inches, remove set screw, use a spanner wrench to unscrew nut/bearing assembly from the taper attachment, then pull taper attachment away from machine. The trick is knowing that you need the spanner wrench because when you are working from back side of the machine its hard to see those 2 little holes in the nut
.
In a pinch, the spanner wrench for a 4" grinder does work. Oh well, it all had to come apart for cleaning.