Thanks for all the help guys, I think I'm headed in the right direction.
As mentioned I tried the Norton 32A60-KVBE dry and it worked quite well but sucked with the Rustlick. I also tried the 19A46-K5VG and it was bad wet or dry. The 1/2" wide ceramic I cut from the 5SG46-JVS worked pretty good dry but would only take about 5 tenths per side before it loaded up, wet it was bad like the others.
I then tried the 170 grit vitrified CBN wheel after truing it with a moly round (thanks CarbideBob), it didn't work well dry but with the Rustlick did it ever cut, the coolant was coming out grey!
I should have my 100 grit CBN wheel from Diagrind this week and am hoping it'll work well for roughing, then I'll switch to a 90 grit white AO wheel for finishing.
I've got the traverse about as slow as it'll go, otherwise it starts to studder. The part is 1.700" long and I outfeed 1/2 the wheel width at each end, all are 1/4" wide except the ceramic which is 1/2". To "get that traverse down though so that the work is only passing by ¼ the width of the wheel per revolution of the part" I figure I need to speed up the part to about 400 rpm, is that right?
The interrupted cut over the ports can't be helping, I might look at filling it with Cerro metal, thanks for the idea.