Given that the OPs first criteria is "fits in my basement" its unlikely that any real industrial CNC machine can be considered anyway. Maybe the little "second-op" mills on castors might go in but I think nothing more serious.
Not so sure how valid the speed issue is either. If you aren't making parts for a living you won't be standing over it waiting for any relatively complex part anyway. If a Tormach takes 45 minutes, a Hass 15 and a Brother 5 odds are the part is complex enough that you only want one or two so you will wander away to get on with something else and come back when its convenient. Maybe an hour or more later. So really the main difference boils down to spindle time - standing time ratio. So long as its done when you are ready who cares what percentage was spindle time.
So if the Tormach is sufficiently accurate and can handle appropriate cutters to get the job done it could well be perfectly practical.
As turnworks asks what is the realistic metal shifting capability and how does that relate to the jobs you intend to do.
Plenty of folk seem to find the Tormach price / performance / capability / how-long-do-I have-to-wait equation satisfactory whilst acknowledging that in a perfect world something much better would be nice. No difference to the real machinists saying a Bridgeport is a floppy, flexi, weak bit of kit (which comparatively speaking it is) whilst the Bridgeport drivers just roll up their sleeves, get on, and get the job done. But slower.
Being able to walk away while a CNC machine works completely changes the toy / not toy equation when compared to manual machines. Manual you have to stand over it so you directly notice when the machine isn't up to making the largest accurate cut the job can stand so the cost is real now time. CNC its more about schedule come back in 20 minutes et al sort of thing. Set-up time will be similar whatever the machine, probably longer than at work because you won't have all the kit.
Speed is not a problem right now. I know that a tormach cant be compared to a used "pro" machining center, I am just not sure what kind of tolerances and surface finish I could accomplish with a tormach 440.