It does sound weird but it's definitely possible. I do more or less the same thing. I'm aiming at an imaginary point in space.
Maybe I can expand it a little... my stick is always visible in my peripheral vision and it's pointing along a certain invisible line. The stick itself is part of that line so it makes it easy to visualize the rest of it.
I see the contact point, and keep tweaking the stick line until I know the CB will hit the contact point. I'm glancing at the contact point while seeing the correct stick line out of the corner of my eye. Once I know the correct stick aiming line, I don't look at ball anymore. I just make sure it stays on.
Thanks man. I see what you're saying but you can understand why I get a little confused when I see: "I'm aiming at an imaginary point in space."

Are you around the Boston area?