If it's that far outside, it's likely one cause of your consistency. Since we use both eyes, even if one is dominant, most players get a more accurate line of sight when the cue is somewhere between the two eyes. But I must qualify that statement. I have seen pictures of Earl where it looks like his cue is off to his right, and he obviously has no problem aiming.
You need to fine a point where what you perceive to be a straight line extending beyond the end of the cue is the actual straight line toward your intended target. Each player is unique, so I can't tell you exactly where yours should be without being there at the table with you.
If you can find a good instructor, they should be able to help.