I think changing the phase +/- will actually change the absolute direction of speaker movement - I think the most widely used convention is that on a + setting both speakers drivers are in phase and move towards the audience when applied a positive signal while on the - setting they will still be in phase but move inwards when applied a positive signal.
Neither setting will place the speakers out of phase, as you wouldn't want this.
There is still a debate going on as to whether absolute phase change produces audible results. On some Chesky test&sampler CD's you do get recordings made with both phase settings to see if you can distinguish between them, and you also get some out-of-phase samples which are immediately and clearly noticeable.
If you can notice difference in spl at your listening position when switching absolute phase, then you probably listen very close to a "node" in a relatively low frequency in your room. Theory recommends you should use the absolute setting which sounds louder.
In my specific setup I can not decide between a + or - setting, although, looking for differences I sometimes feel there is a subtle advantage in bass attack for the + (which is what I use). It might also be coz' my ears are getting older

, or because we sometimes hear what we want to hear
Cheers,
Dorian