The occurrence of artifacts is a major challenge in photoacoustic imaging. The artifacts negatively affect the quality and reliability of the images. An approach using multiwavelength excitation has previously been reported for in-plane artifact identification. Yet, out-of-plane artifacts cannot be tackled with this method. Here we propose a new method using ultrasound transducer array displacement. By displacing the ultrasound transducer array axially, we can de-correlate out-of-plane artifacts with in-plane image features and thus remove them. Combining this new method with the previous one allows us to remove potentially completely both in-plane and out-of-plane artifacts in photoacoustic imaging. We experimentally demonstrate this with experiments in phantoms as well as in vivo.