The scarcity of water and the growing global food demand has fevered the debate on how to increase agricultural production without further depleting water resources. Crop water productivity (CWP) is a performance indicator to monitor and evaluate water use efficiency in agriculture. Often in remote sensing datasets of CWP and its components, i.e. crop yield or above ground biomass production (AGBP) and evapotranspiration (ET a), the end-users and developers are different actors. The accuracy of the datasets should therefore be clear to both users and developers. We assess the accuracy of remotely sensed CWP against the accuracy of estimated in-situ CWP. First, the accuracy of CWP based on in-situ methods, which are assumed to be the user's benchmark for CWP accuracy, is reviewed. Then, the accuracy of current remote sensing products is described to determine if the accuracy benchmark, as set by in-situ methods, can be met with current algorithms. The percentage error of CWP from in-situ methods ranges from 7% to 67%, depending on method and scale. The error of CWP from remote sensing ranges from 7% to 22%, based on the highest reported performing remote sensing products. However, when considering the entire breadth of reported crop yield and ET a accuracy, the achievable errors propagate to CWP ranges of 74% to 108%. Although the remote sensing CWP appears comparable to the accuracy of in-situ methods in many cases, users should determine whether it is suitable for their specific application of CWP.