The repository contains an updated version of the data set underlying the published article 'Sun, X., Zhao, W., Maretto, R.V. and Persello, C., 2021. Building polygon extraction from aerial images and digital surface models with a frame field learning framework. Remote sensing, 13(22), p.4700.' This data set contains image tiles and corresponding reference building polygons derived from PDOK for building polygon extraction. Replacement note: this dataset is a replacement for the dataset of 10.17026/dans-248-n3nd (see description details). The data in the test set of the previous version is not complete. This replacement version contains complete data.