In this paper, we examine the perceptual difference between bare-handed and tool-based interaction by identifying dissimilarities between two perceptual spaces constructed for the two interaction modes. For each interaction mode, four dimensional perceptual spaces are constructed using cluster sorting-based multidimensional scaling with 31 real textured surfaces. In addition, an adjective rating experiment was conducted to understand the meaning of the difference. Distinctive trends and differences of the perceptual spaces were identified. It was seen that familiarity with textured surfaces seemed to decrease the precision of bare-handed interaction, while at the same time it increased classification speed. Furthermore, likely evidence of pre-judgment in tool-based interaction was seen.