Think of a tensor as a multi-dimensional array. In TensorFlow, all data is represented as tensors, which are the primary data structures that are used to represent and manipulate data in TensorFlow.