The mathematical model of high order local interconnected neural network (LINN) is presented. Computer simulations on its associative memory are carried out. The results show that high order LINN has a much small interconnection weight matrix and the same associative memory ability, on the other hand, a large scale neural network can be constructed by using high order LINN if the size of interconnection weight matrix is limited.