The use of antenna selection algorithms in massive Multiple Input Multiple Output(massive MIMO) systems can improve energy efficiency and system throughput. However, antenna selection algorithms suitable for traditional MIMO systems have high complexity and are difficult to be applied to massive MIMO systems. In order to optimize the antenna selection algorithm in two aspects: the algorithm complexity and system capacity, a joint threshold antenna selection algorithm for transmitting and receiving is proposed. The algorithm uses the maximum norm bidirectional antenna selection algorithm at the transmitting side, and the grouped maxvol antenna selection algorithm with an optimum preset threshold at the receiving side. The optimum threshold is obtained by simulation results. Results show that the joint threshold antenna selection algorithm can increase the system capacity while reducing the complexity. Compared with the incremental antenna selection algorithm, the system capacity can be increased up to 52.2 bit/s/Hz. The joint threshold antenna selection algorithm proposed in this paper can meet the transmission environment of different antenna correlation coefficients and SNR.