Semi-quantum dialogue has a relatively strong practicality in quantum communications, and its partial users do not need to be equipped with expensive quantum devices. A four-party authenticated semi-quantum dialogue protocol based on the Brown states is proposed. Then, the proposed protocol is extended to multi-party using the generalized Brown states. Through security analysis, it is verified that the proposed protocol does not have the information leakage problem and can effectively resist the intercept-resend attack, man-in-the-middle attack, disturbance attack and Trojan horse attack. The analysis comparison with the similar protocols shows that the proposed protocol has high quantum communication efficiency.