A novel scheme of controlled secure quantum dialogue by using Brown states was proposed in this paper. It this scheme, Alice, Bob and Charlie shared a fiveparticle Brown states. Alice made unitary operations on two particles of the Brown states to realize encoding her secret calssical message. Similarly, Bob performed corresponding unitary transformations to another two particles to encode the information that he wanted to send to Alice. Later, Charlie made Brown base states joint measurement on the Brown final state and announced the measured results. Alice and Bob deduced the opposite party′s information according to Charlie′s announced measurement results and her (his) unitary operation when encoding.They completed quantum dialogue successfully. Then the scheme′s security was discussed and a conclusion was drawn. Compared with the previous quantum dialogues, the secure quantum dialogue scheme adds the controlled party, ensures the communication security, and increases the particles number involving in the communication process and the coding efficiency.