Confocal three dimensional (3D) micro X-ray fluorescence (XRF) spectrometer based on a polycapillary focusing X-ray lens (PFXRL) in the excitation channel and a polycapillary parallel X-ray lens (PPXRL) in the detection channel was developed. The PFXRL and PPXRL were placed in a confocal configuration. This was helpful in improving the signal-to-noise ratio of the XRF spectra, and accordingly lowered the detection limitation of the XRF technology. The confocal configuration ensured that only the XRF signal from the confocal micro-volume overlapped by the output focal spot of the PFXRL and the input focal spot of the PPXRL could be detected by the detector. Therefore, the point-to-point information of XRF for samples could be obtained non-destructively by moving the sample located at the confocal position. The magnitude of the gain in power density of the PFXRL was 103. This let the low power conventional X-ray source be used in this confocal XRF, and, accordingly, decreased the requirement of high power X-ray source for the confocal XRF based on polycapillary X-ray optics. In this paper, we used the confocal 3D micro X-ray fluorescence spectrometer to non-destructively analyzed mineral samples and to carry out a 3D point-to-point elemental mapping scanning, which demonstrated the capabilities of confocal 3D micro XRF technology for non-destructive analysis elements composition and distribution for mineral samples. For one mineral sample, the experimental results showed that the area with high density of element of iron had high density of copper. To some extent, this reflected the growth mechanisms of the mineral sample. The confocal 3D micro XRF technology has potential applications in such fields like the analysis identification of ore, jade, lithoid utensils, “gamble stone” and lithoid flooring.