When light propagates in a single mode fiber, it may acquire additional phase corresponing to the geomerical configuration of the fiber. In this paper we report the observation of such geometrical phase at single photon level to manifest the quantum origination of the geometical phase.