Fig. 1. (Color online) Classical CNN model architectures. There are four fixed combination of layers in the figure. Among them, (a) stands for residual net in ResNet series networks, (b) expresses Inception-ResNet combination structure, (c) represents naïve inception structure, and (d) shows an upgraded version of inception with dimension reduction feature.

Fig. 2. (Color online) Programming system hierarchy diagram.

Fig. 3. (Color online) (a) TVM and (b) XLA compiling optimization stack overview diagram.

Table 1. Comparison of different hardware acceleration platforms.