[1] Agiwal M, Roy A, Saxena N et al. Next generation 5G wireless networks: a comprehensive survey[J]. IEEE Communications Surveys & Tutorials, 18, 1617-1655(2016).

[2] Liao W X, Li M, Salinas S et al. Energy-source-aware cost optimization for green cellular networks with strong stability[J]. IEEE Transactions on Emerging Topics in Computing, 4, 541-555(2016).

[3] Liao W X, Li M, Salinas S et al. Optimal energy cost for strongly stable multi-hop green cellular networks[C], 62-72(2014).

[4] Gelabert X, Legg P, Qvarfordt C et al. Small cell densification requirements in high capacity future cellular networks[C], 1112-1116(2013).

[5] Chen L, Yang Q. Analysis of spectrum occupation and perspectives of 5G network[J]. Study on Optical Communications, 68-71(2016).

[6] Su X, Liu B, Zhu X P et al. Low-complexity iterative approximated water-filling based power allocation in an ultra-dense network[J]. Entropy, 18, 158(2016).

[7] Yu W, Ginis G, Cioffi J M et al. Distributed multiuser power control for digital subscriber lines[J]. IEEE Journal on Selected Areas in Communications, 20, 1105-1115(2002).

[8] Chen C S, Shum K W, Sung C W et al. Round-robin power control for the weighted sum rate maximisation of wireless networks over multiple interfering links[J]. European Transactions on Telecommunications, 22, 458-470(2011).

[9] Liu G, Zhao H S, Shao H X et al. Power control algorithm in heterogeneous network based on iterative approximation[J]. Computer Engineering, 44, 95-100(2018).

[10] Wen B, Gao Z B, Huang L F et al. A Q-learning-based downlink resource scheduling method for capacity optimization in LTE femtocells[C], 625-628(2014).

[11] Wu J J, Zeng J, Su X et al. Joint CoMP and power allocation in ultra dense networks[C], 1-5(2017).

[12] Liu L, Garcia V, Tian L et al. Joint clustering and inter-cell resource allocation for CoMP in ultra dense cellular networks[C], 2560-2564(2015).

[13] Luo C Q, Guo S Y, Guo S et al. Green communication in energy renewable wireless mesh networks: routing, rate control, and power allocation[J]. IEEE Transactions on Parallel and Distributed Systems, 25, 3211-3220(2014).

[14] Qian L P, Zhang Y J, Huang J W et al. MAPEL: achieving global optimality for a non-convex wireless power control problem[J]. IEEE Transactions on Wireless Communications, 8, 1553-1563(2009).

[15] Wang Y T, Yang S H, Li Z et al. Design of compound free space optical/millimeter wave antenna for communication[J]. Acta Optica Sinica, 39, 1206001(2019).

[16] Zhang Q Q, Kassam S A. Finite-state Markov model for Rayleigh fading channels[J]. IEEE Transactions on Communications, 47, 1688-1692(1999).

[17] Akdeniz M R, Liu Y P, Samimi M K et al. Millimeter wave channel modeling and cellular capacity evaluation[J]. IEEE Journal on Selected Areas in Communications, 32, 1164-1179(2014).

[18] Shi Z, Sun C Y, Jiang F et al. Block-aware power allocation based on Q-Learning in millimeter-wave network[J]. Computer Engineering, 46, 185-192(2020).

[19] Im Y, Wong C J, Ha S et al. AMUSE: empowering users for cost-aware offloading with throughput-delay tradeoffs[J]. IEEE Transactions on Mobile Computing, 15, 1062-1076(2016).

[20] Bellman R, Lee E. History and development of dynamic programming[J]. IEEE Control Systems Magazine, 4, 24-28(1984).

[21] Mismar F B, Evans B L, Alkhateeb A et al. Deep reinforcement learning for 5G networks: joint beamforming, power control, and interference coordination[J]. IEEE Transactions on Communications, 68, 1581-1592(2020).

[22] Bai T Y, Heath R W. Coverage and rate analysis for millimeter-wave cellular networks[J]. IEEE Transactions on Wireless Communications, 14, 1100-1114(2015).