Article
Open Access
Performance evaluation, optimization and dynamic decision in blockchain systems: a recent overview
1 School of Economics and Management, Beijing University of Technology, Beijing, China
2 Monash Business School, Monash University, Melbourne, Australia
Abstract

With rapid development of blockchain technology as well as integration of various application areas, performance evaluation, performance optimization, and dynamic decision in blockchain systems are playing an increasingly important role in developing new blockchain technology. This paper provides a recent systematic overview of this class of research, and especially, developing mathematical modeling and basic theory of blockchain systems. Important examples include (a) performance evaluation: Markov processes, queuing theory, Markov reward processes, random walks, fluid and diffusion approximations, and martingale theory; (b) performance optimization:Linear programming, nonlinear programming, integer programming, and multi-objective programming; (c) optimal control and dynamic decision: Markov decision processes, and stochastic optimal control; and (d) artificial intelligence: Machine learning, deep reinforcement learning, and federated learning. So far, a little research has focused on these research lines. We believe that the basic theory with mathematical methods, algorithms and simulations of blockchain systems discussed in this paper will stronglysupport future development and continuous innovation of blockchain technology.

Keywords

Blockchain; performance evaluation; performance optimization; optimal control; dynamic decision

Preview
References
  • [1]Nakamoto S. Bitcoin: A peer-to-peer electronic cash system. 2008, pp. 1-9. Available: http://bitcoin.org/bitcoin.pdf (accessed on 17 January 2023).
  • [2]Kim S, Kwon Y, Cho S. A survey of scalability solutions on blockchain. 2018 International Conference on Information and Communication Technology Convergence (ICTC), Jeju, Korea (South), 2018, pp. 1204-1207.
  • [3]Rouhani S, Deters R. Security, performance, and applications of smart contracts: A systematic survey. IEEE Access 2019, (7):50759-50779.
  • [4]Wang R, Ye K, Xu CZ. Performance benchmarking and optimization for blockchain systems: A survey. International Conference on Blockchain, Cham: Springer, 2019, pp. 171-185.
  • [5]Zheng X, Zhu Y, Si X. A survey on challenges and progresses in blockchain technologies: A performance and security perspective. Appl Sci 2019, 9(22):4731.
  • [6]Smetanin S, Ometov A, Komarov M, Masek P, Koucheryavy Y. Blockchain evaluation approaches: State-of-the-art and future perspective. Sensors 2020, 20(12):3358.
  • [7]Singh A, Click K, Parizi RM, Zhang Q, Dehghantanha A, et al. Sidechain technologies in blockchain networks: An examination and state-of-the-art review. J Netw Comput 2020, 149:102471.
  • [8]Zhou Q, Huang H, Zheng Z, Bian J. Solutions to scalability of blockchain: A survey. IEEE Access 2020, 8:16440-16455.
  • [9]Yu G, Wang X, Yu K, Ni W, Zhang J, et al. Survey: sharding in blockchains. IEEE Access 2020, 8:14155-14181.
  • [10]Fan C, Ghaemi S, Khazaei H, Musilek P. Performance evaluation of blockchain systems: A systematic survey. IEEE Access 2020, 8:126927-126950.
  • [11]Cao B, Wang Z, Zhang L, Feng D, Peng M, et al. Blockchain systems, technologies and applications: A methodology perspective. arXiv 2021, arXiv:2105.03572.
  • [12]Huang H, Kong W, Zhou S, Zheng Z, Guo S. A survey of state-of-the-art on blockchains: Theories, modelings, and tools. ACM Comput Surv 2021, 54(2):1-42.
  • [13]Wang X, Wu LY. Operations research in the Blockchain technology. Journal of the Operations Research Society of China 2022, 10:401-422.
  • [14]Li QL, Ma JY, Chang YX. Blockchain queue theory. International Conference on Computational Social Networks, Cham: Springer, 2018, pp. 25-40.
  • [15]Chang YX, Li QL, Wang Q, Song XS. Dynamic practical byzantine fault tolerance and its blockchain system: A large-Scale markov modeling. arXiv 2022, arXiv:2210.14003.
  • [16]Kawase Y, Kasahara S. Transaction-confirmation time for bitcoin: A queueing analytical approach to blockchain mechanism. International Conference on Queueing Theory and Network Applications, Cham: Springer, 2017, pp. 75-88.
  • [17]Kasahara S, Kawahara J. Effect of Bitcoin fee on transaction-confirmation process. J Ind Manag Optim 2019, 15(1):365.
  • [18]Li QL, Ma JY, Chang YX, Ma FQ, Yu H. Markov processes in blockchain systems. Comput 2019, 6(1):1-28.
  • [19]Geissler S, Prantl T, Lange S, Wamser F, Hossfeld T. Discrete-time analysis of the blockchain distributed ledger technology. 2019 31st International Teletraffic Congress (ITC 31), Budapest, Hungary, 2019, pp. 130-137.
  • [20]Zhao W, Jin S, Yue W. Analysis of the average confirmation time of transactions in a blockchain system. International Conference on Queueing Theory and Network Applications, Cham: Springer, 2019, pp. 379-388.
  • [21]Krieger UR, Ziegler MH, Cech HL. Performance modeling of the consensus mechanism in a permissioned blockchain. International Conference on Computer Networks, Cham: Springer, 2019, pp. 3-17.
  • [22]Ahmad A, Saad M, Njilla L, Kamhoua C, Bassiouni M, et al. Blocktrail: A scalable multichain solution for blockchain-based audit trails. ICC 2019-2019 IEEE International Conference on Communications (ICC), Shanghai, China, 2019, pp. 1-6.
  • [23]Mišić J, Mišić VB, Chang X, Motlagh SG, Ali MZ. Modeling of bitcoin’s blockchain delivery network. IEEE Trans Netw Sci Eng 2019, 7(3):1368-1381.
  • [24]He J, Zhang G, Zhang J, Zhang R. An economic model of blockchain: The interplay between transaction fees and security. Available at SSRN 3616869, 2020, pp. 1-41.
  • [25]Fang M, Liu J. Toward low-cost and stable blockchain networks. ICC 2020-2020 IEEE International Conference on Communications (ICC), Dublin, Ireland, 2020, pp. 1-6.
  • [26]Frolkova M, Mandjes M. A Bitcoin-inspired infinite-server model with a random fluid limit. Stoch 2019, 35(1):1-32.
  • [27]Fralix B. On classes of Bitcoin-inspired infinite-server queueing systems. Queueing Syst 2020, 95(1):29-52.
  • [28]Seol J, Kancharla A, Ke Z, Kim H, Park N. A variable bulk arrival and static bulk service queueing model for blockchain. In Proceedings of the 2nd ACM International Symposium on Blockchain and Secure Critical Infrastructure, Taipei, Taiwan, October 6, 2020, pp. 63-72.
  • [29]Gopalan A, Sankararaman A, Walid A, Vishwanath S. Stability and scalability of blockchain systems. In Proceedings of the ACM on Measurement and Analysis of Computing Systems, online, June 2020, 4(2), pp. 1-35.
  • [30]Meng T, Zhao Y, Wolter K, Xu CZ. On consortium blockchain consistency: A queueing network model approach. IEEE Trans Parallel Distrib Syst 2021, 32(6): 1369-1382.
  • [31]Sun L, Yang Q, Chen X, Chen Z. RC-chain: Reputation-based crowdsourcing blockchain for vehicular networks. J Netw Comput 2021, 176:102956.
  • [32]Altarawneh A, Sun F, Brooks RR, Hambolu O, Yu L, et al. Availability analysis of a permissioned blockchain with a lightweight consensus protocol. Comput Secur 2021, 102:102098.
  • [33]Ricci S, Ferreira E, Menasche DS, Ziviani A, Souza JE, et al. Learning blockchain delays: A queueing theory approach. ACM SIGMETRICS Performance Evaluation Review 2019, 46(3):122-125.
  • [34]Sukhwani H, Wang N, Trivedi KS, Rindos A. Performance modeling of hyperledger fabric (permissioned blockchain network). 2018 IEEE 17th International Symposium on Network Computing and Applications (NCA), Cambridge MA, USA, 2018, pp. 1-8.
  • [35]Li J, Yuan Y, Wang S, Wang F. Transaction queuing game in bitcoin blockchain. 2018 IEEE Intelligent Vehicles Symposium, Changshu, China, 2018, pp. 114-119.
  • [36]Memon RA, Li JP, Ahmed J. Simulation model for blockchain systems using queuing theory. Electronics 2019, 8(2):234.
  • [37]Spirkina AV, Aptrieva EA, Elagin VS, Shvidkiy AA, Savelieva AA. Approaches to modeling blockchain systems. 2020 12th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), Brno, Czech Republic, 2020, pp. 242-247.
  • [38]Wilhelmi F, Giupponi L, Dini P. Blockchain-enabled server-less federated learning. arXiv 2021, arXiv:2112.07938.
  • [39]Bowden R, Keeler HP, Krzesinski AE, Taylor PG. Modeling and analysis of block arrival times in the Bitcoin blockchain. Stoch 2020, 36(4):602-637.
  • [40]Li QL. Constructive Computation in Stochastic Models with Applications: The RG-factorizations. Springer, 2010.
  • [41]Eyal I, Sirer EG. Majority is not enough: Bitcoin mining is vulnerable. Commun 2018, 61(7):95-102.
  • [42]Li QL, Chang YX, Wu X, Zhang G. A new theoretical framework of pyramid markov processes for blockchain selfish mining. J Syst Sci Syst Eng 2021, 30(6):667- 711.
  • [43]Gőbel J, Keeler HP, Krzesinski AE, Taylor PG. Bitcoin blockchain dynamics: The selfish-mine strategy in the presence of propagation delay. Perform Evaluation 2016, 104:23-41.
  • [44]Javier K, Fralix B. A further study of some Markovian Bitcoin models from Gőbel et al. Stoch 2020, 36(2):223-250.
  • [45]Nayak K, Kumar S, Miller A, Shi E. Stubborn mining: Generalizing selfish mining and combining with an eclipse attack. 2016 IEEE European Symposium on Security and Privacy, Saarbruecken, Germany, 2016, pp. 305-320.
  • [46]Wang Z, Liu J, Wu Q, Zhang Y, Zhou Z. An analytic evaluation for the impact of uncle blocks by selfish and stubborn mining in an imperfect ethereum network. Comput Secur 2019, 87(101581): 1-10.
  • [47]Liu Y, Hei Y, Xu T, Liu J. An evaluation of uncle block mechanism effect on ethereum selfish and stubborn mining combined with an eclipse attack. IEEE Access 2020, 8:17489-17499.
  • [48]Grunspan C, Pérez-Marco R. Selfish mining in ethereum. Mathematical Research for Blockchain Economy, Cham: Springer, 2020, pp. 65-90.
  • [49]Niu J, Feng C. Selfish mining in ethereum. 2019 IEEE 39th International Conference on Distributed Computing Systems, Dallas TX, USA, 2019, pp. 1306-1316.
  • [50]Bai Q, Zhou X, Wang X, Xu Y, Wang X, et al. A deep dive into blockchain selfish mining. ICC 2019-2019 IEEE International Conference on Communications (ICC), Shanghai, China, 2019, pp. 1-6.
  • [51]Bai Q, Xu Y, Liu N, Wang X. Blockchain Mining with Multiple Selfish Miners. arXiv 2021, arXiv:2112.10454.
  • [52]Chang D. Revenue generation strategy through selfish mining focusing multiple pools of honest miners. Bachelor of Technology, Computer Science and Applied Mathematics, Indraprastha Institute of Information Technology, New Delhi, India, 2019.
  • [53]Liu H, Ruan N, Du R, Jia W. On the strategy and behavior of Bitcoin mining with N-attackers. In Proceedings of the 2018 on Asia Conference on Computer and Communications Security, Incheon, Republic of Korea, 4 June, 2018, pp. 357-368.
  • [54]Marmolejo-Cossío FJ, Brigham E, Sela B, Katz J. Competing (semi-) selfish miners in Bitcoin. In Proceedings of the 1st ACM Conference on Advances in Financial Technologies, Zurich Switzerland, October 21-23, 2019, pp. 89-109.
  • [55]Xia Q, Dou W, Xi T, Zeng J, Zhang F, et al. The impact analysis of multiple miners and propagation delay on selfish mining. 2021 IEEE 45th Annual Computers, Software, and Applications Conference (COMPSAC), Madrid, Spain, 2021, pp. 694-703.
  • [56]Song XS, Li QL, Chang YX, Zhang C. A markov process theory for network growth processes of DAG-based blockchain systems. arXiv 2022, arXiv:2209.01458.
  • [57]Li Y, Cao B, Peng M, Zhang L, Zhang L, et al. Direct acyclic graph-based ledger for Internet of Things: Performance and security analysis. IEEE ACM T Netw 2020, 28(4):1643-1656.
  • [58]Ma FQ, Li QL, Liu YH, Chang YX. Stochastic performance modeling for practical Byzantine fault tolerance consensus in blockchain. Peer Peer Netw Appl 2021, 15(6):2516-2528.
  • [59]Carlsten M. The impact of transaction fees on bitcoin mining strategies. Master’s Thesis, Department of Computer Science, Princeton University, 2016.
  • [60]Shi L, Wang T, Li J, Zhang S. Pooling is not favorable: Decentralize mining power of PoW blockchain using age-of-work. arXiv 2021, arXiv:2104.01918.
  • [61]Kiffer L, Rajaraman R, Shelat A. A better method to analyze blockchain consistency. In Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security, Toronto Canada, October 15-19, 2018, pp. 729-744.
  • [62]Huang D, Ma X, Zhang S. Performance analysis of the raft consensus algorithm for private blockchains. IEEE Trans Syst Man Cybern Syst 2019, 50(1):172-181.
  • [63]Srivastava R. Mathematical assessment of blocks acceptance in blockchain using Markov model. Int J Blockchains Cryptocurrencies 2019, 1(1): 42-53.
  • [64]Li Y, Cao B, Liang L, Mao D, Zhang L. Block access control in wireless blockchain network: Design, modeling and analysis. IEEE Trans Veh Technol 2021, 70(9):9258-9272.
  • [65]Piriou PY, Dumas JF. Simulation of stochastic blockchain models. 2018 14th European Dependable Computing Conference, Iasi, Romania, 2018, pp. 150-157.
  • [66]Nguyen DC, Pathirana PN, Ding M, Seneviratne A. Privacy-preserved task offloading in mobile blockchain with deep reinforcement learning. IEEE Trans Netw Service Manag 2020, 17(4):2536-2549.
  • [67]Jofré A, Pardo A, Salas D, Verdugo V, Verschae J. The convergence rates of blockchain mining games: A Markovian approach. arXiv 2021, arXiv:2107.08077.
  • [68]Spitzer F. Principles of Random Walk. Springer, 2001.
  • [69]Prabhu NU. Stochastic Storage Processes: Queues, Insurance Risk, and Dams, and Data Communication. Springer, 1998.
  • [70]Xia F, Liu J, Nie H, Fu Y, Wan L, et al. Random walks: A review of algorithms and applications. IEEE Transactions on Emerging Topics in Computational Intelligence 2020, 4(2):95-107.
  • [71]Goffard PO. Fraud risk assessment within blockchain transactions. Adv Appl Probab 2019, 51(2):443-467.
  • [72]Jang J, Lee HN. Profitable double-spending attacks. Appl Sci 2020, 10(23):8477.
  • [73]Brown M, Peköz E, Ross S. Blockchain double-spend attack duration. Probab Eng Inf Sci 2021, 35(4):858-866.
  • [74]Grunspan C, Pérez-Marco R. On profitability of nakamoto double spend. Probab Eng Inf Sci 2021, 36(3):732-746.
  • [75]Chen H, Yao DD. Fundamentals of Queueing Networks: Performance, Asymptotics, and Optimization. Springer, 2001.
  • [76]Whitt W. Stochastic-process Limits: An Introduction to Stochastic-process Limits and Their Application to Queues. Springer, 2002.
  • [77]Dai JG, He S. Many-server queues with customer abandonment: A survey of diffusion and fluid approximations. J Syst Sci Syst Eng 2012, 21(1):1-36.
  • [78]Büke B, Chen H. Fluid and diffusion approximations of probabilistic matching systems. Queueing Syst 2017, 86(1):1-33.
  • [79]Chen H, Shanthikumar JG. Fluid limits and diffusion approximations for networks of multi-server queues in heavy traffic. Discrete Event Dyn S 1994, 4(3):269-291.
  • [80]King C. The fluid limit of a random graph model for a shared ledger. Adv Appl Probab 2021, 53(1):81-106.
  • [81]Ferraro P, King C, Shorten R. On the stability of unverified transactions in a DAG-based distributed ledger. IEEE Trans Automat Contr 2019, 65(9):3772-3783.
  • [82]Koops D. Predicting the confirmation time of bitcoin transactions. arXiv 2018, arXiv:1809.10596.
  • [83]Corcino R, Casas KP, Elnar AR. Bitcoin: A Non-markovian stochastic process. J Eng Sci Technol 2018, 6:287-298.
  • [84]Chevallier J, Goutte S, Guesmi K, Saadi S. On the Bitcoin price dynamics: An augmented Markov-switching model with Lévy jumps. HAL Id: halshs-02120636 2019, 1-17.
  • [85]Li QL, Chang YX, Zhang C. Tree representation, growth rate of Blockchain and reward allocation in Ethereum with multiple mining pools. IEEE Trans Netw Service Manag, online publication, 2022, pp. 1-19.
  • [86]Grunspan C, Pérez-Marco R. On profitability of selfish mining. arXiv 2018, arXiv:1805.08281.
  • [87]Grunspan C, Pérez-Marco R. On profitability of stubborn mining. arXiv 2018, arXiv:1808.01041.
  • [88]Grunspan C, Pérez-Marco R. On profitability of trailing mining. arXiv 2018, arXiv:1811.09322.
  • [89]Grunspan C, Pérez-Marco R. The mathematics of Bitcoin. J Eur Math Soc 2020, 115:31-37.
  • [90]Grunspan C, Pérez-Marco R. Profit lag and alternate network mining. arXiv 2020, arXiv:2010.02671.
  • [91]Lundbaek LN, D’Iddio AC, Huth M. Optimizing governed blockchains for financial process authentications. arXiv 2016, arXiv:1612.00407.
  • [92]Liang K. Fission: A provably fast, scalable, and secure permissionless blockchain. arXiv 2018, arXiv:1812.05032.
  • [93]Nguyen LN, Nguyen TD, Dinh TN, Thai MT. Optchain: optimal transactions placement for scalable blockchain sharding. 2019 IEEE 39th International Conference on Distributed Computing Systems, Dallas TX, USA, 2019, pp. 525-535.
  • [94]Wang P, Xu H, Jin X, Wang T. Flash: efficient dynamic routing for offchain networks. In Proceedings of the 15th International Conference on Emerging Networking Experiments And Technologies, Orlando FL, USA, December 9-12, 2019, pp. 370-381.
  • [95]Saad M, Njilla L, Kamhoua C, Kim J, Nyang D, et al. Mempool optimization for defending against DDoS attacks in PoW-based blockchain systems. 2019 IEEE international conference on blockchain and cryptocurrency, Seoul, Korea (South), 2019, pp. 285-292.
  • [96]Reddy BS, Sharma GVV. Scalable consensus protocols for poW based blockchain and blockDAG. arXiv 2020, arXiv:2010.05447.
  • [97]Leonardos S, Reijsbergen D, Piliouras G. Weighted voting on the blockchain: Improving consensus in proof of stake protocols. Int J Netw Manag 2020, 30(5):e2093.
  • [98]Liu Y, Fang Z, Cheung MH, Cai W, Huang J. An incentive mechanism for sustainable blockchain storage. arXiv 2021, arXiv:2103.05866.
  • [99]Varma SM, Maguluri ST. Throughput optimal routing in blockchain-based payment systems. IEEE Trans Control Netw Syst 2021, 8(4):1859-1868.
  • [100]Li C, Zhang L, Fang S. EntrapNet: A blockchain-based verification protocol for trustless computing. IEEE Internet Things J 2021, 9(11):8024-8035.
  • [101]Kang J, Xiong Z, Niyato D, Wang P, Ye D, et al. Incentivizing consensus propagation in proof-of-stake based consortium blockchain networks. IEEE Wireless Commun Lett 2018, 8(1):157-160.
  • [102]Aggarwal V, Tan Y. A structural analysis of bitcoin cash’s emergency difficulty adjustment algorithm. Available at SSRN 3383739, 2019, pp. 1-36.
  • [103]Ramezan G, Leung C, Miao C. Optimal transaction queue waiting in blockchain mining. arXiv 2020, arXiv:2011.10886.
  • [104]Riehl JR, Ward J. Transaction pricing for maximizing throughput in a sharded blockchain ledger. 2020 Crypto Valley Conference on Blockchain Technology, Rotkreuz, Switzerland, 2020, pp. 36-42.
  • [105]Zhou Z, Li R, Cao Y, Zheng L, Xiao H. Dynamic performance evaluation of blockchain technologies. IEEE Access 2020, 8:217762-217772.
  • [106]Puterman ML. Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons, 2014.
  • [107]Li QL, Ma JY, Fan RN, Xia L. An overview for Markov decision processes in queues and networks. International Conference of Celebrating Professor Jinhua Cao’s 80th Birthday, Springer, Singapore, 2019, pp. 44-71.
  • [108]Sapirshtein A, Sompolinsky Y, Zohar A. Optimal selfish mining strategies in bitcoin. International Conference on Financial Cryptography and Data Security, Cham: Springer, 2016, pp. 515-532.
  • [109]Sompolinsky Y, Zohar A. Bitcoin’s security model revisited. arXiv 2016, arXiv:1605.09193.
  • [110]Gervais A, Karame GO, Wüst K, Glykantzis V, Ritzdorf H, et al. On the security and performance of proof of work blockchains. In Proceedings of the 2016 ACM SIGSAC conference on computer and communications security, Vienna Austria, October 24-28, 2016, pp. 3-16.
  • [111]Zur RB, Eyal I, Tamar A. Efficient MDP analysis for selfish-mining in blockchains. In Proceedings of the 2nd ACM Conference on Advances in Financial Technologies, New York NY, USA, October 21-23, 2020, pp. 113-131.
  • [112]Li T, Wang Z, Yang G, Cui Y, Chen Y, et al. Semi-selfish mining based on hidden Markov decision process. Int J Intell 2021, 36(7):3596-3612.
  • [113]Ma JY, Li QL. Sensitivity-based optimization for blockchain selfish mining. J Comb Optim, online publication, 2021, pp. 1-38.
  • [114]Niu J, Wang Z, Gai F, Feng C. Incentive analysis of Bitcoin-NG, revisited. ACM SIGMETRICS Performance Evaluation Review 2021, 48(3):59-60.
  • [115]Wüst K. Security of blockchain technologies. Master’s Thesis, ETH Zürich, 2016.
  • [116]Chicarino V, Albuquerque C, Jesus E, Rocha A. On the detection of selfish mining and stalker attacks in blockchain networks. Ann Telecommun 2020, 75(3):143-152.
  • [117]Liu Y, Yu FR, Li X, Ji H, Leung VC. Blockchain and machine learning for communications and networking systems. IEEE Commun Surv Tutor 2020, 22(2):1392-1431.
  • [118]Ekramifard A, Amintoosi H, Seno AH, Dehghantanha A, Parizi RM. A systematic literature review of integration of blockchain and artificial intelligence. Blockchain Cybersecurity, Trust and Privacy 2020, 147-160.
  • [119]Chen F, Wan H, Cai H, Cheng G. Machine learning in/for blockchain: Future and challenges. Can J Stat 2021, 49(4):1364-1382.
  • [120]Shafay M, Ahmad RW, Salah K, Yaqoob I, Jayaraman R, et al. Blockchain for deep learning: review and open challenges. Cluster Comput, 2022, pp. 1-25. Available: https://doi.org/10.1007/s10586-022-03582-7 (accessed on 17 January 2023).
  • [121]Hou C, Zhou M, Ji Y, Daian P, Tramer F, et al. SquirRL: Automating attack analysis on blockchain incentive mechanisms with deep reinforcement learning. arXiv 2019, arXiv:1912.01798.
  • [122]Bar-Zur R. Finding Optimal Strategies in Blockchain Protocols with Reinforcement Learning. Master’s Thesis, Israel Institute of Technology, Haifa, 2020.
  • [123]Wang T, Liew SC, Zhang S. When blockchain meets AI: Optimal mining strategy achieved by machine learning. Int J Intell 2021, 36(5):2183-2207.
  • [124]You J. Blockchain framework for artificial intelligence computation. arXiv 2022, arXiv:2202.11264.
  • [125]Qiu X, Liu L, Chen W, Hong Z, Zheng Z. Online deep reinforcement learning for computation offloading in blockchain-empowered mobile edge computing. IEEE Trans Veh Technol 2019, 68(8):8050-8062.
  • [126]Feng J, Yu FR, Pei Q, Chu X, Du J, et al. Cooperative computation offloading and resource allocation for blockchain-enabled mobile-edge computing: A deep reinforcement learning approach. IEEE Internet Things J 2019, 7(7):6214-6228.
  • [127]Asheralieva A, Niyato D. Learning-based mobile edge computing resource management to support public blockchain networks. IEEE Trans Mob Comput 2019, 20(3):1092-1109.
  • [128]Asheralieva A, Niyato D. Bayesian reinforcement learning and bayesian deep learning for blockchains with mobile edge computing. IEEE Trans Cogn 2020, 7(1):319-335.
  • [129]Yuan S, Li J, Liang J, Zhu Y, Yu X, et al. Sharding for blockchain based mobile edge computing system: A deep reinforcement learning approach. 2021 IEEE Global Communications Conference (GLOBECOM), Madrid, Spain, 2021, pp. 1-6.
  • [130]Waheed N, He X, Ikram M, Usman M, Hashmi SS, et al. Security and privacy in IoT using machine learning and blockchain: Threats and countermeasures. ACM Comput Surv 2020, 53(6):1-37.
  • [131]Gao Y, Wu W, Nan H, Sun Y, Si P. Deep reinforcement learning based task scheduling in mobile blockchain for iot applications. ICC 2020-2020 IEEE International Conference on Communications (ICC), Dublin, Ireland, 2020, pp. 1-7.
  • [132]Qiu C, Yu FR, Yao H, Jiang C, Xu F, et al. Blockchain-based software-defined industrial Internet of Things: A dueling deep Q-learning approach. IEEE Internet Things J 2018, 6(3):4627-4639.
  • [133]Luo J, Chen Q, Yu FR, Tang L. Blockchain-enabled software-defined industrial internet of things with deep reinforcement learning. IEEE Internet Things J 2020, 7(6):5466-5480.
  • [134]Yang L, Li M, Si P, Yang R, Sun E, et al. Energy-efficient resource allocation for blockchain-enabled industrial Internet of Things with deep reinforcement learning. IEEE Internet Things J 2020, 8(4):2318-2329.
  • [135]Wu Y, Wang Z, Ma Y, Leung VC. Deep reinforcement learning for blockchain in industrial IoT: A survey. Comput Netw 2021, 191:108004.
  • [136]Ma C, Li J, Shi L, Ding M, Wang T, et al. When federated learning meets blockchain: A new distributed learning paradigm. IEEE Comput Intell Mag 2022, 17(3):26-33.
  • [137]Qu Y, Uddin MP, Gan C, Xiang Y, Gao L, et al. Blockchain-enabled federated learning: A survey. ACM Comput Surv 2022, 55(4):1-35.
  • [138]Wang Z, Hu Q. Blockchain-based federated learning: A comprehensive survey. arXiv 2021, arXiv:2110.02182.
  • [139]Awan S, Li F, Luo B, Liu M. Poster: A reliable and accountable privacy-preserving federated learning framework using the blockchain. In Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security, London United Kingdom, November 11-15, 2019, pp. 2561-2563.
  • [140]Javed AR, Hassan MA, Shahzad F, Ahmed W, Singh S, et al. Integration of blockchain technology and federated learning in vehicular (iot) networks: A comprehensive survey. Sensors 2022, 22(12):4394.
  • [141]Ali M, Karimipour H, Tariq M. Integration of blockchain and federated learning for Internet of Things: Recent advances and future challenges. Comput Secur 2021, 108:102355.
  • [142]Martinez I, Francis S, Hafid AS. Record and reward federated learning contributions with blockchain. 2019 International conference on cyber-enabled distributed computing and knowledge discovery (CyberC), Guilin, China, 2019, pp. 50-57.
  • [143]Nguyen DC, Ding M, Pham QV, Pathirana PN, Le LB, et al. Federated learning meets blockchain in edge computing: Opportunities and challenges. IEEE Internet Things J 2021, 8(16):12806-12825.
  • [144]Qu Y, Gao L, Luan TH, Xiang Y, Yu S, et al. Decentralized privacy using blockchain-enabled federated learning in fog computing. IEEE Internet Things J 2020, 7(6):5171-5183.
  • [145]Pokhrel SR, Choi J. Federated learning with blockchain for autonomous vehicles: Analysis and design challenges. IEEE Trans Commun 2020, 68(8):4734-4746.
  • [146]Lu Y, Huang X, Dai Y, Maharjan S, Zhang Y. Blockchain and federated learning for privacy-preserved data sharing in industrial IoT. IEEE Trans Industr Inform 2019, 16(6):4177-4186.
  • [147]Lu Y, Huang X, Zhang K, Maharjan S, Zhang Y. Blockchain empowered asynchronous federated learning for secure data sharing in internet of vehicles. IEEE Trans Veh Technol 2020, 69(4):4298-4311.
  • [148]Lu Y, Huang X, Zhang K, Maharjan S, Zhang Y. Blockchain and federated learning for 5G beyond. IEEE Netw 2020, 35(1):219-225.
  • [149]Zhao Y, Zhao J, Jiang L, Tan R, Niyato D, et al. Privacy-preserving blockchainbased federated learning for IoT devices. IEEE Internet Things J 2020, 8(3): 1817-1829.
  • [150]ur Rehman MH, Salah K, Damiani E, Svetinovic D. Towards blockchain-based reputation-aware federated learning. IEEE INFOCOM 2020-IEEE Conference on Computer Communications Workshops, Toronto ON, Canada, 2020, pp. 183-188.
  • [151]Catalini C. How blockchain technology will impact the digital economy. Blockchains Smart Contracts Internet Things 2017, 4:2292-2303.
  • [152]Mori T. Financial technology: Blockchain and securities settlement. Journal of Securities Operations & Custody 2016, 8(3):208-227.
  • [153]Gupta A, Siddiqui ST, Alam S, Shuaib M. Cloud computing security using blockchain. J Emerg Technol Innov Res 2019, 6(6):791-794.
  • [154]Dennis R, Owen G. Rep on the block: A next generation reputation system based on the blockchain. 2015 10th International Conference for Internet Technology and Secured Transactions (ICITST), London, UK, 2015, pp. 131-138.
  • [155]Tang S, Wang Z, Dong J, Ma Y. Blockchain-enabled social security services using smart contracts. IEEE Access 2022, 10:73857-73870.
  • [156]Liu Z, Li Z. A blockchain-based framework of cross-border e-commerce supply chain. Int J Inf Manag 2020, 52:102059.
  • [157]Hussain AA, Al-Turjman F. Artificial intelligence and blockchain: A review. Trans Emerg Telecommun 2021, 32(9):e4268.
  • [158]Hawlitschek F, Notheisen B, Teubner T. The limits of trust-free systems: A literature review on blockchain technology and trust in the sharing economy. Electron Commer Res Appl 2018, 29:50-63.
  • [159]Saberi S, Kouhizadeh M, Sarkis J, Shen L. Blockchain technology and its relationships to sustainable supply chain management. Int J Prod Res 2019, 57(7):2117- 2135.
  • [160]Poon J, Dryja T. The bitcoin lightning network: Scalable off-chain instant payments. 2016, pp. 1-59. Available: https://www.bitcoinlightning.com/wpcontent/uploads/2018/03/lightning-network-paper.pdf (accessed on 17 January 2023).
  • [161]Back A, Corallo M, Dashjr L, Friedenbach M, Maxwell G, et al. Enabling blockchain innovations with pegged sidechains. 2014, 72:201-224. Available: http://www. opensciencereview.com/papers/123/enablingblockchain-innovationswith-pegged-sidechains (accessed on 14 January 2023).
  • [162]Luu L, Narayanan V, Zheng C, Baweja K, Gilbert S, et al. A secure sharding protocol for open blockchains. In Proceedings of the 2016 ACM SIGSAC conference on computer and communications security, Vienna Austria, October 24-28, 2016, pp. 17-30.
  • [163]Popov S. The Tangle. IOTA Foundation Technical Report. 2016, pp. 131-156.