International Journal of Computer Networks and Applications (IJCNA)

Published By EverScience Publications

ISSN : 2395-0455

International Journal of Computer Networks and Applications (IJCNA)

International Journal of Computer Networks and Applications (IJCNA)

Published By EverScience Publications

ISSN : 2395-0455

Cooperative Device-to-Device Communication Using Joint Relay Assignment and Channel Allocation Using Deep Learning

Author NameAuthor Details

Md. Tabrej Khan, Ashish Adholiya

Md. Tabrej Khan[1]

Ashish Adholiya[2]

[1]Department Faculty of Computer Science, Pacific Academy of Higher Education and Research University, Udaipur (Rajasthan), India.

[2]Department Faculty of Computer Science, Pacific Academy of Higher Education and Research University, Udaipur (Rajasthan), India.

Abstract

Fusion centers support sensing and signal processing in decentralized mobile user communications. The backend network is made up of device-to-device (D2D) connections, which use appropriate channel selection to guarantee smooth connectivity. Delays and decreased dependability result from an imbalance in the distribution of channels. In cognitive radio networks, the behavior of primary users affects stability, whereas relay communication maximizes resources. In this regard, a joint channel selection and routing protocol, is proposed in this research based on deep reinforcement learning. The goal of this research is to minimize interference and optimize network performance by developing a deep reinforcement learning-based joint channel allocation and relay selection framework for D2D communication. Initially, the channel allocation technique is proposed using the enhanced hunter prey optimization (EnHpo) algorithm. The adaptive weighting method is integrated with the traditional hunter-prey optimization in the design of the proposed EnHpo to improve the convergence rate and produce the global optimum solution with balanced local search and randomization phases. Here, the multi-objective fitness function based on factors like priority, bandwidth and transmission rate are considered for the optimal channel allocation. Followed by, the relay selection is devised using the deep reinforcement learning criteria based on the channel gain based on the bit error rate. Here, the relay sub-set selection in the using the deep reinforcement learning improves D2D communication efficiency. The performance evaluation of the proposed joint channel allocation and relay selection mechanism in terms of Average Residual Energy, Latency, Network Life Time, Packet Delivery Ratio, and Throughput acquired the values of 0.998, 2.709, 99.592, 0.999, and 23015 respectively. The maximum throughput estimated by the proposed method is 23015, which is 54.73%, 41.63%, 29.98%, and 8.00% superior outcome compared to the conventional DDPG Approach, Zigbee/WiFi Routing, Decode and Forward method, and Game-based Framework methods with 100 nodes.

Index Terms

Deep Reinforcement Learning

Channel Allocation

Joint Optimization

Device to Device Communication

Cooperative Networks

Enhanced Hunter Prey Optimization

Residual Energy

Reference

  1. 1.
    Yang D, Li C, Ren B, Li H, Guo K. Analysis of relay selection schemes in underlay cognitive radio non-orthogonal multiple access networks. Int J Distrib Sens Networks. 2022 May 13;18(5):155014772110663.
  2. 2.
    Li X, Gao X, Shaikh SA, Zeng M, Huang G, Faseeh Qureshi NM, et al. NOMA-based cognitive radio network with hybrid FD/HD relay in industry 5.0. J King Saud Univ - Comput Inf Sci. 2023 Jun;35(6):101363.
  3. 3.
    Chen G, Chen G. A Cooperative Automatic Retransmission Request Technique Based on Listening Node Participation Competition. Appl Sci. 2023 Feb 8;13(4):2161.
  4. 4.
    Li S, Li H, Yang Q, Gaber J. Hybrid Cooperative Spectrum Sharing Protocols Based on OMA and NOMA in Cognitive Radio Networks. Appl Sci. 2022 Dec 10;12(24):12683.
  5. 5.
    Tarek D, Hafez MI. Development of Spectrum Sharing Protocol for Cognitive Radio Internet of Things. 2021.
  6. 6.
    Jasim SI, Akawee MM, Hasan RA. A spectrum sensing approaches in cognitive radio network by using cloud computing environment. Bull Electr Eng Informatics. 2022 Apr 1;11(2):750–7.
  7. 7.
    Cicio?lu M, Çalhan A, Miah MS. An effective routing algorithm for spectrum allocations in cognitive radio based internet of things. Concurr Comput Pract Exp. 2022 Dec 25;34(28).
  8. 8.
    Yu X, Cai Y, Li W, Zhou X, Tang L. Research on Dynamic Spectrum Allocation Algorithm Based on Cyclic Neural Network. Jafari Navimipour N, editor. Wirel Commun Mob Comput. 2022 Mar 23;2022:1–14.
  9. 9.
    Arshid K, Jianbiao Z, Hussain I, Pathan MS, Yaqub M, Jawad A, et al. Energy efficiency in cognitive radio network using cooperative spectrum sensing based on hybrid spectrum handoff. Egypt Informatics J. 2022 Dec;23(4):77–88.
  10. 10.
    P. Venkatapathi, H. Khan, S. Srinivasa Rao, and G. Immadi, “Cooperative Spectrum Sensing Performance Assessment using Machine Learning in Cognitive Radio Sensor Networks,” Engineering, Technology & Applied Science Research, vol. 14, no. 1, pp. 12875–12879, Feb. 2024.
  11. 11.
    Ferreira, M.V., Vieira, F.H. and Cardoso, Á.A., 2022. Power and delay optimization based uplink resource allocation for wireless networks with device-to-device communications. Computer Communications, 194, pp.226-239.
  12. 12.
    Isnawati AF. A Survey of Game Theoretical Approach in Cognitive Radio Network and 5G-6G Communications. J Commun. 2022;17(10):830–43.
  13. 13.
    Zafar MH, Khan I, Alassafi MO. An efficient resource optimization scheme for D2D communication. Digit Commun Networks. 2022 Dec;8(6):1122–9.
  14. 14.
    Alotaibi S. Interference Mitigation Strategy for D2D Communication in 5G Networks. Eng Technol Appl Sci Res. 2023 Aug 9;13(4):11318–25.
  15. 15.
    Omidkar A, Khalili A, Nguyen HH, Shafiei H. Reinforcement-Learning-Based Resource Allocation for Energy-Harvesting-Aided D2D Communications in IoT Networks. IEEE Internet Things J. 2022 Sep 1;9(17):16521–31.
  16. 16.
    Chatterjee S, De S. QoE-Aware Cross-Layer Adaptation for D2D Video Communication in Cooperative Cognitive Radio Networks. IEEE Syst J. 2022 Jun;16(2):2078–89.
  17. 17.
    Arun Mozhi Selvi S, Alroobaea R, Rubaiee S, S. Hanbazazah A. Optimized Resource Allocation for IoT-D2D Communication Using WSN. Comput Syst Sci Eng. 2023;45(2):1789–804.
  18. 18.
    Dejen A, Wondie Y, Förster A. Survey on D2D Resource Scheduling and Power Control Techniques: State-of-art and Challenges. ICST Trans Mob Commun Appl. 2018 Jul 13;173977.
  19. 19.
    Khoshafa MH, Ngatched TMN, Ahmed MH. Relay Selection for Improving Physical Layer Security in D2D Underlay Communications. IEEE Access .2022;10:95539–52.
  20. 20.
    Ahmad N, Sidhu GAS, Khan WU. A Learning Based Framework for Enhancing Physical Layer Security in Cooperative D2D Network. Electronics. 2022 Nov 30;11(23):3981.
  21. 21.
    Eappen G, T S, Nilavalan R. Cooperative relay spectrum sensing for cognitive radio network: Mutated MWOA-SNN approach. Appl Soft Comput. 2022 Jan;114:108072.
  22. 22.
    Farooq-i-Azam M, Ni Q, Dong M, Pervaiz H, Zarakovitis C, Alsolami F. Interference Avoidance in Cognitive Radio Networks Using Cooperative Localization. IEEE Syst J. 2022 Dec;16(4):5120–30.
  23. 23.
    Ramzan MR, Naeem M, Chughtai O, Ejaz W, Altaf M. Radio resource management in energy harvesting cooperative cognitive UAV assisted IoT networks: A multi-objective approach. Digit Commun Networks. 2023 Jan.
  24. 24.
    Salameh HB, Abdel-Razeq S, Al-Obiedollah H. Integration of Cognitive Radio Technology in NOMA-Based B5G Networks: State of the Art, Challenges, and Enabling Technologies. IEEE Access. 2023;11:12949–62.
  25. 25.
    Amini T, Abouei J. A matching?based context?aware relay assignment scheme with power control in ad?hoc wireless networks. IET Commun. 2023 Feb 28;17(3):348–61.
  26. 26.
    Alsunbuli BN, Fakhruldeen HF, Ismail W, Mahyuddin NM. Hybrid beamforming with relay and dual-base stations blockage mitigation in millimetre-wave 5G communication applied in (VIOT). Comput Electr Eng. 2022 May;100:107953.
  27. 27.
    Sun G, Li J, Wang A, Wu Q, Sun Z, Liu Y. Secure and Energy-Efficient UAV Relay Communications Exploiting Collaborative Beamforming. IEEE Trans Commun. 2022 Aug;70(8):5401–16.
  28. 28.
    Kumar R, Singh H. Machine learning solution of a coalitional game for optimal power allocation in multi-relay cooperative scenario. S?dhan?. 2022 Nov 22;47(4):250.
  29. 29.
    Imtiaz HH, Tang S. Multi-Task Partial Offloading with Relay and Adaptive Bandwidth Allocation for the MEC-Assisted IoT. Sensors. 2022 Dec 24;23(1):190.
  30. 30.
    Sarma SS, Hazra R, Chong PHJ. Performance Analysis of DF Relay-Assisted D2D Communication in a 5G mmWave Network. Futur Internet. 2022 Mar 24;14(4):101.
  31. 31.
    Zhang T, Zhu K, Wang J. Energy-Efficient Mode Selection and Resource Allocation for D2D-Enabled Heterogeneous Networks: A Deep Reinforcement Learning Approach. IEEE Trans Wirel Commun. 2021 Feb;20(2):1175–87.
  32. 32.
    Lee, W. and Schober, R., 2022. Deep learning-based resource allocation for device-to-device communication. IEEE Transactions on Wireless Communications, 21(7), pp.5235-5250.
  33. 33.
    Chennaboin, R.B. and Nandakumar, S., 2024. An adaptive MLP-based joint optimization of resource allocation and relay selection in device-to-device communication using hybrid meta-heuristic algorithm. EURASIP Journal on Wireless Communications and Networking, 2024(1), p.50.
  34. 34.
    Y. Yu and X. Tang, "Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications," in IEEE Access, vol. 12, pp. 196609-196623, 2024.
  35. 35.
    Logeshwaran, J., R. N. Shanmugasundaram, and Jaime Lloret. "Load based dynamic channel allocation model to enhance the performance of device-to-device communication in WPAN." Wireless Networks 30.4 (2024): 2477-2509.