Impact of Distributed-Memory Parallel Processing Approach on Performance Enhancing of Multicomputer-Multicore Systems: A Review

Dildar Masood Abdulqader; Subhi R. M. Zeebaree

doi:10.25212/lfu.qzj.6.4.45

Authors

Dildar Masood Abdulqader Department of Information Technology, Akre Technical College, Duhok Polytechnic University, Duhok, Kurdistan Region, Iraq
Subhi R. M. Zeebaree Culture Centre, Duhok Polytechnic University, Duhok, Kurdistan Region, Iraq

DOI:

https://doi.org/10.25212/lfu.qzj.6.4.45

Keywords:

Multicomputer, multicore, distributed system, parallel processing, performance enhancing.

Abstract

Distributed memory is a term used in computer science to describe a multiprocessor computer system in which each processor has its own private memory. Computational jobs can only work with local data, so if you need remote data, you'll have to communicate with one or more remote processors. Parallel and distributed computing are frequently used together. Distributed parallel computing employs many computing devices to process tasks in parallel, whereas parallel computing on a single computer uses multiple processors to execute tasks in parallel. Distributed systems are designed separately from the core network. There are different kinds of distributed systems such as peer-to-peer (P2P) networks, groups, grids, distributed storage systems. The multicore processor can be classified into two types: homogeneous and heterogeneous. This paper reviews the impact of the distributed-memory parallel processing approach on performance-enhancing of multicomputer-multicore systems. Also, number of methods have been introduced which used in distributed-memory systems and discuss which method is the best and enhance multicore performance in distributed systems. The best methods were those which used an operating system named gun/Linux 4.8.0-36, intel Xeon 2.5, python programming language.

Downloads

Download data is not yet available.

References

Agarwal, V. 2004. “Fault Tolerance in Distributed Systems, I. Institute of Technology Kanpur.”

Al-Wesabi, Fahd, Huda Iskandar, and Mokhtar Ghilan. 2019. “Improving Performance in Component Based Distributed Systems.” EAI Endorsed Transactions on Scalable Information Systems 6(22).

Amir, Yair, Yongdae Kim, Cristina Nita-Rotaru, John L. Schultz, Jonathan Stanton, and Gene Tsudik. 2004. “Secure Group Communication Using Robust Contributory Key Agreement.” IEEE Transactions on Parallel and Distributed Systems 15(5):468–80.

Anton, B., and A. Norbert. 2016. “Peer to Peer System Deployment.” Acta Electrotech. Inform 16:11–14.

Asaduzzaman, Abu, and Govipalagodage H. Gunasekara. 2012. “A Way Cache Locking Scheme Supported by Knowledge Based Smart Preload Effective for Low-Power Multicore Electronics.” Journal of Low Power Electronics 8(5):552–64.

Bansal, Sanjay, Sanjeev Sharma, and Ishita Trivedi. 2011. “A Detailed Review of Fault-Tolerance Techniques in Distributed System.” International Journal on Internet & Distributed Computing Systems 1(1).

Bhatia, Munish, Sandeep K. Sood, and Simranpreet Kaur. 2020. “Quantumized Approach of Load Scheduling in Fog Computing Environment for IoT Applications.” Computing 1–19.

Bianco, Michele Petracca Robert Birke Andrea. 2020. “HERO: High-Speed Enhanced Routing Operation in Ethernet NICs for Software Routers⋆.”

Blake, Geoffrey, Ronald G. Dreslinski, and Trevor Mudge. 2009. “A Survey of Multicore Processors.” IEEE Signal Processing Magazine 26(6):26–37.

Bridges, Matthew J., Neil Vachharajani, Yun Zhang, Thomas Jablin, and David I. August. 2008. “Revisiting the Sequential Programming Model for the Multicore Era.” IEEE Micro 28(1):12–20.

Chen, Xin, Xubin He, He Guo, and Yuxin Wang. 2011. “Design and Evaluation of an Online Anomaly Detector for Distributed Storage Systems.” J. Softw. 6(12):2379–90.

Dhingra, Swati, Rajasekhara Babu Madda, Rizwan Patan, Pengcheng Jiao, Kaveh Barri, and Amir H. Alavi. 2020. “Internet of Things-Based Fog and Cloud Computing Technology for Smart Traffic Monitoring.” Internet of Things 100175.

Dino, Hivi Ismat, Subhi R. M. Zeebaree, Omar M. Ahmad, Hanan M. Shukur, Rizgar R. Zebari, and Lailan M. Haji. n.d. “Impact of Load Sharing on Performance of Distributed Systems Computations.”

Fiat, Amos, and Jared Saia. 2002. “Censorship Resistant Peer-to-Peer Content Addressable Networks.” Pp. 94–103 in SODA. Vol. 2.

Gao, Yansong, Minki Kim, Sharif Abuadbba, Yeonjae Kim, Chandra Thapa, Kyuyeon Kim, Seyit A. Camtepe, Hyoungshick Kim, and Surya Nepal. 2020. “End-to-End Evaluation of Federated Learning and Split Learning for Internet of Things.” ArXiv Preprint ArXiv:2003.13376.

Grudenić, Igor, and Nikola Bogunović. 2009. “Computer Cluster and Grid Simulator.” in MIPRO 2009.

Haji, Lailan M., Subhi R. M. Zeebaree, Omar M. Ahmed, Amira B. Sallow, Karwan Jacksi, and Rizgar R. Zeabri. 2020. “Dynamic Resource Allocation for Distributed Systems and Cloud Computing.”

Harinath, Depavath, K. Ramesh Babu, P. Satyanarayana, and M. V. Ramana Murthy. 2015. “Enhancing Security Using Video Steganography and WaterMarking.” European Journal of Applied Sciences 3(5):1.

Hossain, Md, Mohammad Nowsin Amin Sheikh, Shawon Rahman, Sujan Biswas, and Md Ariful Islam Arman. 2018. “Enhancing and Measuring the Performance in Software Defined Networking.” International Journal of Computer Networks & Communications (IJCNC) 10(5).

Kaur, Ramanjyot, Tajinder Kaur, and Harpreet Kaur. 2013. “Scheduling in Grid Computing Environment.” International Journal of Advanced Research in Computer Science and Software Engineering 3(6):455–58.

Kotary, Dinesh Kumar, and Satyasai Jagannath Nanda. 2020. “Distributed Robust Data Clustering in Wireless Sensor Networks Using Diffusion Moth Flame Optimization.” Engineering Applications of Artificial Intelligence 87:103342.

Lakshmanan, Subramanian, Mustaque Ahamad, and H. Venkateswaran. 2003. “Responsive Security for Stored Data.” IEEE Transactions on Parallel and Distributed Systems 14(9):818–28.

Liu, Yinqiu, Kun Wang, Yun Lin, and Wenyao Xu. 2019. “$mathsf {LightChain} $: A Lightweight Blockchain System for Industrial Internet of Things.” IEEE Transactions on Industrial Informatics 15(6):3571–81.

Lu, Gang, Jianfeng Zhan, Xinlong Lin, Chongkang Tan, and Lei Wang. 2016. “On Horizontal Decomposition of the Operating System.” ArXiv Preprint ArXiv:1604.01378.

McCool, Michael D. 2008. “Scalable Programming Models for Massively Multicore Processors.” Proceedings of the IEEE 96(5):816–31.

Neelima, P., and A. Rama Mohan Reddy. 2020. “An Efficient Load Balancing System Using Adaptive Dragonfly Algorithm in Cloud Computing.” Cluster Computing 1–9.

Noor, Fazal, Abdulghani Ibrahim, and Mohammed M. AlKhattab. 2020. “Performance of Parallel Distributed Bat Algorithm Using MPI on a PC Cluster.” Annals of Emerging Technologies in Computing (AETiC) 4(1).

Parra, Gonzalo De La Torre, Paul Rad, Kim-Kwang Raymond Choo, and Nicole Beebe. 2020. “Detecting Internet of Things Attacks Using Distributed Deep Learning.” Journal of Network and Computer Applications 102662.

Phoemphon, Songyut, Chakchai So-In, and Tri Gia Nguyen. 2018. “An Enhanced Wireless Sensor Network Localization Scheme for Radio Irregularity Models Using Hybrid Fuzzy Deep Extreme Learning Machines.” Wireless Networks 24(3):799–819.

Ports, Dan R. K., Jialin Li, Vincent Liu, Naveen Kr Sharma, and Arvind Krishnamurthy. 2015. “Designing Distributed Systems Using Approximate Synchrony in Data Center Networks.” Pp. 43–57 in 12th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 15).

Puttaswamy, Krishna P. N., Heather Zheng, and Ben Y. Zhao. 2008. “Securing Structured Overlays against Identity Attacks.” IEEE Transactions on Parallel and Distributed Systems 20(10):1487–98.

Ramanathan, R. M. 2006. “Intel Multi-Core Processors: Making the Move to Quad-Core and Beyond.” Technology@ Intel Magazine 4(9):2–4.

Rao, S. N. Tirumala, Sireesha Moturi, and Vaddeswaram KLEF. 2018. “SCALABILITY OF MEMORY MAPPED K-MEANS ALGORITHM WITH HYPER-THREADED PROCESSORS.” International Journal of Pure and Applied Mathematics 120(6):4179–92.

Rao, S. N. Tirumala, E. V Prasad, and N. B. Venkateswarlu. 2009. “A Scalable K-Means Clustering Algorithm on Multi-Core Architecture.” Pp. 1–9 in 2009 Proceeding of International Conference on Methods and Models in Computer Science (ICM2CS). IEEE.

Rashid, Zryan Najat, Subhi R. M. Zebari, Karzan Hussein Sharif, and Karwan Jacksi. 2018. “Distributed Cloud Computing and Distributed Parallel Computing: A Review.” Pp. 167–72 in 2018 International Conference on Advanced Science and Engineering (ICOASE). IEEE.

Ratnasamy, Sylvia, Paul Francis, Mark Handley, Richard Karp, and Scott Shenker. 2001. “A Scalable Content-Addressable Network.” Pp. 161–72 in Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications.

Rauniyar, Ashish, Paal Engelstad, and Jonas Moen. 2018. “A New Distributed Localization Algorithm Using Social Learning Based Particle Swarm Optimization for Internet of Things.” Pp. 1–7 in 2018 IEEE 87th Vehicular Technology Conference (VTC Spring). IEEE.

Ren, Yongjun, Fujian Zhu, Pradip Kumar Sharma, Tian Wang, Jin Wang, Osama Alfarraj, and Amr Tolba. 2020. “Data Query Mechanism Based on Hash Computing Power of Blockchain in Internet of Things.” Sensors 20(1):207.

Rouse, Margaret. 2013. “Definition: Multi-Core Processor.” TechTarget. Retrieved March 6.

Rowstron, Antony, and Peter Druschel. 2001. “Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems.” Pp. 329–50 in IFIP/ACM International Conference on Distributed Systems Platforms and Open Distributed Processing. Springer.

Saafan, Ahmed. 2009. “Distributed Denial of Service Attacks: Explanation, Classification and Suggested Solutions.” 23 March 2009)[Online]. Available: Http://Www. Exploitdb. Com.

Shahid, Furqan, Abid Khan, and Gwanggil Jeon. 2020. “Post-Quantum Distributed Ledger for Internet of Things.” Computers & Electrical Engineering 83:106581.

Shukur, Hanan, Subhi Zeebaree, Rizgar Zebari, Omar Ahmed, Lailan Haji, and Dildar Abdulqader. 2020. “Cache Coherence Protocols in Distributed Systems.” Journal of Applied Science and Technology Trends 1(3):92–97.

Sklyarov, V., Artjom Rjabov, Iouliia Skliarova, and Alexander Sudnitson. 2016. “High-Performance Information Processing in Distributed Computing Systems.” International Journal of Innovative Computing, Information and Control 12(1):139–60.

Sondhi, Garima, and Abhinaya Ganesh. n.d. “An Overview of Multi Core Processors.”

Sreevidya, B., M. Rajesh, and T. M. Mamatha. 2018. “Design and Development of an Enhanced Security Scheme Using RSA for Preventing False Data Injection in Wireless Sensor Networks.” Pp. 225–36 in Ambient Communications and Computer Systems. Springer.

Van Steen, Maarten, and Andrew S. Tanenbaum. 2017. Distributed Systems. Maarten van Steen Leiden, The Netherlands.

Stoica, Ion, Robert Morris, David Karger, M. Frans Kaashoek, and Hari Balakrishnan. 2001. “Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications.” ACM SIGCOMM Computer Communication Review 31(4):149–60.

Sweilam, N. H., H. M. Moharram, and Sameh Ahmed. 2012. “On the Parallel Iterative Finite Difference Algorithm for 2-D Poisson’s Equation with MPI Cluster.” Pp. MM–78 in 2012 8th International Conference on Informatics and Systems (INFOS). IEEE.

Tan, Lucas, Fuyao Zhao, and Xu Zhang. 2019. “15712 Advanced Operating and Distributed System Android and IOS Platform Study Final Report.”

Wang, Chonggang, and Bo Li. 2003. “Peer-to-Peer Overlay Networks: A Survey.” Department of Computer Science, The Hong Kong University of Science and Technology, Hong Kong 9.

Wang, Lizhe, Jie Tao, Gregor von Laszewski, and Holger Marten. 2010. “Multicores in Cloud Computing: Research Challenges for Applications.” JCP 5(6):958–64.

Warasup, Kittipong, Masanori Hamamura, and Suwat Pattaramalai. 2020. “Performance Analysis for Asynchronous Requests in Wireless Networks with Multiple Packet Reception Capability.” Wireless Personal Communications 1–23.

Wei, Ting-Ying, Zhi-liang Qiu, Chung-ping Young, and Da-Wei Chang. 2011. “Development of Heterogeneous Multi-Core Embedded Platform for Automotive Applications.” in 2011 International Conference on Circuits, System and Simulation (IPCSIT). Vol. 7.

Yánez, Wendy, Redowan Mahmud, Rami Bahsoon, Yuqun Zhang, and Rajkumar Buyya. 2020. “Data Allocation Mechanism for Internet-of-Things Systems With Blockchain.” IEEE Internet of Things Journal 7(4):3509–22.

Yousefi, Shamim, Farnaz Derakhshan, Hadis Karimipour, and Hadi S. Aghdasi. 2020. “An Efficient Route Planning Model for Mobile Agents on the Internet of Things Using Markov Decision Process.” Ad Hoc Networks 98:102053.

Zeebaree, Subhi R. M., Lailan M. Haji, Imad Rashid, Rizgar R. Zebari, Omar M. Ahmed, Karwan Jacksi, and Hanan M. Shukur. 2020. “Multicomputer Multicore System Influence on Maximum Multi-Processes Execution Time.”

Zhao, Ben Yanbin, John Kubiatowicz, and Anthony D. Joseph. 2001. “Tapestry: An Infrastructure for Fault-Tolerant Wide-Area Location and Routing.”

Zhao, Xin, Wei Xiao, Lu Wu, Zhigang Zhao, Jidong Huo, Shi Wang, Zhenhua Guo, and Dianmin Sun. 2020. “Intelligent City Intelligent Medical Sharing Technology Based on Internet of Things Technology.” Future Generation Computer Systems.