Creative Combination of Legacy System and Map Reduce in Cloud Migration

doi:10.23940/ijpe.19.02.p22.579590

Abstract

Abstract:

With the advent of the big data era, the response speed of traditional legacy systems is gradually unable to meet the requirements of users. Because legacy systems carry domain knowledge and critical resources, many organizations are migrating legacy systems to cloud platform so as to maximize the reuse of legacy systems as well as improve the performance of big data processing. MapReduce is recognized as an effective programming model for processing big data in parallel mode in cloud computing. Therefore, how to creatively combine parallelizable legacy code and the MapReduce model to enable legacy code to be accurately mapped into the MapReduce model is a challenging issue. We use the first type of creative computing to propose an approach for legacy code refactoring. The legacy code of big data processing is divided into several types according to the business logic, and then the corresponding refactoring rules are proposed. We use the second type of creative computing to develop a tool to support the refactoring process. The experimental results indicate that the refactoring results are correct and efficient in practical scenarios.

Key words: legacy system, MapReduce, cloud migration, creative combination

Junfeng Zhao and Wenmeng Wang. Creative Combination of Legacy System and Map Reduce in Cloud Migration [J]. Int J Performability Eng, 2019, 15(2): 579-590.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

Figures/Tables 13

Figure 1

Table 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

References 25

[1]	L. Zhang and H. Yang, “Definition, Research Scope and Challenges of Creative Computing,”in Proceedings of 2013 19th International Conference on Automation and Computing: Future Energy and Automation, 2013
[2]	J. Dean and S. Ghemawat, “MapReduce: Simplified Data Processing on Large Clusters,” Communications of the ACM, Vol. 51, No. 1, pp. 107-113, January 2008
[3]	J. F . Zhao and J. T. Zhou, “Strategies and Methods for Cloud Migration,” International Journal of Automation and Computing, Vol. 11,No. 2, pp. 143-152, April 2014 doi: 10.1007/s11633-014-0776-7
[4]	R. Lustig , “The Creative Mind: Myths and Mechanisms, ” Artificial Intelligence, 1995
[5]	G. A. Wiggins , “A Preliminary Framework for Description, Analysis andComparison of Creative Systems,”Knowledge-based Systems, Vol. 19, No. 7, pp. 449-458, 2006 doi: 10.1016/j.knosys.2006.04.009
[6]	A. Hugill and H. Yang, “The Creative Turn: New Challenges for Computing,”International Journal of Creative Computing, Vol. 1, No. 1, pp. 4-19, 2013
[7]	R. J. Sternberg , “Handbook of Creativity, ” Cambridge University Press, 1999
[8]	J. Sawle, F. Raczinski, H. Yang , “A Framework for Creativity in Search Results,”in Proceedings of the Third International Conference on Creative Content Technologies, Rome, Italy, 2011
[9]	L. Zhang and H. Yang, “Knowledge Discovery in Creative Computing for Creative Tasks,” in Proceedings of the 1st Conference on Creativity in Intelligent Technologies and Data Science, Volgograd, Russia, 2015 doi: 10.1007/978-3-319-23766-4_7
[10]	A. Hugill, H. Yang, F. Raczinski, J. Sawle , “The Pataphysics of Creativity: Developing a Tool for Creative Search,”Digital Creativity, Vol. 24, No. 3, 2013 doi: 10.1080/14626268.2013.813377
[11]	T. Colburn and G. Shute, “Abstraction in Computer Science,”Minds and Machines, Vol. 17, No. 2, pp. 169-184, 2007
[12]	R. E. Mayer , “ Fifty Years of Creativity Research: In Handbook of Creativity,” Cambridge University Press, pp. 449-460, 1999
[13]	J. B. Zhang, D. Xiang, T. R. Li, Y. Pan , “M2M:A Simple Matlab-to-MapReduce Translator for Cloud Computing,” Tsinghua Science and Technology, Vol. 18, No. 1, pp. 1-9, 2013
[14]	R. Lee, T. Luo, Y. Huai, F. S. Wang, Y. Q. He, X. D. Zhang , “YSmart: Yet Another SQL-to-MapReduce Translator,” in Proceedings of 2011 31st International Conference on Distributed Computing Systems (ICDCS), pp. 25-36, Minneapolis, MN, USA, 2011 doi: 10.1109/ICDCS.2011.26
[15]	A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony , et al., “Hive: A Warehousing Solution over a Map-Reduce Framework,” Proceedings of the VLDB Endowment, Vol. 2, No. 2, pp. 1626-1629, 2009 doi: 10.14778/1687553.1687609
[16]	F. Gates, O. Natkovich, S. Chopra, P. Kamath, S. M. Narayanamurthy, C. Olston , et al., “Building a High-Level Dataflow System on Top of Map-Reduce: The Pig Experience,” Proceedings of the VLDB Endowment, Vol. 2, No. 2, pp. 1414-1425, 2009
[17]	C. Olston, B. Reed, U. Srivastava, R. Kumar, A. Tomkins, “Piglatin: A Not-so-foreign Language for Data Processing, ” in Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp. 1099-1110, 2008 doi: 10.1145/1376616.1376726
[18]	B. Li, J. B. Zhang, N. Yu, Y. Pan , “J2M: A Java to MapReduce Translator for Cloud Computing,” Journal of Supercomputing, Vol. 72, No. 5, pp. 1928-1945, 2016 doi: 10.1007/s11227-016-1695-x
[19]	R. Wottrich, R. Azevedo, G. Araujo , “Cloud-based OpenMP Parallelization using a MapReduce Runtime,” in Proceedings of the 26th International Symposium on Computer Architecture and High Performance Computing, pp. 334-341, SBAC-PAD, Paris, France, IEEE Computer Society, 2014 doi: 10.1109/SBAC-PAD.2014.46
[20]	A. Abouzeid, K. Bajda-Pawlikowski, D. Abadi, A. Silberschatz, A. Rasin , “HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads,” Proceedings of the VLDB Endowment, Vol. 2, No. 1, pp. 922-933, 2009 doi: 10.14778/1687627.1687731
[21]	K. Bajda-Pawlikowski, D. J. Abadi, A. Silberschatz, E. Paulson , “Efficient Processing of Data Warehousing Queries in a Split Execution Environment,” in Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 1165-1176, 2011
[22]	R. Chaiken, B. Jenkins , Per-Ake. Larson, J. R. Zhou, et al. “SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets,” Proceedings of the VLDB Endowment, Vol.1, No. 2, pp. 1265-1276, August 2008 doi: 10.14778/1454159.1454166
[23]	J. R. Zhou, N. Bruno, M. C. Wu , Per-Ake. Larson, R. Chaiken, and D. Shakib, “SCOPE: Parallel Databases Meet MapReduce,” VLDB Journal, Vol. 21, No. 5, pp. 611-636, 2012
[24]	Miner and A. Sbook, “MapReduce Design Patterns,” O'Reilly Media, pp. 256, 2012
[25]	J. F . Zhao and Z. M. Zhao, “Distributed Parallelizability Analysis of Legacy Code,” in Proceedings of the 16th IEEE International Symposium on Parallel and Distributed Processing with Applications, 2018

Java basic types	Hadoop basic types
Int	IntWritable
Long	LongWritable
Boolean	BooleanWritable
Float	FloatWritable
Double	DoubleWritable
String	Text