Abstract
Machine translation system (MTS) constitutes of functionally heterogeneous modules for processing source language to a given target language. Deploying such an application on a stand-alone system requires much time, knowledge and complications. It even becomes more challenging for a common user to utilize such a complex application. This paper presents a MTS that has been developed using a combination of linguistic rich, rule-based and prominent neural-based approach. The proposed MTS is deployed on the cloud to offer translation as a cloud service and improve the quality of service (QoS) from a stand-alone system. It is developed on TensorFlow and deployed under the cluster of virtual machines in the Amazon web server (EC2). The significance of this paper is to demonstrate management of recurrent changes in term of corpus, domain, algorithm and rules. Further, the paper also compares the MTS as deployed on stand-alone machine and on cloud for different QoS parameters like response time, server load, CPU utilization and throughput. The experimental results assert that in the translation task, with the availability of elastic computing resources in the cloud environment, the job completion time irrespective of its size can be assured to be within a fixed time limit with high accuracy.
Similar content being viewed by others
References
Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M et al (2016) Tensorflow: a system for large-scale machine learning. OSDI 16:265–283
Abd-El-Malek M, Wachs M, Cipar J, Sanghi K, Ganger GR, Gibson GA, Reiter MK (2012) File system virtual appliances: portable file system implementations. ACM Trans Storage (TOS) 8(3):9
Ahmad R (2013) Engineering machine translation for deployment on cloud. PhD thesis. International Institute of Information Technology Hyderabad, India
Ahmad I, Ranka S (2016) Handbook of energy-aware and green computing-two volume set. CRC Press, Boca Raton
Ahmad R, Kumar P, Rambabu B, Sajja P, Sinha MK, Sangal R (2011a) Enhancing throughput of a machine translation system using mapreduce framework: an engineering approach. In: ICON
Ahmad R, Rathaur A, Rambabu B, Kumar P, Sinha MK, Sangal R (2011b) Provision of a cache by a system integration and deployment platform to enhance the performance of compute-intensive NLP applications. In: African conference on software engineering applied computing
Ahmad R, Kumar P, Kumar A, Sinha MK, Chaudhary B (2014) Improve user experience on web for machine translation system using storm. In: IEEE 4th international conference on big data and cloud computing. IEEE, New York, pp 243–248
Amazon E (2020) Amazon web services. Accessed on 28 Mar 2020
Asemi A, Salim SSB, Shahamiri SR, Asemi A, Houshangi N (2019) Adaptive neuro-fuzzy inference system for evaluating dysarthric automatic speech recognition (ASR) systems: a case study on MVML-based ASR. Soft Comput 23(10):3529–3544
Bahadur P, Jain A, Chauhan D (2012) EtranS-A complete framework for English to Sanskrit machine translation. In: International journal of advanced computer science and applications (IJACSA) from international conference and workshop on emerging trends in technology. Citeseerx, New York
Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. Preprint arXiv:1409.0473
Barkade V, Devale PR (2010) English to Sanskrit machine translation semantic mapper. Int J Eng Sci Technol 2(10):5313–5318
Bharati A, Kulkarni A (2007) Sanskrit and computational linguistics. In: 1st international Sanskrit computational symposium. Department of Sanskrit Studies, University of Hyderabad
Bharati A, Chaitanya V, Sangal R, Ramakrishnamacharyulu K (1995) Natural language processing: a paninian perspective. Prentice-Hall, New Delhi
Bharati A, Kulkarni AP, Sheeba V (2006) Building a wide coverage Sanskrit morphological analyser: a practical approach. In: The 1st national symposium on modelling and shallow parsing of Indian Languages. IIT, Bombay
Chaudhury S, Rao A, Sharma DM (2010) Anusaaraka: an expert system based machine translation system. In: Proceedings of the 6th international conference on natural language processing and knowledge engineering (NLPKE-2010). IEEE, New York, pp 1–6
Chen Y, He J, Zhang X, Hao C, Chen D (2019) Cloud-DNN: an open framework for mapping DNN models to cloud FPGAs. In: Proceedings of the 2019 ACM/SIGDA international symposium on field-programmable gate arrays, pp 73–82
Cho K, Van Merriënboer B, Bahdanau D, Bengio Y (2014) On the properties of neural machine translation: encoder–decoder approaches. Preprint arXiv:1409.1259
Chowdhury GG (2003) Natural language processing. Ann Rev Inf Sci Technol 37(1):51–89
Dastjerdi AV, Garg SK, Buyya R (2011) Qos-aware deployment of network of virtual appliances across multiple clouds. In: IEEE 3rd international conference on cloud computing technology and science. IEEE, New York, pp 415–423
Dong Y, Zhang Z, Hong WC (2018) A hybrid seasonal mechanism with a chaotic cuckoo search algorithm with a support vector regression model for electric load forecasting. Energies 11(4):1009
Dunn NA, Unni DR, Diesh C, Munoz-Torres M, Harris NL, Yao E, Rasche H, Holmes IH, Elsik CG, Lewis SE (2019) Apollo: democratizing genome annotation. PLoS Comput Biol 15(2):e1006790
Ferrández-Tordera J, Ortiz-Rojas S, Toral A (2016) Cloudlm: a cloud-based language model for machine translation. Prague Bull Math Linguist 105(1):51–61
Foster I, Zhao Y, Raicu I, Lu S (2008) Cloud computing and grid computing 360-degree compared. In: Grid computing environments workshop. IEEE, New York, pp 1–10
Fox A, Griffith R, Joseph A, Katz R, Konwinski A, Lee G, Patterson D, Rabkin A, Stoica I (2009) Above the clouds: a Berkeley view of cloud computing. Dept Electrical Eng and Comput Sciences, University of California, Berkeley, Rep UCB/EECS 28(13):2009
Galaviz-Aguilar JA, Roblin P, Cárdenas-Valdez JR, Emigdio Z, Trujillo L, Nuñez-Pérez JC, Schütze O et al (2019) Comparison of a genetic programming approach with anfis for power amplifier behavioral modeling and FPGA implementation. Soft Comput 23(7):2463–2481
Gao Q, Vogel S (2010) Training phrase-based machine translation models on the cloud: open source machine translation toolkit chaski. Prague Bull Math Linguist 93:37–46
Gorzalczany MB, Gluszek A (2002) Neuro-fuzzy systems for rule-based modelling of dynamic processes. In: Zimmermann HJ, Tselentis G, van Someren M, Dounias G (eds) Advances in computational intelligence and learning. Springer, Dordrecht, pp 135–146
Goyal P, Arora V, Behera L (2009) Analysis of Sanskrit text: parsing and semantic relations. In: Huet G, Kulkarni A, Scharf P (eds) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 200–218
Hellwig O (2009) Sanskrittagger: a stochastic lexical and pos tagger for Sanskrit. In: Huet G, Kulkarni A, Scharf P (eds) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 266–277
Hellwig O (2010) Performance of a lexical and pos tagger for Sanskrit. In: Jha GN (ed) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 162–172
Hong WC, Li MW, Geng J, Zhang Y (2019) Novel chaotic bat algorithm for forecasting complex motion of floating platforms. Appl Math Model 72:425–443
Huang Y, Cheng Y, Bapna A, Firat O, Chen D, Chen M, Lee H, Ngiam J, Le QV, Wu Y (2019) Gpipe: efficient training of giant neural networks using pipeline parallelism. In: 33rd conference on neural information processing systems (NeurIPS 2019). Advances in Neural Information Processing Systems, Vancouver, Canada, pp 103–112
Huet G (2006) Shallow syntax analysis in Sanskrit guided by semantic nets constraints. In: Proceedings of the 2006 international workshop on research issues in digital libraries. ACM, New York, pp 1–10
Jha GN, Agrawal M, Mishra SK, Mani D, Mishra D, Bhadra M, Singh SK et al (2009) Inflectional morphology analyzer for Sanskrit. In: Huet G, Kulkarni A, Scharf P (eds) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 219–238
Ketkar N (2017) Introduction to Keras. In: Deep Learning with Python. Apress, Berkeley, CA, pp 97–111
Kim HN, Yoo SH, Kim KH, Chung AYJ, Lee JY, Lee SK, Jung JT (2019) Method for controlling hand-over in drone network. US Patent 10,230,450
Kiyurkchiev V, Pavlov N, Rahnev A (2019) Cloud-based architecture of dispel. Int J Pure Appl Math 120(4):573–581
Kulkarni A (2013) A deterministic dependency parser with dynamic programming for Sanskrit. In: Proceedings of the 2nd international conference on dependency linguistics (DepLing 2013), pp 157–166
Kulkarni A, Kumar A (2011) Statistical constituency parser for Sanskrit compounds. In: Proceedings of ICON
Kulkarni A, Ramakrishnamacharyulu K (2013) Parsing Sanskrit texts: some relation specific issues. In: Proceedings of the 5th international Sanskrit computational linguistics symposium. DK Printworld (P) Ltd
Kulkarni A, Pokar S, Shukl D (2010) Designing a constraint based parser for Sanskrit. In: Jha GN (ed) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 70–90
Kumar A, Sheebasudheer V, Kulkarni A (2009) Sanskrit compound paraphrase generator. In: Proceedings of ICON
Kumar A, Mittal V, Kulkarni A (2010) Sanskrit compound processor. In: Jha GN (ed) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 57–69
Kumar P, Ahmad R, Chaudhary B, Sinha M (2013a) An approach to assure QoS of machine translation system on cloud. In: Proceedings of the 4th international conference on cloud computing, GRIDs, and virtualization, pp 179–184
Kumar P, Ahmad R, Chaudhary B, Sinha M (2013b) Dashboard: a tool for integration, validation, and visualization of distributed NLP systems on heterogeneous platforms. In: The companion volume of the proceedings of IJCNLP 2013: system demonstrations, pp 9–12
Kumar P, Ahmad R, Chaudhary BD, Sangal R (2013c) Machine translation system as virtual appliance: for scalable service deployment on cloud. In: IEEE 7th international symposium on service-oriented system engineering. IEEE, New York, pp 304–308
Kundra H, Sadawarti H (2015) Hybrid algorithm of cuckoo search and particle swarm optimization for natural terrain feature extraction. Res J Inf Technol 7(1):58–69
Laadan O, Nieh J, Viennot N (2010) Teaching operating systems using virtual appliances and distributed version control. In: Proceedings of the 41st ACM technical symposium on computer science education. ACM, New York, pp 480–484
Machida F, Kawato M, Maeno Y (2010) Renovating legacy distributed systems using virtual appliance with dependency graph. In: 2010 international conference on network and service management. IEEE, New York, pp 17–24
Mishra V, Mishra R (2009) Ann and rule based model for English to Sanskrit machine translation. INFOCOMP J Comput Sci 9(1):80–89
Mittal V (2010) Automatic Sanskrit segmentizer using finite state transducers. In: Proceedings of the ACL 2010 student research workshop, association for computational linguistics, pp 85–90
Naderpour H, Mirrashid M (2019) Classification of failure modes in ductile and non-ductile concrete joints. Eng Fail Anal 103:361–375
Naderpour H, Mirrashid M (2020a) Confinement coefficient predictive modeling of FRP-confined RC columns. Adv Civ Eng Mater 9(1):1–21
Naderpour H, Mirrashid M (2020b) Proposed soft computing models for moment capacity prediction of reinforced concrete columns. Soft Comput 2020:1–15
Naderpour H, Vahdani R, Mirrashid M (2018) Soft computing research in structural control by mass damper (a review paper). In: 4th international conference on structural engineering, Tehran
Naderpour H, Mirrashid M, Nagai K (2019) An innovative approach for bond strength modeling in frp strip-to-concrete joints using adaptive neuro-fuzzy inference system. Eng Comput 2019:1–18
Nandi M, Ramasree R (2013) Rule-based extraction of multi-word expressions for elementary Sanskrit texts. Int J Adv Res Comput Sci Softw Eng 3(11):661–667
Neelaveni R, Sridevi B (2019) A novel Neyman–Pearson criterion-based adaptive neuro-fuzzy inference system (NPC-ANFIS) model for security threats detection in cognitive radio networks. Soft Comput 23(18):8389–8397
Pandey RK, Jha GN (2016) Error analysis of sahit—a statistical Sanskrit–Hindi translator. Proc Comput Sci 96:495–501
Pappu A, Sanyal R (2008) Vaakkriti: Sanskrit tokenizer. In: Proceedings of the 3rd international joint conference on natural language processing
Polykretis C, Kalogeropoulos K, Andreopoulos P, Faka A, Tsatsaris A, Chalkias C (2019) Comparison of statistical analysis models for susceptibility assessment of earthquake-triggered landslides: a case study from 2015 earthquake in Lefkada Island. Geosciences 9(8):350
Qian L, Luo Z, Du Y, Guo L (2009) Cloud computing: an overview. In: IEEE international conference on cloud computing. Springer, Berlin, pp 626–631
Rathod SG, Sondur S (2012) English to Sanskrit translator and synthesizer (ETSTS). Int J Emerg Technol Adv Eng 2(12):379–383
Rimal BP, Choi E, Lumb I (2009) A taxonomy and survey of cloud computing systems. In: INC, IMS and IDC, pp 44–51
Sachin K (2007) Sandhi splitter and analyzer for Sanskrit (with reference to AC sandhi). Mphil Thesis (SCSS), JNU
Schwartze C, Kralisch S, Flügel WA (2011) Geospatial virtual appliances using open source software. In: International symposium on environmental software systems. Springer, Berlin, pp 154–160
Sennrich R, Haddow B (2016) Linguistic input features improve neural machine translation. Preprint arXiv:1606.02892
Shi W, Lu Y, Li Z, Engelsma J (2011) Sharc: a scalable 3D graphics virtual appliance delivery framework in cloud. J Netw Comput Appl 34(4):1078–1087
Shobana M, Sabitha R, Karthik S (2020) An enhanced soft computing-based formulation for secure data aggregation and efficient data processing in large-scale wireless sensor network. Soft Comput 2020:1–12
Siddique N, Adeli H (2013) Computational intelligence: synergies of fuzzy logic, neural networks and evolutionary computing. Wiley, Berlin
Singh M, Kumar R, Chana I (2019a) Neural-based machine translation system outperforming statistical phrase-based machine translation for low-resource languages. In: 2019 12th international conference on contemporary computing (IC3). IEEE, New York, pp 1–7
Singh M, Kumar R, Chana I (2019b) Neuro-FGA based machine translation system for Sanskrit to Hindi language. In: 2019 international conference on innovative sustainable computational technologies (CISCT). IEEE, New York, pp 1–6
Skadiņš R, Tiedemann J, et al. (2012) Letsmt!: a cloud-based platform for do-it-yourself machine translation. In: Proceedings of the ACL 2012 system demonstrations. Association for Computational Linguistics, pp 43–48
Sun K, Mou S, Qiu J, Wang T, Gao H (2018) Adaptive fuzzy control for nontriangular structural stochastic switched nonlinear systems with full state constraints. IEEE Trans Fuzzy Syst 27(8):1587–1601
Upadhyay Pankaj KA, Chandra Jaiswal Umesh (2014) Transish: translator from Sanskrit to English-A rule based machine translation. Int J Comput Appl 4(5):2277–4106
Vasiljevs A, Skadiņš R, Tiedemann J (2011) Letsmt!: cloud-based platform for building user tailored machine translation engines. In: Proceedings of the 13th machine translation summit, pp 507–511
Vaswani A, Bengio S, Brevdo E, Chollet F, Gomez AN, Gouws S, Jones L, Kaiser Ł, Kalchbrenner N, Parmar N, et al. (2018) Tensor2tensor for neural machine translation. Preprint arXiv:1803.07416
Venugopal A, Zollmann A (2009) Grammar based statistical MT on hadoop: an end-to-end toolkit for large scale pscfg based mt. Prague Bull Math Linguist 91:67–78
Xing Y, Zhan Y (2012) Virtualization and cloud computing. In: Zhang Y (ed) Future wireless networks and information systems. Springer, Berlin, Heidelberg, pp 305–312
Yager RR, Zadeh LA, Kosko B, Grossberg S (1994) Fuzzy sets, neural networks and soft computing. Technical report
Zadeh LA (1996) Fuzzy logic, neural networks, and soft computing. Communication of the ACM, vol 37, no 3, pp 77–83
Zhang Z, Hong WC (2019) Electric load forecasting by complete ensemble empirical mode decomposition adaptive noise and support vector regression with quantum-based dragonfly algorithm. Nonlinear Dyn 98(2):1107–1136
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All the authors declare that there is no conflict of interest.
Human or animal participants
This article does not contain any studies with human or animal participants performed by any of the authors.
Additional information
Communicated by V. Loia.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Singh, M., Kumar, R. & Chana, I. A forefront to machine translation technology: deployment on the cloud as a service to enhance QoS parameters. Soft Comput 24, 16057–16079 (2020). https://doi.org/10.1007/s00500-020-04923-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-020-04923-7