Skip to main content
Log in

A forefront to machine translation technology: deployment on the cloud as a service to enhance QoS parameters

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Machine translation system (MTS) constitutes of functionally heterogeneous modules for processing source language to a given target language. Deploying such an application on a stand-alone system requires much time, knowledge and complications. It even becomes more challenging for a common user to utilize such a complex application. This paper presents a MTS that has been developed using a combination of linguistic rich, rule-based and prominent neural-based approach. The proposed MTS is deployed on the cloud to offer translation as a cloud service and improve the quality of service (QoS) from a stand-alone system. It is developed on TensorFlow and deployed under the cluster of virtual machines in the Amazon web server (EC2). The significance of this paper is to demonstrate management of recurrent changes in term of corpus, domain, algorithm and rules. Further, the paper also compares the MTS as deployed on stand-alone machine and on cloud for different QoS parameters like response time, server load, CPU utilization and throughput. The experimental results assert that in the translation task, with the availability of elastic computing resources in the cloud environment, the job completion time irrespective of its size can be assured to be within a fixed time limit with high accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  • Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M et al (2016) Tensorflow: a system for large-scale machine learning. OSDI 16:265–283

    Google Scholar 

  • Abd-El-Malek M, Wachs M, Cipar J, Sanghi K, Ganger GR, Gibson GA, Reiter MK (2012) File system virtual appliances: portable file system implementations. ACM Trans Storage (TOS) 8(3):9

    Google Scholar 

  • Ahmad R (2013) Engineering machine translation for deployment on cloud. PhD thesis. International Institute of Information Technology Hyderabad, India

  • Ahmad I, Ranka S (2016) Handbook of energy-aware and green computing-two volume set. CRC Press, Boca Raton

    Google Scholar 

  • Ahmad R, Kumar P, Rambabu B, Sajja P, Sinha MK, Sangal R (2011a) Enhancing throughput of a machine translation system using mapreduce framework: an engineering approach. In: ICON

  • Ahmad R, Rathaur A, Rambabu B, Kumar P, Sinha MK, Sangal R (2011b) Provision of a cache by a system integration and deployment platform to enhance the performance of compute-intensive NLP applications. In: African conference on software engineering applied computing

  • Ahmad R, Kumar P, Kumar A, Sinha MK, Chaudhary B (2014) Improve user experience on web for machine translation system using storm. In: IEEE 4th international conference on big data and cloud computing. IEEE, New York, pp 243–248

  • Amazon E (2020) Amazon web services. Accessed on 28 Mar 2020

  • Asemi A, Salim SSB, Shahamiri SR, Asemi A, Houshangi N (2019) Adaptive neuro-fuzzy inference system for evaluating dysarthric automatic speech recognition (ASR) systems: a case study on MVML-based ASR. Soft Comput 23(10):3529–3544

    Google Scholar 

  • Bahadur P, Jain A, Chauhan D (2012) EtranS-A complete framework for English to Sanskrit machine translation. In: International journal of advanced computer science and applications (IJACSA) from international conference and workshop on emerging trends in technology. Citeseerx, New York

  • Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. Preprint arXiv:1409.0473

  • Barkade V, Devale PR (2010) English to Sanskrit machine translation semantic mapper. Int J Eng Sci Technol 2(10):5313–5318

    Google Scholar 

  • Bharati A, Kulkarni A (2007) Sanskrit and computational linguistics. In: 1st international Sanskrit computational symposium. Department of Sanskrit Studies, University of Hyderabad

  • Bharati A, Chaitanya V, Sangal R, Ramakrishnamacharyulu K (1995) Natural language processing: a paninian perspective. Prentice-Hall, New Delhi

    Google Scholar 

  • Bharati A, Kulkarni AP, Sheeba V (2006) Building a wide coverage Sanskrit morphological analyser: a practical approach. In: The 1st national symposium on modelling and shallow parsing of Indian Languages. IIT, Bombay

  • Chaudhury S, Rao A, Sharma DM (2010) Anusaaraka: an expert system based machine translation system. In: Proceedings of the 6th international conference on natural language processing and knowledge engineering (NLPKE-2010). IEEE, New York, pp 1–6

  • Chen Y, He J, Zhang X, Hao C, Chen D (2019) Cloud-DNN: an open framework for mapping DNN models to cloud FPGAs. In: Proceedings of the 2019 ACM/SIGDA international symposium on field-programmable gate arrays, pp 73–82

  • Cho K, Van Merriënboer B, Bahdanau D, Bengio Y (2014) On the properties of neural machine translation: encoder–decoder approaches. Preprint arXiv:1409.1259

  • Chowdhury GG (2003) Natural language processing. Ann Rev Inf Sci Technol 37(1):51–89

    MathSciNet  Google Scholar 

  • Dastjerdi AV, Garg SK, Buyya R (2011) Qos-aware deployment of network of virtual appliances across multiple clouds. In: IEEE 3rd international conference on cloud computing technology and science. IEEE, New York, pp 415–423

  • Dong Y, Zhang Z, Hong WC (2018) A hybrid seasonal mechanism with a chaotic cuckoo search algorithm with a support vector regression model for electric load forecasting. Energies 11(4):1009

    Google Scholar 

  • Dunn NA, Unni DR, Diesh C, Munoz-Torres M, Harris NL, Yao E, Rasche H, Holmes IH, Elsik CG, Lewis SE (2019) Apollo: democratizing genome annotation. PLoS Comput Biol 15(2):e1006790

    Google Scholar 

  • Ferrández-Tordera J, Ortiz-Rojas S, Toral A (2016) Cloudlm: a cloud-based language model for machine translation. Prague Bull Math Linguist 105(1):51–61

    Google Scholar 

  • Foster I, Zhao Y, Raicu I, Lu S (2008) Cloud computing and grid computing 360-degree compared. In: Grid computing environments workshop. IEEE, New York, pp 1–10

  • Fox A, Griffith R, Joseph A, Katz R, Konwinski A, Lee G, Patterson D, Rabkin A, Stoica I (2009) Above the clouds: a Berkeley view of cloud computing. Dept Electrical Eng and Comput Sciences, University of California, Berkeley, Rep UCB/EECS 28(13):2009

  • Galaviz-Aguilar JA, Roblin P, Cárdenas-Valdez JR, Emigdio Z, Trujillo L, Nuñez-Pérez JC, Schütze O et al (2019) Comparison of a genetic programming approach with anfis for power amplifier behavioral modeling and FPGA implementation. Soft Comput 23(7):2463–2481

    Google Scholar 

  • Gao Q, Vogel S (2010) Training phrase-based machine translation models on the cloud: open source machine translation toolkit chaski. Prague Bull Math Linguist 93:37–46

    Google Scholar 

  • Gorzalczany MB, Gluszek A (2002) Neuro-fuzzy systems for rule-based modelling of dynamic processes. In: Zimmermann HJ, Tselentis G, van Someren M, Dounias G (eds) Advances in computational intelligence and learning. Springer, Dordrecht, pp 135–146

    Google Scholar 

  • Goyal P, Arora V, Behera L (2009) Analysis of Sanskrit text: parsing and semantic relations. In: Huet G, Kulkarni A, Scharf P (eds) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 200–218

    Google Scholar 

  • Hellwig O (2009) Sanskrittagger: a stochastic lexical and pos tagger for Sanskrit. In: Huet G, Kulkarni A, Scharf P (eds) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 266–277

    Google Scholar 

  • Hellwig O (2010) Performance of a lexical and pos tagger for Sanskrit. In: Jha GN (ed) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 162–172

    Google Scholar 

  • Hong WC, Li MW, Geng J, Zhang Y (2019) Novel chaotic bat algorithm for forecasting complex motion of floating platforms. Appl Math Model 72:425–443

    MathSciNet  MATH  Google Scholar 

  • Huang Y, Cheng Y, Bapna A, Firat O, Chen D, Chen M, Lee H, Ngiam J, Le QV, Wu Y (2019) Gpipe: efficient training of giant neural networks using pipeline parallelism. In: 33rd conference on neural information processing systems (NeurIPS 2019). Advances in Neural Information Processing Systems, Vancouver, Canada, pp 103–112

  • Huet G (2006) Shallow syntax analysis in Sanskrit guided by semantic nets constraints. In: Proceedings of the 2006 international workshop on research issues in digital libraries. ACM, New York, pp 1–10

  • Jha GN, Agrawal M, Mishra SK, Mani D, Mishra D, Bhadra M, Singh SK et al (2009) Inflectional morphology analyzer for Sanskrit. In: Huet G, Kulkarni A, Scharf P (eds) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 219–238

    Google Scholar 

  • Ketkar N (2017) Introduction to Keras. In: Deep Learning with Python. Apress, Berkeley, CA, pp 97–111

    Google Scholar 

  • Kim HN, Yoo SH, Kim KH, Chung AYJ, Lee JY, Lee SK, Jung JT (2019) Method for controlling hand-over in drone network. US Patent 10,230,450

  • Kiyurkchiev V, Pavlov N, Rahnev A (2019) Cloud-based architecture of dispel. Int J Pure Appl Math 120(4):573–581

    Google Scholar 

  • Kulkarni A (2013) A deterministic dependency parser with dynamic programming for Sanskrit. In: Proceedings of the 2nd international conference on dependency linguistics (DepLing 2013), pp 157–166

  • Kulkarni A, Kumar A (2011) Statistical constituency parser for Sanskrit compounds. In: Proceedings of ICON

  • Kulkarni A, Ramakrishnamacharyulu K (2013) Parsing Sanskrit texts: some relation specific issues. In: Proceedings of the 5th international Sanskrit computational linguistics symposium. DK Printworld (P) Ltd

  • Kulkarni A, Pokar S, Shukl D (2010) Designing a constraint based parser for Sanskrit. In: Jha GN (ed) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 70–90

    Google Scholar 

  • Kumar A, Sheebasudheer V, Kulkarni A (2009) Sanskrit compound paraphrase generator. In: Proceedings of ICON

  • Kumar A, Mittal V, Kulkarni A (2010) Sanskrit compound processor. In: Jha GN (ed) Sanskrit computational linguistics. Springer, Berlin, Heidelberg, pp 57–69

    Google Scholar 

  • Kumar P, Ahmad R, Chaudhary B, Sinha M (2013a) An approach to assure QoS of machine translation system on cloud. In: Proceedings of the 4th international conference on cloud computing, GRIDs, and virtualization, pp 179–184

  • Kumar P, Ahmad R, Chaudhary B, Sinha M (2013b) Dashboard: a tool for integration, validation, and visualization of distributed NLP systems on heterogeneous platforms. In: The companion volume of the proceedings of IJCNLP 2013: system demonstrations, pp 9–12

  • Kumar P, Ahmad R, Chaudhary BD, Sangal R (2013c) Machine translation system as virtual appliance: for scalable service deployment on cloud. In: IEEE 7th international symposium on service-oriented system engineering. IEEE, New York, pp 304–308

  • Kundra H, Sadawarti H (2015) Hybrid algorithm of cuckoo search and particle swarm optimization for natural terrain feature extraction. Res J Inf Technol 7(1):58–69

    Google Scholar 

  • Laadan O, Nieh J, Viennot N (2010) Teaching operating systems using virtual appliances and distributed version control. In: Proceedings of the 41st ACM technical symposium on computer science education. ACM, New York, pp 480–484

  • Machida F, Kawato M, Maeno Y (2010) Renovating legacy distributed systems using virtual appliance with dependency graph. In: 2010 international conference on network and service management. IEEE, New York, pp 17–24

  • Mishra V, Mishra R (2009) Ann and rule based model for English to Sanskrit machine translation. INFOCOMP J Comput Sci 9(1):80–89

    Google Scholar 

  • Mittal V (2010) Automatic Sanskrit segmentizer using finite state transducers. In: Proceedings of the ACL 2010 student research workshop, association for computational linguistics, pp 85–90

  • Naderpour H, Mirrashid M (2019) Classification of failure modes in ductile and non-ductile concrete joints. Eng Fail Anal 103:361–375

    Google Scholar 

  • Naderpour H, Mirrashid M (2020a) Confinement coefficient predictive modeling of FRP-confined RC columns. Adv Civ Eng Mater 9(1):1–21

    Google Scholar 

  • Naderpour H, Mirrashid M (2020b) Proposed soft computing models for moment capacity prediction of reinforced concrete columns. Soft Comput 2020:1–15

    Google Scholar 

  • Naderpour H, Vahdani R, Mirrashid M (2018) Soft computing research in structural control by mass damper (a review paper). In: 4th international conference on structural engineering, Tehran

  • Naderpour H, Mirrashid M, Nagai K (2019) An innovative approach for bond strength modeling in frp strip-to-concrete joints using adaptive neuro-fuzzy inference system. Eng Comput 2019:1–18

    Google Scholar 

  • Nandi M, Ramasree R (2013) Rule-based extraction of multi-word expressions for elementary Sanskrit texts. Int J Adv Res Comput Sci Softw Eng 3(11):661–667

    Google Scholar 

  • Neelaveni R, Sridevi B (2019) A novel Neyman–Pearson criterion-based adaptive neuro-fuzzy inference system (NPC-ANFIS) model for security threats detection in cognitive radio networks. Soft Comput 23(18):8389–8397

    Google Scholar 

  • Pandey RK, Jha GN (2016) Error analysis of sahit—a statistical Sanskrit–Hindi translator. Proc Comput Sci 96:495–501

    Google Scholar 

  • Pappu A, Sanyal R (2008) Vaakkriti: Sanskrit tokenizer. In: Proceedings of the 3rd international joint conference on natural language processing

  • Polykretis C, Kalogeropoulos K, Andreopoulos P, Faka A, Tsatsaris A, Chalkias C (2019) Comparison of statistical analysis models for susceptibility assessment of earthquake-triggered landslides: a case study from 2015 earthquake in Lefkada Island. Geosciences 9(8):350

    Google Scholar 

  • Qian L, Luo Z, Du Y, Guo L (2009) Cloud computing: an overview. In: IEEE international conference on cloud computing. Springer, Berlin, pp 626–631

  • Rathod SG, Sondur S (2012) English to Sanskrit translator and synthesizer (ETSTS). Int J Emerg Technol Adv Eng 2(12):379–383

    Google Scholar 

  • Rimal BP, Choi E, Lumb I (2009) A taxonomy and survey of cloud computing systems. In: INC, IMS and IDC, pp 44–51

  • Sachin K (2007) Sandhi splitter and analyzer for Sanskrit (with reference to AC sandhi). Mphil Thesis (SCSS), JNU

  • Schwartze C, Kralisch S, Flügel WA (2011) Geospatial virtual appliances using open source software. In: International symposium on environmental software systems. Springer, Berlin, pp 154–160

  • Sennrich R, Haddow B (2016) Linguistic input features improve neural machine translation. Preprint arXiv:1606.02892

  • Shi W, Lu Y, Li Z, Engelsma J (2011) Sharc: a scalable 3D graphics virtual appliance delivery framework in cloud. J Netw Comput Appl 34(4):1078–1087

    Google Scholar 

  • Shobana M, Sabitha R, Karthik S (2020) An enhanced soft computing-based formulation for secure data aggregation and efficient data processing in large-scale wireless sensor network. Soft Comput 2020:1–12

    Google Scholar 

  • Siddique N, Adeli H (2013) Computational intelligence: synergies of fuzzy logic, neural networks and evolutionary computing. Wiley, Berlin

    Google Scholar 

  • Singh M, Kumar R, Chana I (2019a) Neural-based machine translation system outperforming statistical phrase-based machine translation for low-resource languages. In: 2019 12th international conference on contemporary computing (IC3). IEEE, New York, pp 1–7

  • Singh M, Kumar R, Chana I (2019b) Neuro-FGA based machine translation system for Sanskrit to Hindi language. In: 2019 international conference on innovative sustainable computational technologies (CISCT). IEEE, New York, pp 1–6

  • Skadiņš R, Tiedemann J, et al. (2012) Letsmt!: a cloud-based platform for do-it-yourself machine translation. In: Proceedings of the ACL 2012 system demonstrations. Association for Computational Linguistics, pp 43–48

  • Sun K, Mou S, Qiu J, Wang T, Gao H (2018) Adaptive fuzzy control for nontriangular structural stochastic switched nonlinear systems with full state constraints. IEEE Trans Fuzzy Syst 27(8):1587–1601

    Google Scholar 

  • Upadhyay Pankaj KA, Chandra Jaiswal Umesh (2014) Transish: translator from Sanskrit to English-A rule based machine translation. Int J Comput Appl 4(5):2277–4106

    Google Scholar 

  • Vasiljevs A, Skadiņš R, Tiedemann J (2011) Letsmt!: cloud-based platform for building user tailored machine translation engines. In: Proceedings of the 13th machine translation summit, pp 507–511

  • Vaswani A, Bengio S, Brevdo E, Chollet F, Gomez AN, Gouws S, Jones L, Kaiser Ł, Kalchbrenner N, Parmar N, et al. (2018) Tensor2tensor for neural machine translation. Preprint arXiv:1803.07416

  • Venugopal A, Zollmann A (2009) Grammar based statistical MT on hadoop: an end-to-end toolkit for large scale pscfg based mt. Prague Bull Math Linguist 91:67–78

    Google Scholar 

  • Xing Y, Zhan Y (2012) Virtualization and cloud computing. In: Zhang Y (ed) Future wireless networks and information systems. Springer, Berlin, Heidelberg, pp 305–312

    Google Scholar 

  • Yager RR, Zadeh LA, Kosko B, Grossberg S (1994) Fuzzy sets, neural networks and soft computing. Technical report

  • Zadeh LA (1996) Fuzzy logic, neural networks, and soft computing. Communication of the ACM, vol 37, no 3, pp 77–83

  • Zhang Z, Hong WC (2019) Electric load forecasting by complete ensemble empirical mode decomposition adaptive noise and support vector regression with quantum-based dragonfly algorithm. Nonlinear Dyn 98(2):1107–1136

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Muskaan Singh.

Ethics declarations

Conflict of interest

All the authors declare that there is no conflict of interest.

Human or animal participants

This article does not contain any studies with human or animal participants performed by any of the authors.

Additional information

Communicated by V. Loia.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, M., Kumar, R. & Chana, I. A forefront to machine translation technology: deployment on the cloud as a service to enhance QoS parameters. Soft Comput 24, 16057–16079 (2020). https://doi.org/10.1007/s00500-020-04923-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-020-04923-7

Keywords

Navigation