Skip to main content

Immersive Exploration of Cell Localization Scenarios Using VR, Spatialized Video Communication, and Integrative Bioinformatics

  • Chapter
  • First Online:
Integrative Bioinformatics

Abstract

Integrating spatially localized molecular networks into virtual cell environments is an approach which is only provided by a very small number of tools. As this task requires the combination of a set of Biotechnology/Bioinformatics-related information sources, it can be seen as an appropriate example for Integrative Bioinformatics research. Here, we want to show new immersive perspectives for cytological pathway integration by combining recent explorative technologies with the software CELLmicrocosmos 4 PathwayIntegration. A mesoscopic-localized metabolic pathway—i.e. the citrate cycle and the glycolysis—is localized based on database entries onto an abstract cell environment of Arabidopsis thaliana. The created cell model is used in three different contexts providing different degrees of immersion: (1) Web-based 2D exploration of 3D Scenarios (using Gather.town), (2) Exploration and Annotation in a VR Design Application (using Gravity Sketch), and (3) Large-Scale VR Visualization and Navigation (using the CAVE2 and zSpace). All these examples promise to be very useful in the context of Integrative Bioinformatics-related education as well as communication.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • Autodesk: 3ds Max - 3D modeling, animation, and rendering software – Autodesk. http://usa.autodesk.com/3ds-max/. Accessed 7 Jan 2012

  • Barsky A, Gardy JL, Hancock REW, Munzner T (2007) Cerebral: a Cytoscape plugin for layout of and interaction with biological networks using subcellular localization annotation. Bioinformatics 23:1040–1042

    Article  CAS  PubMed  Google Scholar 

  • Becker MY, Rojas I (2001) A graph layout algorithm for drawing metabolic pathways. Bioinformatics 17:461–467

    Article  CAS  PubMed  Google Scholar 

  • Belloy N, Wong H, Révoteau-Jonquet J, Baud S, Dauchez M (2018) Mesoscopic rigid body modelling of the extracellular matrix self-assembly. J Integr Bioinform 15:20180009. https://doi.org/10.1515/jib-2018-0009

    Article  PubMed Central  Google Scholar 

  • Biere N, Ghaffar M, Doebbe A, Jäger D, Rothe N, Friedrich BM, Hofestädt R, Schreiber F, Kruse O, Sommer B (2018) Heuristic modeling and 3D stereoscopic visualization of a Chlamydomonas reinhardtii cell. J Integr Bioinform 15:20180003. https://doi.org/10.1515/jib-2018-0003

    Article  PubMed Central  Google Scholar 

  • Binder JX, Pletscher-Frankild S, Tsafou K, Stolte C, O’Donoghue SI, Schneider R, Jensen LJ (2014) COMPARTMENTS: unification and visualization of protein subcellular localization evidence. Database 2014:bau012

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Blender.: blender.org - Home of the Blender project - free and open 3D Creation Software. http://www.blender.org/. Accessed 22 July 2014

  • Bol M (2021) Has oculus quest sold one-million lifetime units? https://arinsider.co/2020/09/21/has-oculus-quest-sold-one-million-units/. Accessed 16 May 2021

  • Brinkrolf C, Janowski SJ, Kormeier B, Lewinski M, Hippe K, Borck D, Hofestädt R (2014) VANESA-A software application for the visualization and analysis of networks in systems biology applications. J Integr Bioinform 11:239. https://doi.org/10.2390/biecoll-jib-2014-239

    Article  PubMed  Google Scholar 

  • Brøuža V, Byška J, Mičan J, Kozlíková B (2021) VRdeo: creating engaging educational material for asynchronous student-teacher exchange using virtual reality. Comput Graph 98:280–292

    Google Scholar 

  • Cardona A, Saalfeld S, Schindelin J, Arganda-Carreras I, Preibisch S, Longair M, Tomancak P, Hartenstein V, Douglas RJ (2012) TrakEM2 software for neural circuit reconstruction. PLoS One 7:e38011

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Cell Press: Picture Show: Cell Press. http://www.cell.com/pictureshow. Accessed 8 Dec 2014

  • Chan J, Kishore R, Sternberg P, Van Auken K (2012) The gene ontology: enhancements for 2011. Nucleic Acids Res 40:D559–D564

    Article  CAS  Google Scholar 

  • Chang A, Schomburg I, Placzek S, Jeske L, Ulbrich M, Xiao M, Sensen CW, Schomburg D (2014) BRENDA in 2015: exciting developments in its 25th year of existence. Nucleic Acids Res 43:D439

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Chang A, Jeske L, Ulbrich S, Hofmann J, Koblitz J, Schomburg I, Neumann-Schaal M, Jahn D, Schomburg D (2021) BRENDA, the ELIXIR core data resource in 2021: new developments and updates. Nucleic Acids Res 49:D498–D508

    Article  CAS  PubMed  Google Scholar 

  • Cordeil M, Dwyer T, Klein K, Laha B, Marriott K, Thomas BH (2017) Immersive collaborative analysis of network connectivity: CAVE-style or head-mounted display? IEEE Trans Vis Comput Graph 23:441–450

    Article  PubMed  Google Scholar 

  • Croft D, O’Kelly G, Wu G, Haw R, Gillespie M, Matthews L, Caudy M, Garapati P, Gopinath G, Jassal B (2011) Reactome: a database of reactions, pathways and biological processes. Nucleic Acids Res 39:D691–D697

    Article  CAS  PubMed  Google Scholar 

  • Febretti A, Nishimoto A, Thigpen T, Talandis J, Long L, Pirtle JD, Peterka T, Verlo A, Brown M, Plepys D (2013) CAVE2: a hybrid reality environment for immersive simulation and information analysis. In: IS&T/SPIE electronic imaging. International Society for Optics and Photonics, Bellingham, pp 864903–864903–12

    Google Scholar 

  • Febretti A, Nishimoto A, Mateevitsi V, Renambot L, Johnson A, Leigh J (2014) Omegalib: a multi-view application framework for hybrid reality display environments. In: Virtual reality (VR). IEEE, pp 9–14

    Google Scholar 

  • FEI Visualization Sciences Group: Amira | FEI Visualization Sciences Group. http://www.vsg3d.com/amira/overview. Accessed 22 July 2014

  • Flickr: Welcome to Flickr – Fotosharing. https://www.flickr.com/. Accessed 22 July 2014

  • Frick A, Ludwig A, Mehldau H (1994) A fast adaptive layout algorithm for undirected graphs (extended abstract and system demonstration). In: International symposium on graph drawing. Springer, Berlin, pp 388–403

    Google Scholar 

  • Friedrichs M (2021) BioDWH2: an automated graph-based data warehouse and mapping tool. J Integr Bioinform 18:167

    Article  PubMed  PubMed Central  Google Scholar 

  • Fruchterman TMJ, Reingold EM (1991) Graph drawing by force-directed placement. Softw Pract Exp 21:1129–1164

    Article  Google Scholar 

  • Gather. https://gather.town/. Accessed 11 May 2021

  • Gather - Crunchbase Company Profile & Funding. https://www.crunchbase.com/organization/gather-4189. Accessed 16 May 2021

  • Genc B, Dogrusoz U (2003) A constrained, force-directed layout algorithm for biological pathways. In: Graph drawing. Springer, Berlin, pp 314–319

    Google Scholar 

  • Gravity Sketch | 3D design and modelling software. https://www.gravitysketch.com/. Accessed 11 May 2021

  • Hamish H (2021) Oculus Quest 2 sales figures prove VR has finally gone mainstream. https://www.techradar.com/news/oculus-quest-2-sales-figures-prove-vr-has-finally-gone-mainstream. Accessed 16 May 2021

  • Ivanisenko TV, Saik OV, Demenkov PS, Ivanisenko NV, Savostianov AN, Ivanisenko VA (2020) ANDDigest: a new web-based module of ANDSystem for the search of knowledge in the scientific literature. BMC Bioinformatics 21:1–21

    Article  Google Scholar 

  • Joundi J, Christiaens Y, Saldien J, Conradie P, De Marez L (2020) An explorative study towards using VR sketching as a tool for ideation and prototyping in product design. In: Proceedings of the design society: DESIGN conference. Cambridge University Press, Cambridge, pp 225–234

    Google Scholar 

  • Kanehisa M, Goto S, Sato Y, Furumichi M, Tanabe M (2012) KEGG for integration and interpretation of large-scale molecular data sets. Nucleic Acids Res 40:D109–D114

    Article  CAS  PubMed  Google Scholar 

  • Karp PD, Paley S (1994) Automated drawing of metabolic pathways. In: Third international conference on bioinformatics and genome research, pp 225–238

    Google Scholar 

  • Kormeier B (2014) Data warehouses in bioinformatics. In: Approaches in integrative bioinformatics. Springer, Berlin, pp 111–130

    Chapter  Google Scholar 

  • Kovanci G, Ghaffar M, Sommer B (2016) Web-based hybrid-dimensional visualization and exploration of cytological localization scenarios. J Integr Bioinform 13:298

    PubMed  Google Scholar 

  • Maes A, Martinez X, Druart K, Laurent B, Guégan S, Marchand CH, Lemaire SD (2018) MinOmics, an integrative and immersive tool for multi-omics analysis. J Integr Bioinform 15:20180006. https://doi.org/10.1515/jib-2018-0006

    Article  PubMed Central  Google Scholar 

  • Martone ME, Gupta A, Wong M, Qian X, Sosinsky G, Ludäscher B, Ellisman MH (2002) A cell-centered database for electron tomographic data. J Struct Biol 138:145–155

    Article  CAS  PubMed  Google Scholar 

  • Mascarenhas N (2021) Sequoia Capital puts millions of dollars into Gather, a virtual HQ platform | TechCrunch. https://techcrunch.com/2021/03/11/sequoia-capital-puts-millions-of-dollars-into-gather-a-virtual-hq-platform/. Accessed 16 May 2021

  • Meyer B (1998) Self-organizing graphs—a neural network perspective of graph layout. In: Lecture notes in computer science (graph drawing). Springer, Berlin, pp 246–262

    Google Scholar 

  • Michal G (1998) Biochemical pathways: an atlas of biochemistry and molecular biology. Wiley-Spektrum, Heidelberg

    Google Scholar 

  • Michal G (2012) ExPASy - biochemical pathways. https://www.webcitation.org/6qd4XvLnc. Accessed 18 March 2012

  • Mueller, S.C., Sommer, B., Backes, C., Haas, J., Meder, B., Meese, E., Keller, A.: From single variants to protein cascades: multi-scale modeling of SNV sets in genetic disorders. J Biol Chem 291, 1582–1590 (2016). https://doi.org/https://doi.org/10.1074/jbc.M115.695247

  • Müller C, Huber M, Biener V, Herr D, Koch S, Reina G, Weiskopf D, Ertl T (2018) Interactive molecular graphics for augmented reality using HoloLens. J Integr Bioinform 15:20180005. https://doi.org/10.1515/jib-2018-0005

    Article  PubMed Central  Google Scholar 

  • (2021) UniProt: the universal protein knowledgebase in 2021. Nucleic Acids Res 49:D480–D489

    Google Scholar 

  • O’Madadhain J, Fisher D, White S, Boey Y (2003) The JUNG (Java Universal Network/Graph) framework. University of California, Irvine

    Google Scholar 

  • Podkolodnaya OA, Yarkova EE, Demenkov PS, Konovalova OS, Ivanisenko VA, Kolchanov NA (2011) Application of the ANDCell computer system to reconstruction and analysis of associative networks describing potential relationships between myopia and glaucoma. Russ J Genet Appl Res 1:21–28

    Article  Google Scholar 

  • Rohn H, Junker A, Hartmann A, Grafahrend-Belau E, Treutler H, Klapperstück M, Czauderna T, Klukas C, Schreiber F (2012) VANTED v2: a framework for systems biology applications. BMC Syst Biol 6:139

    Article  PubMed  PubMed Central  Google Scholar 

  • Sayuti A, Ahmed-Kristensen S (2020) Understanding emotional responses and perception within new creative practices of biological materials. In: Proceedings of the sixth international conference on design creativity (ICDC 2020), pp 144–151

    Chapter  Google Scholar 

  • Sayuti NA, Sommer B, Ahmed-Kristensen S (2020) Identifying the purposes of biological materials in everyday designs. Environ-Behav Proc J 5:29–37

    Article  Google Scholar 

  • Sayuti NA, Sommer B, Ahmed-Kristensen S (2021) Bio-related design genres: a survey on familiarity and potential applications. In: Interactivity and game creation: 9th EAI international conference, ArtsIT 2020, Aalborg, Denmark, 10–11 Dec 2020. Springer, Berlin, p 379

    Chapter  Google Scholar 

  • Schindelin J, Arganda-Carreras I, Frise E, Kaynig V, Longair M, Pietzsch T, Preibisch S, Rueden C, Saalfeld S, Schmid B (2012) Fiji: an open-source platform for biological-image analysis. Nat Methods 9:676–682

    Article  CAS  PubMed  Google Scholar 

  • Schreiber F (2002) High quality visualization of biochemical pathways in BioPath. In Silico Biol 2:59–73

    CAS  PubMed  Google Scholar 

  • Schreiber F, Dwyer T, Marriott K, Wybrow M (2009) A generic algorithm for layout of biological networks. BMC Bioinformatics. 10:1

    Google Scholar 

  • Smoot ME, Ono K, Ruscheinski J, Wang PL, Ideker T (2011) Cytoscape 2.8: new features for data integration and network visualization. Bioinformatics 27:431–432

    Article  CAS  PubMed  Google Scholar 

  • Sommer B (2012) CELLmicrocosmos - integrative cell modeling at the molecular, mesoscopic and functional level. http://pub.uni-bielefeld.de/download/2557380/2557411

  • Sommer B, Schreiber F (2017) Integration and virtual reality exploration of biomedical data with CmPI and VANTED. It-Inf Technol 59:181

    Google Scholar 

  • Sommer B, Künsemöller J, Sand N, Husemann A, Rumming M, Kormeier B (2010a) CELLmicrocosmos 4.1: an interactive approach to integrating spatially localized metabolic networks into a virtual 3D cell environment. In: Fred A, Filipe J, Gamboa H (eds) BIOINFORMATICS 2010 - proceedings of the 1st international conference on bioinformatics, part of the 3rd international joint conference on biomedical engineering systems and technologies (BIOSTEC 2010), pp 90–95

    Google Scholar 

  • Sommer B, Tiys ES, Kormeier B, Hippe K, Janowski SJ, Ivanisenko TV, Bragin AO, Arrigo P, Demenkov PS, Kochetov AV, Ivanisenko VA, Kolchanov NA, Hofestädt R (2010b) Visualization and analysis of a cardio vascular disease-and MUPP1-related biological network combining text mining and data warehouse approaches. J Integr Bioinform 7:148

    PubMed  Google Scholar 

  • Sommer B, Kormeier B, Demenkov PS, Arrigo P, Hippe K, Ates Ö, Kochetov AV, Ivanisenko VA, Kolchanov NA, Hofestädt R (2013) Subcellular localization charts: a new visual methodology for the semi-automatic localization of protein-related data sets. J Bioinforma Comput Biol 11:1340005

    Article  CAS  Google Scholar 

  • Sommer B, Bender C, Hoppe T, Gamroth C, Jelonek L (2014) Stereoscopic cell visualization: from mesoscopic to molecular scale. J Electron Imaging 23:011007-1–011007-10. https://doi.org/10.1117/1.JEI.23.1.011007

    Article  Google Scholar 

  • Sommer B, Wang SJ, Xu L, Chen M, Schreiber F (2015) Hybrid-dimensional visualization and interaction - integrating 2D and 3D visualization with semi-immersive navigation techniques. In: Big data visual analytics (BDVA). IEEE, pp 1–8

    Google Scholar 

  • Sommer B, Hamacher A, Kaluza O, Czauderna T, Klapperstück M, Biere N, Civico M, Thomas B, Barnes DG, Schreiber F (2016) Stereoscopic space map – semi-immersive configuration of 3D-stereoscopic tours in multi-display Environments. In: Proceedings of stereoscopic displays and applications XXVII

    Google Scholar 

  • Sommer B, Baaden M, Krone M, Woods A (2018) From virtual reality to immersive analytics in bioinformatics. J Integr Bioinform 15:20180043

    PubMed Central  Google Scholar 

  • Sommer B, Lee CH, Martin N, Torrisi VS (2020) Immersive design engineering. In: Electronic imaging 2020 Proceedings of stereoscopic display and applications. XXXI, pp 265-1–265-16. https://doi.org/10.2352/ISSN.2470-1173.2020.2.SDA-265

    Chapter  Google Scholar 

  • Spevacek G (2000) Lernen mit Bildern in Texten: in Abhangigkeit von bereichsspezifischem Wissen, Gert Spevacek

    Google Scholar 

  • The Cell: An Image Library. http://www.cellimagelibrary.org. Accessed 8 Dec 2014

  • Töpel T, Kormeier B, Klassen A, Hofestädt R (2008) BioDWH: a data warehouse kit for life science data integration. J Integr Bioinform 5:93

    Google Scholar 

  • UniPort Consortium (2013) Update on activities at the universal protein resource (UniProt) in 2013. Nucleic Acids Res 41:D43–D47

    Article  CAS  Google Scholar 

  • Van Goethem S, Watts R, Dethoor A, Van Boxem R, van Zegveld K, Verlinden J, Verwulgen S (2020) The use of immersive technologies for concept design. In: International conference on applied human factors and ergonomics. Springer, Berlin, pp 698–704

    Google Scholar 

  • Wang Q (2011) 3DScape: three dimensional visualization plug-in for Cytoscape. Nat Prec. https://doi.org/10.1038/npre.2011.6094.1

  • Widjaja YY, Pang CNI, Li SS, Wilkins MR, Lambert TD (2009) The interactorium: visualising proteins, complexes and interaction networks in a virtual 3D cell. Proteomics 9:5309–5315

    Article  CAS  PubMed  Google Scholar 

  • Wiederhold BK (2020) Connecting through technology during the coronavirus disease 2019 pandemic: avoiding “Zoom Fatigue”. Mary Ann Liebert, Inc, Larchmont

    Google Scholar 

  • Wurtele ES, Li J, Diao L, Zhang H, Foster CM, Fatland B, Dickerson J, Brown A, Cox Z, Cook D (2003) MetNet: software to build and model the biogenetic lattice of Arabidopsis. Comp Funct Genomics 4:239–245

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Yang Y, Wurtele ES, Cruz-Neira C, Dickerson JA (2006) Hierarchical visualization of metabolic networks using virtual reality. In: Proceedings of the 2006 ACM international conference on virtual reality continuum and its applications. ACM, pp 377–381

    Chapter  Google Scholar 

  • Zhu L, Malatras A, Thorley M, Aghoghogbe I, Mer A, Duguez S, Butler-Browne G, Voit T, Duddy W (2015) CellWhere: graphical display of interaction networks organized on subcellular localizations. Nucleic Acids Res 43:W571–W575

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bjorn Sommer .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Sommer, B., Sayuti, A., Lee, C.H., Lin, Z., Hu, J., Hall, A. (2022). Immersive Exploration of Cell Localization Scenarios Using VR, Spatialized Video Communication, and Integrative Bioinformatics. In: Chen, M., Hofestädt, R. (eds) Integrative Bioinformatics. Springer, Singapore. https://doi.org/10.1007/978-981-16-6795-4_14

Download citation

Publish with us

Policies and ethics