File-Less Approach to Large Scale Data Management

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9523)

Abstract

With the continuously increasing amount of online resources and data such use cases as discovery, maintenance and inter-operation become more and more complex. In particular, data management is becoming one of the main issues with respect to both scientific (large scale simulations or data mining applications) as well as consumer use cases (accessing photos or email attachments on mobile devices). We believe that one of the main bottlenecks blocking development of solutions providing truly seamless developer and user experience is the concept of file and filesystem. We present Filess, vision and architecture of file-less information systems where files are not necessary, neither in the application nor operating system layers.

Keywords

File systems Data management Hypergraphs 

References

  1. 1.
    Bandulet, C.: Object-based storage devices (2007). http://developers.sun.com/solaris/articles/osd.html
  2. 2.
    Berge, C.: Hypergraphs: Combinatorics of Finite Sets. North-Holland Mathematical Library, vol. 45. North-Holland, Amsterdam (1989)MATHGoogle Scholar
  3. 3.
    Boyd, M., Mçbrien, P.: Comparing and transforming between data models via an intermediate hypergraph data model. In: Spaccapietra, S. (ed.) Journal on Data Semantics IV. LNCS, vol. 3730, pp. 69–109. Springer, Heidelberg (2005) CrossRefGoogle Scholar
  4. 4.
    Drago, I., Mellia, M., Munafo, M.M., Sperotto, A., Sadre, R., Pras, A.: Inside dropbox: understanding personal cloud storage services. In: Proceedings of the 2012 ACM Conference on Internet Measurement Conference, IMC 2012, pp. 481–494. ACM, New York (2012)Google Scholar
  5. 5.
    Ferré, S., Ridoux, O.: A file system based on concept analysis. In: Palamidessi, C., Moniz Pereira, L., Lloyd, J.W., Dahl, V., Furbach, U., Kerber, M., Lau, K.-K., Sagiv, Y., Stuckey, P.J. (eds.) CL 2000. LNCS (LNAI), vol. 1861, pp. 1033–1047. Springer, Heidelberg (2000) CrossRefGoogle Scholar
  6. 6.
    Gallo, G., Longo, G., Pallottino, S., Nguyen, S.: Directed hypergraphs and applications. Discrete Appl. Math. 42(2–3), 177–201 (1993)MATHCrossRefMathSciNetGoogle Scholar
  7. 7.
    Gantz, J., Reinsel, D.: The Digital Universe in 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East. International Data Corporation, December 2010. https://www.emc.com/collateral/analyst-reports/idc-digital-universe-united-states.pdf
  8. 8.
    Gifford, D.K., Jouvelot, P., Sheldon, M.A., O’Toole, Jr., J.W.: Semantic file systems. SIGOPS Oper. Syst. Rev. 25(5), 16–25 (1991)Google Scholar
  9. 9.
    Grimes, R.: Code name WinFS: Revolutionary file storage system lets users search and manage files based on content. MSDN Magazine 19(1) (2004). http://msdn.microsoft.com/msdnmag/issues/04/01/WinFS/
  10. 10.
    IDC iView: The Digital Universe Decade - Are You Ready? International Data Corporation, Framingham, MA, USA (2010). http://www.emc.com/digital_universe
  11. 11.
    Iordanov, B.: HyperGraphDB: a generalized graph database. In: Shen, H.T., Pei, J., Özsu, M.T., Zou, L., Lu, J., Ling, T.-W., Yu, G., Zhuang, Y., Shao, J. (eds.) WAIM 2010. LNCS, vol. 6185, pp. 25–36. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  12. 12.
    Kryza, B., Kitowski, J.: Comparison of information representation formalisms for scalable file agnostic information infrastructures. Comput. Inf. 34, 473–494 (2015)Google Scholar
  13. 13.
    Kryza, B., Kitowski, J.: Filess - file-less architecture for future information systems. In: 2014 IEEE Fourth International Conference on Big Data and Cloud Computing, BDCloud 2014, Sydney, Australia, 3–5 December 2014, pp. 281–282 (2014)Google Scholar
  14. 14.
    Mylka, A., Mylka, A., Kryza, B., Kitowski, J.: Integration of heterogeneous data sources in an ontological knowledge base. Comput. Inf. 31(1), 189–223 (2012)Google Scholar
  15. 15.
    Orient Technologies: OrientDB project website. http://www.orientechnologies.com
  16. 16.
    Padioleau, Y., Ridoux, O.: A logic file system. In: Proceedings of the General Track: 2003 USENIX Annual Technical Conference, San Antonio, Texas, USA, 9–14 June 2003, pp. 99–112 (2003)Google Scholar
  17. 17.
    Rajimwale, A., Prabhakaran, V., Davis, J.D.: Block management in solid-state devices. In: Proceedings of the 2009 Conference on USENIX Annual Technical Conference, USENIX 2009, pp. 21–21. USENIX Association, Berkeley (2009)Google Scholar
  18. 18.
    Reiser, H.: Futurue vision of reiserfs (2006). https://reiser4.wiki.kernel.org/index.php/Future_Vision
  19. 19.
    Salton, G.: Another look at automatic text-retrieval systems. Commun. ACM 29(7), 648–656 (1986). http://doi.acm.org/10.1145/6138.6149 CrossRefGoogle Scholar
  20. 20.
    SanDisk: Ulltradimm product page. http://www.sandisk.com/enterprise/ulltradimm-ssd/
  21. 21.
    Seagate Technology LLC: The seagate kinetic open storage vision. Seagate Technology LLC (2013). http://www.seagate.com/tech-insights/kinetic-vision-how-seagate-new-developertools-meets-the-needs-of-cloud-storage-platforms-master-ti/
  22. 22.
    Stender, J., Hogqvist, M., Kolbeck, B.: Loosely time-synchronized snapshots in object-based file systems. In: IPCCC, pp. 188–197. IEEE (2010)Google Scholar
  23. 23.
    Wang, F., Brandt, S.A., Miller, E.L., Long, D.D.E.: OBFS: a file system for object-based storage devices. In: Proceedings of the 21st IEEE/12TH NASA Goddard Conference on Mass Storage Systems and Technologies, College Park, MD, pp. 283–300 (2004)Google Scholar
  24. 24.
    Williams, R.: How we found the missing memristor. IEEE Spectr. 45(12), 28–35 (2008)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Department of Computer Science, Faculty of Computer Science, Electronics and TelecommunicationsAGH University of Science and TechnologyKrakowPoland

Personalised recommendations