Skip to main content

Overview of the S3 Contest: Performance Evaluation of Semantic Service Matchmakers

  • Chapter
  • First Online:
Semantic Web Services

Abstract

This chapter provides an overview of the organization and latest results of the international contest series on semantic service selection (S3). In particular, we introduce its publicly available S3 evaluation framework including the standard OWL-S and SAWSDL service retrieval test collections OWLS-TC and SAWSDL-TC as well as its retrieval performance evaluation tool SME2. Further, we classify and present representative examples of Semantic Web service matchmakers which participated in the S3 contest from 2007 to 2010. Eventually, we present and discuss selected results of the comparative experimental performance evaluation of all matchmakers that have been contested in the past editions of the S3 series.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.w3.org/Submission/OWL-S/

  2. 2.

    http://www.w3.org/2002/ws/sawsdl/

  3. 3.

    http://www.wsmo.org/wsml/wsml-syntax

  4. 4.

    http://projects.semwebcentral.org/projects/owls-tc/

  5. 5.

    http://projects.semwebcentral.org/projects/sawsdl-tc/

  6. 6.

    http://projects.semwebcentral.org/projects/sme2/

  7. 7.

    http://www.dfki.de/-klusch/s3/

  8. 8.

    http://projects.semwebcentral.org/projects/owls2wsdl/

  9. 9.

    http://research.nii.ac.jp/ntcir/index-en.html

  10. 10.

    linkedservices.org

  11. 11.

    http://www.seals-project.eu/

  12. 12.

    http://www.dfki.de/~klusch/s3

References

  1. S. Dietze, N. Benn, J. Domingue, A. Conconi, F. Cattaneo, Two-fold semantic web service matchmaking – applying ontology mapping for service discovery, in Proceedings of 4th Asian Semantic Web Conference, Shanghai, 2009

    Google Scholar 

  2. M. Dudev, P. Kapahnke, J. Misutka, M. Vasileski, M. Klusch, SME2: Semantic Service Matchmaker Evaluation Environment. Latest version 2.2 was released on Dec 2, 2010, at semwebcentral: http://projects.semwebcentral.org/projects/sme2/. First version of SME2 was released at semwebcentral on 17 Apr 2008. Online support for the SME2 tool is provided by Patrick Kapahnke DFKI (2007)

  3. C. Kiefer, A. Bernstein, The creation and evaluation of iSPARQL strategies for matchmaking, in Proceedings of the 5th European Semantic Web Conference (ESWC), Tenerife, 2008

    Google Scholar 

  4. M. Klusch, Semantic web service description, in CASCOM – Intelligent Service Coordination in the Semantic Web, ed. by M. Schumacher, H. Helin, Chapter 3 (Birkhäuser Verlag, Springer, Basel, 2008)

    Google Scholar 

  5. M. Klusch, Semantic web service coordination, in CASCOM – Intelligent Service Coordination in the Semantic Web, ed. by M. Schumacher, H. Helin, Chapter 4 (Birkhäuser Verlag, Springer, Basel, 2008)

    Google Scholar 

  6. M. Klusch, K. Sycara, Brokering and matchmaking for coordination of agent societies: a survey, in Coordination of Internet Agents, ed. by A. Omicini et al., Chapter 8 (Springer, London, 2001)

    Google Scholar 

  7. M. Klusch, P. Kapahnke, OWLS-MX3: an adaptive hybrid semantic service matchmaker for OWL-S, in CEUR Proceedings of 3rd International Workshop on Semantic Matchmaking and Resource Retrieval (SMR2), Washington, 2009

    Google Scholar 

  8. M. Klusch, B. Fries, K. Sycara, OWLS-MX: a hybrid semantic web service matchmaker for OWL-S services. Web Semant. 7(2), 121–133 (2009), Elsevier

    Google Scholar 

  9. M. Klusch, P. Kapahnke, I. Zinnikus, Adaptive hybrid semantic selection of SAWSDL services with SAWSDL-MX2. Semant. Web Inf. Syst. 6(4), 1–26 (2011), IGI Global

    Google Scholar 

  10. OWLS-TC: OWL-S service retrieval test collection. Latest version OWLS-TC 4.0 (OWLS-TC4) published on 21 Sept 2010, at semwebcentral: http://projects.semwebcentral.org/projects/owls-tc/. First version of OWLS-TC was created by Benedikt Fries, Mahboob Khalid, Matthias Klusch (DFKI) and published at semwebcentral on 11 Apr 2005

  11. P. Plebani, B. Pernici, URBE: web service retrieval based on similarity evaluation. IEEE Trans. Knowl. Data Eng. 21, 1629–1642 (2010)

    Google Scholar 

  12. SAWSDL-TC: SAWSDL service retrieval test collection. Latest version SAWSDL-TC 3.0 (SAWSDL-TC3) published on 22 Sept 2009, at semwebcentral: http://projects.semwebcentral.org/projects/sawsdl-tc/. First version of SAWSDL-TC was created by Patrick Kapahnke, Martin Vasileski, Matthias Klusch (DFKI) and published at semwebcentral on 28 July 2008

  13. M.L. Sbodio, D. Martin, C. Moulin, Discovering semantic web services using SPARQL and intelligent agents. Web Semant. 8(4), 310–328 (2010), Elsevier

    Google Scholar 

  14. E. Toch, A. Gal, I. Reinhartz-Berger, D. Dori, A semantic approach to approximate service retrieval. ACM Trans. Internet Technol. (TOIT) 8(1), 2-es (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matthias Klusch .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Klusch, M. (2012). Overview of the S3 Contest: Performance Evaluation of Semantic Service Matchmakers. In: Blake, B., Cabral, L., König-Ries, B., Küster, U., Martin, D. (eds) Semantic Web Services. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28735-0_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28735-0_2

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28734-3

  • Online ISBN: 978-3-642-28735-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics