Skip to main content
View expanded cover

Human-Friendly Robotics 2021 pp 91–106Cite as

Robotized Laundry Manipulation With Appliance User Interface Interpretation

Part of the Springer Proceedings in Advanced Robotics book series (SPAR,volume 23)

Abstract

In this paper, a robotized laundry picking and insertion in to washing machine followed by display interpretation and adjustment of the washing cycle for a complete robotic laundry operation is described. To ensure the successful insertion of a laundry, recovery picking from the drum door region in case large clothes remain partially out from the washing machine is also evaluated. A pointcloud-based perception algorithm is proposed to detect wrinkles on the cloth surface to compute spline curves along the wrinkle-like structure and estimate grasping frames. Even more, to insure graspability in the absence of wrinkles, a blob detection approach is evaluated together with grasp pose quality ranking to aim for the optimal pose. A deep learning based washing machine user-interface detection and interpretation algorithm is also developed, to fully Automate the robotic laundry operation. A fully autonomous laundry handling and washing cycle setting on the appliance display is tested and validated extensively by performing multiple tasks using our robotic platforms (Tiago and Baxter) and AEG washing machine.

Keywords

  • Laundry automation
  • Deformable objects
  • User interface interpretation
  • Deep learning

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-96359-0_7
  • Chapter length: 16 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   149.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-96359-0
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Hardcover Book
USD   199.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

References

  1. Jiménez, P.,  Torras, C.: Perception of cloth in assistive robotic manipulation tasks. Nat. Comput. 1–23 (2020)

    Google Scholar 

  2. Sanchez, J., Corrales, J.-A., Bouzgarrou, B.-C., Mezouar, Y.: Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a survey. Int. J. Robot. Res. 37(7), 688–716 (2018)

    CrossRef  Google Scholar 

  3. Kita, Y., Kanehiro, F., Ueshiba, T., Kita, N.: Clothes handling based on recognition by strategic observation. In: Proceedings of the IEEE ICRA (2011)

    Google Scholar 

  4. Ramisa, A., Alenya, G., Moreno-Noguer, F., Torras, C.: Using depth and appearance features for informed robot grasping of highly wrinkled clothes. In: Proceedings of the IEEE ICRA (2012)

    Google Scholar 

  5. Yamazaki, K.: Grasping point selection on an item of crumpled clothing based on relational shape description. In: Proceedings of the IEEE/RSJ IROS (2014)

    Google Scholar 

  6. Shibata, M., Ota, T., Hirai, S.: Wiping motion for deformable object handling. In: Proceedings of the IEEE ICRA (2009)

    Google Scholar 

  7. Monsó, P., Alenyà, G., Torras, C.: Pomdp approach to robotized clothes separation. In: Proceedings of the IEEE/RSJ IROS (2012)

    Google Scholar 

  8. Cusumano-Towner, M., Singh, A., Miller, S., O’Brien, J.F., Abbeel, P.: Bringing clothing into desired configurations with limited perception. In: Proceedings of the IEEE ICRA (2011)

    Google Scholar 

  9. Doumanoglou, A., Kargakos, A., Kim, T.-K., Malassiotis, S.: Autonomous active recognition and unfolding of clothes using random decision forests and probabilistic planning. In: Proceedings of the IEEE ICRA (2014)

    Google Scholar 

  10. Alexa, M., Behr, J., Cohen-Or, D., Fleishman, S., Levin, D., Silva, C.T.: Computing and rendering point set surfaces. IEEE Trans. Vis. Comput. Graph. 9(1), 3–15 (2003)

    CrossRef  Google Scholar 

  11. Rusu, R.B.: Semantic 3d object maps for everyday manipulation in human living environments. KI-Künstliche Intelligenz (2010)

    Google Scholar 

  12. Christoph Stein, S., Schoeler, M., Papon, J., Worgotter, F.: Object partitioning using local convexity. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 304–311 (2014)

    Google Scholar 

  13. Caporali, A., Palli, G.: Pointcloud-based identification of optimal grasping poses for cloth-like deformable objects. In: Proceeding of the IEEE International Conference on Factory Automation and Emerging Technologies (2020)

    Google Scholar 

  14. Papon, J., Abramov, A., Schoeler, M., Worgotter, F.: Voxel cloud connectivity segmentation-supervoxels for point clouds. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2013)

    Google Scholar 

  15. Buch, A.G., Kraft, D., Kamarainen, J.-K., Petersen, H.G., Krüger, N.: Pose estimation using local structure-specific shape and appearance context. In: Proceedings of the IEEE ICRA (2013)

    Google Scholar 

  16. Rusu, R.B., Blodow, N., Beetz, M.: Fast point feature histograms (fpfh) for 3d registration. In: Proceedings of the IEEE ICRA (2009)

    Google Scholar 

  17. Bay, H., Tuytelaars, T., Van Gool, L.: Surf: Speeded up robust features. In: European Conference on Computer Vision, pp. 404–417. Springer (2006)

    Google Scholar 

  18. Muja, M., Lowe, D.G.: Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP (1) 2(2), 331–340 (2009)

    Google Scholar 

  19. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    MathSciNet  CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DEI - Department of Electrical, Electronic and Information Engineering, University of Bologna, Viale Risorgimento 2, 40136, Bologna, Italy

    Wendwosen B. Bedada, Ismayil Ahmadli & Gianluca Palli

Authors
  1. Wendwosen B. Bedada
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ismayil Ahmadli
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gianluca Palli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wendwosen B. Bedada .

Editor information

Editors and Affiliations

  1. University of Bologna, Bologna, Italy

    Prof. Dr. Gianluca Palli

  2. University of Bologna, Bologna, Italy

    Prof. Dr. Claudio Melchiorri

  3. University of Bologna, Bologna, Italy

    Dr. Roberto Meattini

Rights and permissions

Reprints and Permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Bedada, W.B., Ahmadli, I., Palli, G. (2022). Robotized Laundry Manipulation With Appliance User Interface Interpretation. In: Palli, G., Melchiorri, C., Meattini, R. (eds) Human-Friendly Robotics 2021. Springer Proceedings in Advanced Robotics, vol 23. Springer, Cham. https://doi.org/10.1007/978-3-030-96359-0_7

Download citation