Skip to main content
SpringerLink
Log in

EdgeWare: toward extensible and flexible middleware for connected vehicle services

  • Regular Paper
  • Published:
CCF Transactions on High Performance Computing Aims and scope Submit manuscript

Abstract

The dramatic development of Edge Computing technologies is strongly stimulating the adoption of machine learning models on connected and autonomous vehicles (CAVs) so that they can provide a variety of intelligent onboard services. When multiple services running on the resource-constrained CAVs, how limited resources can dynamically support the desired services is of the utmost importance for both automakers and domain researchers. In this context, efficiently and dynamically managing vehicle services becomes critical for autonomous driving. While previous research focused on service scheduling, computation offloading, and virtual machine migration, we propose EdgeWare, an extensible and flexible middleware to manage the execution of vehicle services, which is open-source to the community with four key features: i) on-demand model switch, i.e., easily switch and upgrade machine learning models, ii) function consolidation and deduplication to eliminate duplicate copies of repeating functions and maximize the reusability of vehicle services, iii) build event-driven applications to reduce workload, and iv) dynamic workflow customization which enables customizing workflow to extend the functionality. Our experiment results show that EdgeWare accelerates the execution of services about 2.6 \(\times\) faster compared to the silo approach and save CPU and memory utilization up to around 50% and 17% respectively, and it allows domain researchers to dynamically add new services on CAVs or easily switch to the upgraded applications for the life cycle management of vehicle services.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Ahmed, F., Kabir, M.H.: Facial feature representation with directional ternary pattern (dtp): Application to gender classification. In: 2012 IEEE 13th International conference on information reuse & integration (IRI), pp. 159–164 (2012). IEEE

  • Akiba, T., Suzuki, S., Fukuda, K.: Extremely large minibatch sgd: training resnet-50 on imagenet in 15 minutes. arXiv:1711.04325 (2017)

  • Arthurs, P., Gillam, L., Krause, P., Wang, N., Halder, K., Mouzakitis, A.: A taxonomy and survey of edge cloud computing for intelligent transportation systems and connected vehicles. IEEE Trans. Intell. Transp. Syst. (2021)

  • Badri, H., Bahreini, T., Grosu, D., Yang, K.: Multi-stage stochastic programming for service placement in edge computing systems: Poster. In: Proceedings of the Second ACM/IEEE Symposium on Edge Computing. SEC ’17, pp. 28–1282. ACM, New York, NY, USA (2017). https://doi.org/10.1145/3132211.3132461

  • Battle, R., Benson, E.: Bridging the semantic web and web 2.0 with representational state transfer (rest). J. Web Semant. 6(1), 61–69 (2008)

    Article  Google Scholar 

  • Beneventi, F., Bartolini, A., Cavazzoni, C., Benini, L.: Continuous learning of hpc infrastructure models using big data analytics and in-memory processing tools. In: Design, automation & test in Europe Conference & Exhibition (DATE), 2017, pp. 1038–1043 (2017). IEEE

  • BinMasoud, A., Cheng, Q.: Design of an iot-based vehicle state monitoring system using raspberry pi. In: 2019 International Conference on Electrical Engineering Research & Practice (ICEERP), pp. 1–6 (2019). IEEE

  • Bochkovskiy, A., Wang, C.-Y., Liao, H.-Y.M.: YOLOv4: optimal speed and accuracy of object detection. arXiv:2004.10934 (2020)

  • Cheng, Y., Wang, D., Zhou, P., Zhang, T.: A survey of model compression and acceleration for deep neural networks. arXiv:1710.09282 (2017)

  • Clapés, A., Bilici, O., Temirova, D., Avots, E., Anbarjafari, G., Escalera, S.: From apparent to real age: gender, age, ethnic, makeup, and expression bias analysis in real age estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 2373–2382 (2018)

  • Danish, M., Brazauskas, J., Bricheno, R., Lewis, I., Mortier, R.: Deepdish: multi-object tracking with an off-the-shelf raspberry pi. In: Proceedings of the Third ACM International Workshop on Edge Systems, Analytics and Networking, pp. 37–42 (2020)

  • Dong, Z., Gu, Y., Chen, J., Tang, S., He, T., Liu, C.: Enabling predictable wireless data collection in severe energy harvesting environments. In: 2016 IEEE Real-Time Systems Symposium (RTSS), pp. 157–166 (2016). IEEE

  • Dong, Z., Gu, Y., Fu, L., Chen, J., He, T., Liu, C.: Athome: Automatic tunable wireless charging for smart home. In: Proceedings of the Second International Conference on Internet-of-Things Design and Implementation, pp. 133–143 (2017)

  • Dong, Z., Liu, Y., Zhou, H., Xiao, X., Gu, Y., Zhang, L., Liu, C.: An energy-efficient offloading framework with predictable temporal correctness. In: Proceedings of the Second ACM/IEEE Symposium on Edge Computing. SEC ’17, pp. 19–11912. ACM, New York, NY, USA (2017). https://doi.org/10.1145/3132211.3134448

  • Drolia, U., Guo, K., Narasimhan, P.: Precog: Prefetching for image recognition applications at the edge. In: Proceedings of the Second ACM/IEEE Symposium on Edge Computing, pp. 1–13 (2017)

  • Eidinger, E., Enbar, R., Hassner, T.: Age and gender estimation of unfiltered faces. IEEE Trans. Inf. Forensic. Secur. 9(12), 2170–2179 (2014)

    Article  Google Scholar 

  • Elharrouss, O., Al-Maadeed, N., Al-Maadeed, S.: Video summarization based on motion detection for surveillance systems. In: 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC), pp. 366–371 (2019). IEEE

  • Face Detection. https://github.com/Kagami/go-face (2018)

  • Facial detection, recognition and emotion detection. https://github.com/priya-dwivedi/face_and_emotion_detection/blob/master/Facial%20Detection%2C%20Recognition%20and%20Emotion%20Detection.md (2019)

  • Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., Berg, A.C.: Dssd: Deconvolutional single shot detector. arXiv:1701.06659 (2017)

  • Gender Classification. https://github.com/BoyuanJiang/Age-Gender-Estimate-TF (2017)

  • Gibbs, S.: Google sibling waymo launches fully autonomous ride-hailing service. The Guardian 7, (2017)

  • Gillmore, S., Tenhundfeld, N.L.: The good, the bad, and the ugly: Evaluating tesla’s human factors in the wild west of self-driving cars. In: Human Factors and Ergonomics Society Annual Meeting (2020)

  • Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014)

  • Girshick, R.: Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp. 1440–1448 (2015)

  • Gupta, S.: Gender detection using machine learning techniques and delaunay triangulation. Int. J. Comput. Appl. 124(6) (2015)

  • Han, S., Mao, H., Dally, W.J.: Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv:1510.00149 (2015)

  • Hand, D.J.: Classifier technology and the illusion of progress. Stat. Sci. 1–14 (2006)

  • Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4295–4304 (2015)

  • He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)

  • Huang, R., Pedoeem, J., Chen, C.: YOLO-LITE: a real-time object detection algorithm optimized for non-GPU computers. In: 2018 IEEE International Conference on Big Data (Big Data), pp. 2503–2510 (2018). IEEE

  • Hung, C., Ananthanarayanan, G., Bodik, P., Golubchik, L., Yu, M., Bahl, P., Philipose, M.: VideoEdge: Processing camera streams using hierarchical clusters. In: 2018 IEEE/ACM Symposium on Edge Computing (SEC), pp. 115–131 (2018). https://doi.org/10.1109/SEC.2018.00016

  • Jang, S.Y., Lee, Y., Shin, B., Lee, D.: Application-aware iot camera virtualization for video analytics edge computing. In: 2018 IEEE/ACM Symposium on Edge Computing (SEC), pp. 132–144 (2018). https://doi.org/10.1109/SEC.2018.00017

  • Jiang, H., Learned-Miller, E.: Face detection with the faster r-cnn. In: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), pp. 650–657 (2017). IEEE

  • Jiang, B., Yang, J., Ding, G., Wang, H.: Cyber-physical security design in multimedia data cache resource allocation for industrial networks. IEEE Trans. Ind. Inf. 15(12), 6472–6480 (2019)

    Article  Google Scholar 

  • Kim, H.-C., Kim, D., Ghahramani, Z., Bang, S.Y.: Appearance-based gender classification with gaussian processes. Pattern Recognit. Lett. 27(6), 618–626 (2006)

    Article  Google Scholar 

  • Kiryong, H., Yoshihisa, A., Zhuo, C., Wenlu, H., Brandon, A.: Adaptive vm handoff across cloudlets. technical report cmu-c s-15–113. Computer Science Department, Carnegie Mellon University (2015)

  • Kreps, J., Narkhede, N., Rao, J., et al: Kafka: A distributed messaging system for log processing. In: Proceedings of the NetDB, vol. 11, pp. 1–7 (2011)

  • Kukkala, V.K., Tunnell, J., Pasricha, S., Bradley, T.: Advanced driver-assistance systems: a path toward autonomous vehicles. IEEE Consumer Electron. Magn. 7(5), 18–25 (2018)

    Article  Google Scholar 

  • Kumar, A.N., Sureshkumar, C.: Background subtraction based on threshold detection using modified k-means algorithm. In: 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering, pp. 378–382 (2013). IEEE

  • Lee, K., Flinn, J., Noble, B.D.: Gremlin: Scheduling interactions in vehicular computing. In: Proceedings of the Second ACM/IEEE Symposium on Edge Computing. SEC ’17, pp. 4–1413. ACM, New York, NY (2017). https://doi.org/10.1145/3132211.3134450

  • Levi, G., Hassner, T.: Age and gender classification using convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 34–42 (2015)

  • Lin, P., Liu, J., Jin, P.J., Ran, B.: Autonomous vehicle-intersection coordination method in a connected vehicle environment. IEEE Intell. Transp. Syst. Magz. 9(4), 37–47 (2017)

    Article  Google Scholar 

  • Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., Berg, A.C.: Ssd: Single shot multibox detector. In: European Conference on Computer Vision, pp. 21–37 (2016). Springer

  • Liu, L., Lu, S., Zhong, R., Wu, B., Yao, Y., Zhang, Q., Shi, W.: Computing systems for autonomous driving: state-of-the-art and challenges. IEEE Int. Things J. (2020)

  • Liu, P., Qi, B., Banerjee, S.: Edgeeye: An edge service framework for real-time intelligent video analytics. In: Proceedings of the 1st International Workshop on Edge Systems, Analytics and Networking. EdgeSys’18, pp. 1–6. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3213344.3213345

  • Liu, L., Qiao, X.Z.M., Shi, W.: Safeshareride: Edge-based attack detection in ridesharing services. In: USENIX Workshop on Hot Topics in Edge Computing (HotEdge 18). USENIX Association, Boston, MA (2018). https://www.usenix.org/conference/hotedge18/presentation/liu

  • Liu, B.: Lifelong machine learning: a paradigm for continuous learning. Front. Comput. Sci. 11(3), 359–361 (2017)

    Article  Google Scholar 

  • Lu, S., Luo, B., Patel, T., Yao, Y., Tiwari, D., Shi, W.: Making disk failure predictions smarter! In: 18th USENIX conference on file and storage technologies (FAST’ 20), pp. 151–167 (2020)

  • Lu, S., Yao, Y., Shi, W.: Collaborative learning on the edges: A case study on connected vehicles. In: 2nd USENIX Workshop on Hot Topics in Edge Computing (HotEdge 19) (2019)

  • Lu, S., Yuan, X., Shi, W.: An integrated framework for compressive imaging processing on cavs. In: the Fifth ACM/IEEE Symposium on Edge Computing (SEC ’20). IEEE, Virtual (2020)

  • Luo, Q., Hu, S., Li, C., Li, G., Shi, W.: Resource scheduling in edge computing: A survey. IEEE Commun. Surv. Tutor. (2021)

  • Luo, Q., Li, C., Luan, T.H., Shi, W.: Collaborative data scheduling for vehicular edge computing via deep reinforcement learning. IEEE Int. Things J. 7(10), 9637–9650 (2020)

    Article  Google Scholar 

  • Ma, L., Yi, S., Li, Q.: Efficient service handoff across edge servers via docker container migration. In: Proceedings of the Second ACM/IEEE Symposium on Edge Computing. SEC ’17, pp. 11–11113. ACM, New York, NY, USA (2017). https://doi.org/10.1145/3132211.3134460

  • Merkel, D.: Docker: lightweight linux containers for consistent development and deployment. Linux J. 2014(239), 2 (2014)

    Google Scholar 

  • Microsoft Rocket for Live Video Analytics. https://www.microsoft.com/en-us/research/project/live-video-analytics/ (2019)

  • Morozov, I.V., Kazennov, A., Bystryi, R., Norman, G.E., Pisarev, V., Stegailov, V.V.: Molecular dynamics simulations of the relaxation processes in the condensed matter on gpus. Comput. Phys. Commun. 182(9), 1974–1978 (2011)

    Article  Google Scholar 

  • Motion Detection. https://github.com/hybridgroup/gocv/blob/release/cmd/motion-detect/main.go (2017)

  • Nesbit, K.J., Smith, J.E.: Data cache prefetching using a global history buffer. In: 10th International symposium on high performance computer architecture (HPCA’04), pp. 96–96 (2004). IEEE

  • Norris, W.R., Allard, J., Filippov, M.O., Haun, R.D., Turner, C.D.G., Gilbertson, S., Norby, A.J.: Systems and methods for switching between autonomous and manual operation of a vehicle. Google Patents. US Patent 7,894,951 (2011)

  • Orf, S., Zofka, M.R., Zöllner, J.M.: From level four to five: Getting rid of the safety driver with diagnostics in autonomous driving. In: 2020 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), pp. 19–25 (2020). IEEE

  • Parks, D.H., Fels, S.S.: Evaluation of background subtraction algorithms with post-processing. In: 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance, pp. 192–199 (2008). IEEE

  • Project Flogo. https://github.com/TIBCOSoftware/flogo (2016)

  • Ravindran, A., George, A.: An edge datastore architecture for latency-critical distributed machine vision applications. In: USENIX Workshop on Hot Topics in Edge Computing (HotEdge 18). USENIX Association, Boston, MA (2018). https://www.usenix.org/conference/hotedge18/presentation/ravindran

  • Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)

  • Redmon, J., Farhadi, A.: Yolo9000: better, faster, stronger. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7263–7271 (2017)

  • Redmon, J., Farhadi, A.: YOLOv3: An incremental improvement. arXiv:1804.02767 (2018)

  • Ren, S., He, K., Girshick, R., Sun, J.: Faster r-cnn: Towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)

  • Rothe, R., Timofte, R., Van Gool, L.: DEX: Deep expectation of apparent age from a single image. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 10–15 (2015)

  • Rothe, R., Timofte, R., Van Gool, L.: Deep expectation of real and apparent age from a single image without facial landmarks. Int. J. Comput. Vis. 126(2–4), 144–157 (2018)

    Article  MathSciNet  Google Scholar 

  • Satyanarayanan, M., Bahl, P., Caceres, R., Davies, N.: The case for VM-based cloudlets in mobile computing. IEEE Pervas Comput 8(4), 14–23 (2009)

    Article  Google Scholar 

  • Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: A unified embedding for face recognition and clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 815–823 (2015)

  • Shi, W., Cao, J., Zhang, Q., Li, Y., Xu, L.: Edge computing: vision and challenges. IEEE Int. Things J. 3(5), 637–646 (2016)

    Article  Google Scholar 

  • Showcase of awesome activities, triggers and apps for Flogo. https://tibcosoftware.github.io/flogo/showcases/ (2016)

  • Sidi, L., Weisong, S.: The emergence of vehicle computing. IEEE Int. Comput. (2021)

  • Spiga, F., Girotto, I.: phigemm: a cpu-gpu library for porting quantum espresso on hybrid systems. In: 2012 20th Euromicro International Conference on Parallel, Distributed and Network-based Processing, pp. 368–375 (2012). IEEE

  • Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A.: Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-first AAAI Conference on Artificial Intelligence (2017)

  • Tsymbal, A.: The problem of concept drift: definitions and related work. Comput. Sci. Dept Trinity Coll. Dublin 106(2), 58 (2004)

    Google Scholar 

  • Vanini, Z.S., Khorasani, K., Meskin, N.: Fault detection and isolation of a dual spool gas turbine engine using dynamic neural networks and multiple model approach. Inf. Sci. 259, 234–251 (2014)

    Article  Google Scholar 

  • Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)

    Article  Google Scholar 

  • Wang, J., Feng, Z., Chen, Z., George, S., Bala, M., Pillai, P., Yang, S.-W., Satyanarayanan, M.: Bandwidth-efficient live video analytics for drones via edge computing. In: 2018 IEEE/ACM Symposium on Edge Computing (SEC), pp. 159–173 (2018). IEEE

  • Wang, L., Zhang, Q., Li, Y., Zhong, H., Shi, W.: Mobileedge: Enhancing on-board vehicle computing units using mobile edges for cavs. In: 2019 IEEE 25th International Conference on Parallel and Distributed Systems (ICPADS), pp. 470–479 (2019). IEEE

  • Wu, C.-J., Brooks, D., Chen, K., Chen, D., Choudhury, S., Dukhan, M., Hazelwood, K., Isaac, E., Jia, Y., Jia, B., et al: Machine learning at Facebook: Understanding inference at the edge. In: 2019 IEEE International Symposium on High Performance Computer Architecture (HPCA), pp. 331–344 (2019). IEEE

  • Wu, B., Dai, X., Zhang, P., Wang, Y., Sun, F., Wu, Y., Tian, Y., Vajda, P., Jia, Y., Keutzer, K.: Fbnet: Hardware-aware efficient convnet design via differentiable neural architecture search. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 10734–10742 (2019)

  • Xu, K., Xiao, X., Miao, J., Luo, Q.: Data driven prediction architecture for autonomous driving and its application on apollo platform. In: 2020 IEEE Intelligent Vehicles Symposium (IV), pp. 175–181 (2020). IEEE

  • Yi, S., Hao, Z., Zhang, Q., Zhang, Q., Shi, W., Li, Q.: Lavea: Latency-aware video analytics on edge computing platform. In: Proceedings of the Second ACM/IEEE Symposium on Edge Computing. SEC ’17, pp. 15–11513. ACM, New York, NY, USA (2017). https://doi.org/10.1145/3132211.3134459

  • Zhang, Z., Song, Y., Qi, H.: Age progression/regression by conditional adversarial autoencoder. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017). IEEE

  • Zhang, Q., Yu, Z., Shi, W., Zhong, H.: EVAPS: Edge video analysis for public safety. In: 2016 IEEE/ACM Symposium on Edge Computing (SEC), pp. 121–122 (2016). https://doi.org/10.1109/SEC.2016.30

  • Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23(10), 1499–1503 (2016)

    Article  Google Scholar 

  • Zhao, Y., Kim, B.: Optimizing allocation and scheduling of connected vehicle service requests in cloud/edge computing. In: 2020 IEEE 13th International Conference on Cloud Computing (CLOUD), pp. 361–369 (2020). https://doi.org/10.1109/CLOUD49709.2020.00057

  • Zhou, P., Dai, L., Jiang, H.: Sequence training of multiple deep neural networks for better performance and faster training speed. In: 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5627–5631 (2014). IEEE

  • Zhou, P., Jiang, H., Dai, L.-R., Hu, Y., Liu, Q.-F.: State-clustering based multiple deep neural networks modeling approach for speech recognition. IEEE/ACM Trans. Audio Speech Lang. Process. 23(4), 631–642 (2015)

    Article  Google Scholar 

  • Žliobaitė, I.: Learning under concept drift: an overview. arXiv:1010.4784 (2010)

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Wayne State University, Detroit, MI, 48202, USA

    Sidi Lu, Yongtao Yao, Bing Luo & Weisong Shi

  2. Edgemind Solutions LLC, Detroit, MI, 48201, USA

    Zhifeng Yu & Dalong Li

Authors
  1. Sidi Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yongtao Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bing Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhifeng Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dalong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Weisong Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sidi Lu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, S., Yao, Y., Luo, B. et al. EdgeWare: toward extensible and flexible middleware for connected vehicle services. CCF Trans. HPC 4, 339–356 (2022). https://doi.org/10.1007/s42514-022-00100-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42514-022-00100-4

Keywords

Search

Navigation