Towards Similarity Models in Police Photo Lineup Assembling Tasks

  • Ladislav PeskaEmail author
  • Hana Trojanova
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11223)


Photo lineups play a significant role in the eyewitness identification process. Lineups are used to provide evidence in the prosecution and subsequent conviction of suspects. Unfortunately, there are many cases where lineups have led to the incorrect identification and conviction of innocent suspects. One of the key factors affecting the incorrect identification is the lack of lineup fairness, i.e. that the suspect differs significantly from other candidates. Although the process of assembling a fair lineup is both highly important and time-consuming, only a handful of tools are available to simplify the task.

In this paper, we follow our previous work in this area and focus on defining and tuning the inter-person similarity metric that will serve as a base for a lineup candidate recommender system. This paper proposes an inter-person similarity metric based on DCNN descriptors of candidates’ photos and their content-based features, which is further tuned by the feedback of domain experts. The recommending algorithm further considers the need for uniformity in lineups. The proposed method was evaluated in a realistic user study focused on lineup fairness over solutions proposed by domain experts.

Results shown indicate that the precision of the proposed method is similar to the solutions proposed by domain experts and therefore the approach may significantly reduce the amount of manual work needed for assembling photo lineups.


Photo lineups Recommender systems Inter-person similarity 



This work was supported by the Czech grants GAUK-232217 and GACR-17-22224S. Source codes and raw results are available from


  1. 1.
    Brigham, J.C.: Applied issues in the construction and expert assessment of photo lineups. Appl. Cogn. Psychol. 13, S73–S92 (1999)CrossRefGoogle Scholar
  2. 2.
    Carbonell, J., Goldstein, J.: The use of MMR, diversity-based reranking for reordering documents and producing summaries. In: 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 1998 (1998)Google Scholar
  3. 3.
    Charman, S.D., et al.: The dud effect: adding highly dissimilar fillers increases confidence in lineup identifications. Law Hum. Behav. 35, 479–500 (2011)CrossRefGoogle Scholar
  4. 4.
    Gatys, L.A., et al.: Image style transfer using convolutional neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition (2016)Google Scholar
  5. 5.
    Kingma, D.P., Ba, J.L.: Adam: a method for stochastic optimization. In: 2015 International Conference on Learning Representations, pp. 1–15 (2015)Google Scholar
  6. 6.
    Kunaver, M., Požrl, T.: Diversity in recommender systems – a survey. Knowl.-Based Syst. 123, 154–162 (2017)CrossRefGoogle Scholar
  7. 7.
    MacLin, O.H., et al.: PC_Eyewitness and the sequential superiority effect: computer-based lineup administration. Law Hum. Behav. 29, 303–321 (2005)CrossRefGoogle Scholar
  8. 8.
    Malpass, R.S., Lindsay, R.C.: Measuring line-up fairness. Appl. Cogn. Psychol. 13, S1–S7 (1999)CrossRefGoogle Scholar
  9. 9.
    Mansour, J.K., et al.: Evaluating lineup fairness: variations across methods and measures. Law Hum. Behav. 41, 103 (2017)CrossRefGoogle Scholar
  10. 10.
    Parkhi, O.M., et al.: Deep face recognition. In: 2015 Proceedings of the British Machine Vision Conference (2015)Google Scholar
  11. 11.
    Peska, L., Trojanova, H.: Towards recommender systems for police photo lineup. In: ACM International Conference Proceeding Series (2017)Google Scholar
  12. 12.
    Smith, A.M., et al.: Fair lineups are better than biased lineups and showups, but not because they increase underlying discriminability. Law Hum. Behav. 41, 127 (2017)CrossRefGoogle Scholar
  13. 13.
    Steblay, N., et al.: Eyewitness accuracy rates in police showup and lineup presentations: a meta-analytic comparison. Law Hum. Behav. 27, 523–540 (2003)CrossRefGoogle Scholar
  14. 14.
    Tredoux, C.: A direct measure of facial similarity and its relation to human similarity perceptions. J. Exp. Psychol. Appl. 8, 180 (2002)CrossRefGoogle Scholar
  15. 15.
    Valentine, T.R., et al.: How can psychological science enhance the effectiveness of identification procedures? An international comparison. Public Interest Law Report (2007)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Faculty of Mathematics and PhysicsCharles UniversityPragueCzech Republic
  2. 2.Faculty of PhilosophyCharles UniversityPragueCzech Republic

Personalised recommendations