Abstract
This paper describes a tool for assisting lawyers and paralegal teams during document review in eDiscovery. The tool combines a machine learning technology (CategoriX) and advanced multi-touch interface capable of not only addressing the usual cost, time and accuracy issues in document review, but also of facilitating the work of the review teams by capitalizing on the intelligence of the reviewers and enabling collaborative work.
Similar content being viewed by others
Notes
BackStop Software. http://backstopllp.com/software.html.
(YouTube video at: http://www.youtube.com/watch?v=tNd8SGBtmzI).
Multi-Touch G² Touch Screen. PQ Labs, California. http://multi-touch-screen.net/.
RonCD3 Enron subset by R. Bekkerman (http://www.cs.umass.edu/~ronb/enron_dataset.html).
References
Attfield S, De Gabrielle S, Blandford A (2009) The loneliness of the long-distance document reviewer: e-Discovery and cognitive ergonomics. In: DESI III workshop at ICAIL, Barcelona, June 2009
Barnett T, Godjevac S, Privault C, Renders JM, Wickstrom R (2009) Machine learning classification for document review. In: DESI III Workshop at ICAIL, Barcelona, June 2009 (http://www.law.pitt.edu/DESI3_Workshop/DESI_III_papers.htm)
Baron J, Braman R, Withers K, Allman T, Daley M, Paul G (2007) Best practices commentary on the use of search & information retrieval methods in e-Discovery. The Sedona Conference Journal 8:189–223
Belkin NJ (2008) Some(what) grand challenges for information retrieval. ACM SIGIR Forum Arch 42(1):47–54
Blair DC, Maron ME (1985) Evaluation of retrieval effectiveness for a full-text document-retrieval system. Commun ACM 28(3):289–299
Davis JE, Matus WC (2008) Does your search pass judicial scrutiny? NY Law J. http://www.law.com/jsp/nylj/index.jsp
Gaussier E, Goutte C, Popat K, Chen F (2002) A hierarchical model for clustering and categorising documents. In: Proceedings of the 24th BCS-IRSG European Colloquium on IR research: advances in information retrieval, 25–27 March 2002, pp 229–247
Greenwood A (2007) Attorney at Blah. In: Washington city paper. http://www.washingtoncitypaper.com/display.php?id=34054
Hearst MA (2009) Search user interfaces. Cambridge University Press, Cambridge
Hofmann T (1999) Probabilistic latent semantic analysis. In: Proceedings of 15th conference on uncertainty in artificial intelligence. Morgan Kaufmann, pp 289–296
Kershaw A (2005) Automated document review proves its reliability. Digit Discov e-Evid 5(11). http://www.akershaw.com/iframes/akershaw_publications.html
Liddy E (2005) Document retrieval, automatic. In: Encyclopedia of language and linguistics, 2nd edn. Elsevier, Amsterdam
Love N (2006) Automating document review. In: CS224n final project http://nlp.stanford.edu/courses/cs224n/2006/fp/natlove-1-natlove_cs224n_final.pdf
McNee MS, Arnette B (2008) Productivity as a metric for visual analytics: reflections on e-discovery. In: Proceedings of the BELIV’08 conference, Florence, Italy
Roitblat HL, Kershaw A, Oot P (2010) Document categorization in legal electronic discovery: computer classification vs. manual review. JASIST 61(1):70–80
Sebastiani F (2002) Machine learning in automated text categorization. ACM Comput Surv 34(1):1–47
Smart Document Review (2010) http://www.youtube.com/watch?v=tNd8SGBtmzI
Tomlinson S, Oard DW, Baron JR, Thompson P (2007) Overview of the TREC 2007 legal track. In: TREC 2007 (http://trec-legal.umiacs.umd.edu/)
Turtle H (1994) Natural language vs. Boolean query evaluation: a comparison of retrieval performance. In: Proceedings of the 17th ACM SIGIR, Dublin, pp 212–220
Victor Stanley Inc. v. Creative Pipe Inc. 2008 WL 2221841 (D.Md. 2008). http://ralphlosey.files.wordpress.com/2008/06/victorstanleymomay29-08final.pdf
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Privault, C., O’Neill, J., Ciriza, V. et al. A new tangible user interface for machine learning document review. Artif Intell Law 18, 459–479 (2010). https://doi.org/10.1007/s10506-010-9090-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10506-010-9090-z