Using Simulation to Evaluate Data-Driven Agents

  • Elizabeth Sklar
  • Ilknur Icke
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5269)

Abstract

We use simulation to evaluate agents derived from humans interacting in a structured on-line environment. The data set was gathered from student users of an adaptive educational assessment. These data illustrate human behavior patterns within the environment, and we employed these data to train agents to emulate these patterns. The goal is to provide a technique for deriving a set of agents from such data, where individual agents emulate particular characteristics of separable groups of human users and the set of agents collectively represents the whole. The work presented here focuses on finding separable groups of human users according to their behavior patterns, and agents are trained to embody the group’s behavior. The burden of creating a meaningful training set is shared across a number of users instead of relying on a single user to produce enough data to train an agent. This methodology also effectively smooths out spurious behavior patterns found in individual humans and single performances, resulting in an agent that is a reliable representative of the group’s collective behavior. Our demonstrated approach takes data from hundreds of students, learns appropriate groupings of these students and produces agents which we evaluate in a simulated environment. We present details and results of these processes.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Elizabeth Sklar
    • 1
    • 2
  • Ilknur Icke
    • 2
  1. 1.Dept of Computer and Information Science, Brooklyn CollegeCity University of New YorkUSA
  2. 2.Dept of Computer Science, The Graduate CenterCity University of New YorkNew YorkUSA

Personalised recommendations