Interactive POMDPs


Tutorials:

  • Prashant Doshi, Zinovi Rabinovich and Piotr Gmytrasiewicz, "Decision Making in Extended Multiagent Interactions", in AAMAS, 2009 [flyer] [slides]
  • Prashant Doshi and Zinovi Rabinovich, "Decision Making in Extended Multiagent Interactions", in AAMAS, 2008 [flyer] [slides]

Framework:

  • Adam Goodie, Prashant Doshi and Diana Young, "Two Level Recursive Reasoning by Humans Playing Sequential Fixed-Sum Games", in MSDM Workshop, 2009 [paper] [talk]
  • Prashant Doshi, "On the Role of Interactive Epistemology in Multiagent Planning", in AIPR, 2007 (invited paper) [paper] [talk]
  • Prashant Doshi and Piotr Gmytrasiewicz, "On the Difficulty of Achieving Equilibria in Interactive POMDPs", in AAAI, 2006 [paper] [talk]
    • Prashant Doshi and Piotr Gmytrasiewicz, "On the Difficulty of Achieving Equilibria in Interactive POMDPs", in AI and Math Symposium, 2006 [paper]
    • Prashant Doshi and Piotr Gmytrasiewicz, "Subjective Equilibrium in Interactive POMDPs: Theory and Computational Limitations", in GTDT Workshop, 2005 [paper]
  • Piotr Gmytrasiewicz and Prashant Doshi, "A Framework for Sequential Planning in Multiagent Settings", in Journal of AI Research (JAIR), Vol 24: 49-79, 2005 [article]
    • Piotr Gmytrasiewicz and Prashant Doshi, "Interactive POMDPs: Properties and Preliminary Results", poster paper in AAMAS, 2004
      • Piotr Gmytrasiewicz and Prashant Doshi, "A Framework for Sequential Planning in Multiagent Settings", in GTDT Workshop, 2004 [paper]
      • Prashant Doshi, "A Framework for Optimal Sequential Planning in Multiagent Settings", in AAAI/SIGART Doctoral Consortium, 2004 [paper]
      • Piotr Gmytrasiewicz and Prashant Doshi, "A Framework for Sequential Planning in Multiagent Settings", in AI and Math Symposium, 2004 [paper]

Exact and Approximate Solution Methods:

  • Prashant Doshi, "Compact Approximations of Mixture Distributions for State Estimation in Multiagent Settings", poster paper in AAMAS, 2009 [paper] [poster]
  • Prashant Doshi and Dennis Perez, "Generalized Point Based Value Iteration for Interactive POMDPs", in AAAI, 2008 [paper] [talk]
    • Dennis D. Perez and Prashant Doshi, "Approximate Solutions to Interactive POMDPs Using Point Based Value Iteration", in AI and Math Symposium (ISAIM), 2008 [paper]
  • Prashant Doshi, "Improved State Estimation in Multiagent Settings with Continuous or Large Discrete State Spaces", in AAAI, 2007 [paper] [talk]
    • Prashant Doshi, "Approximate State Estimation in Multiagent Settings with Continuous or Large Discrete State Spaces", poster paper, in AAMAS, 2007
    • Prashant Doshi, "Approximate State Estimation in Multiagent Settings with Continuous or Large Discrete State Spaces", in MSDM Workshop, 2007 [paper]
  • B. Rathnasabapathy, Prashant Doshi, and Piotr Gmytrasiewicz, "Exact Solutions for Interactive POMDPs Using Behavioral Equivalence", in AAMAS, 2006 [paper] [talk]
  • Prashant Doshi and Piotr Gmytrasiewicz, "Monte Carlo Sampling Methods For Approximating Interactive POMDPs", in Journal of AI Research (JAIR), Vol. 34: 297-337, 2009 [article]
    • Prashant Doshi and Piotr Gmytrasiewicz, "A Particle Filtering Based Approach to Approximating Interactive POMDPs", in AAAI, 2005 [paper]
      • Prashant Doshi and Piotr Gmytrasiewicz, "A Method for Approximating Interactive POMDPs Using Particle Filters", in GTDT Workshop, 2005
    • Prashant Doshi and Piotr Gmytrasiewicz, "Approximating State Estimation in Multiagent Settings Using Particle Filters", in AAMAS, 2005 [paper]
      • Prashant Doshi and Piotr Gmytrasiewicz, "A Particle Filtering Algorithm for Interactive POMDPs", in MOO Workshop, 2004 [paper]

Interactive Influence Diagrams:

  • Yifeng Zeng and Prashant Doshi, "Speeding Up Exact Solutions of Interactive Dynamic Influence Diagrams Using Action Equivalence", in IJCAI, 2009 [paper] [talk]
  • Prashant Doshi and Yifeng Zeng, "Improved Approximation of Interactive Dynamic Influence Diagrams Using Discriminative Model Updates", in AAMAS, 2009 [paper] [talk] [poster]
  • Yifeng Zeng and Prashant Doshi, "Model Identification in Interactive Influence Diagrams Using Mutual Information", in Journal of Web Intelligence and Agent Systems (WIAS), IOS Press, to appear in 2010.
    • Yifeng Zeng and Prashant Doshi, "An Information-theoretic Approach to Model Identification in Interactive Influence Diagrams", in IEEE/WIC/ACM IAT, 2008 [paper] [talk]
      • Yifeng Zeng and Prashant Doshi, "Toward Robust Model Identification in Interactive Influence Diagrams Using Mutual Information", in MSDM Workshop, AAMAS, 2008 [paper] [talk]
  • Prashant Doshi and Yifeng Zeng, "Graphical Models for Interactive POMDPs: Representations and Solutions", in Journal of Autonomous Agents and Multiagent Systems (JAAMAS), 18(3):376-416, 2009 [article]
    • Yifeng Zeng, Prashant Doshi, and Qiongyu Chen, "Approximate Solutions to Dynamic Interactive Influence Diagrams Using Model Clustering", in AAAI, 2007 [paper] [talk]
    • Prashant Doshi, Yifeng Zeng, and Qiongyu Chen, "Graphical Models for Online Solutions to Interactive POMDPs", in AAMAS, 2007 [paper] [talk]
      • Prashant Doshi, Yifeng Zeng, and Qiongyu Chen, "Graphical Models for Online Solutions to Interactive POMDPs", in AAAI Spring Symposium on GTDT Agents, 2007

Theses:

  • Dennis Perez, "Anytime Point-Based Approximations for Interactive POMDPs", M.S. Thesis, University of Georgia, 2007 [thesis in pdf]
  • Prashant Doshi, "Optimal Sequential Planning in Partially Observable Multiagent Settings", Ph.D. Thesis, University of Illinois at Chicago, 2005 [thesis in pdf] [thesis in ps] [talk]