List of Publications

2017

D. Bahdanau, P. Brakel, K. Xu, A. Goyal, R. Lowe, J. Pineau, A. Courville, Y. Bengio. ``An Actor-Critic Algorithm for Sequence Prediction". International Conference on Learning Representations (ICLR). 2017.
[paper].

I.V. Serban, A. Sordoni, R. Lowe, L. Charlin, J. Pineau, A. Courville, Y. Bengio.``A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues". American Association for Artificial Intelligence (AAAI). 2017.
[paper]. [code]

R. Lowe, N. Pow, I.V. Serban, L. Charlin, C.W. Liu, J. Pineau. ``Training End-to-End Dialogue Systems with the Ubuntu Dialogue Corpus." Dialogue & Discourse. 8(1), 31-65. 2017.
[paper].

M. Smith, L. Charlin, J. Pineau. ``A Sparse Probabalistic Model of User Preference Data". Canadian AI 2017.
[paper]

A. Emami, J. El Youssef, R. Rabasa-Lhoret, J. Pineau, J. Castle, A. Haidar. ``Modelling glucagon action in patients with type 1 diabetes". IEEE Journal of Biomedial and Health Informatics. 99. 2017.
[paper].

Hebert, A.-M., Kairy, D. & Pineau, J. ``Vers l'evaluation de l'experience utilisateur et la co-experience d'un fauteuil roulant motorise intelligent : une perspective macroscopique des experiences impliquees." Conference Handicap 2016.

W. Choi, O. Cyens, T. Chan, M. Schijven, S. Lajoie, M.E. Mancini, P. Dev, L. Fellander-Tsai, M. Ferland, P. Kato, J. Lau, M. Montonaro, J. Pineau, R. Aggarwal. ``Engagement and Learning in Simulation: Recommendations of the Simnovate Engaged Learning Domain Group". BMJ Simulation & Technology Enhanced Learning. 2017; 0:1-10. doi:10.1136/bmjstel-2016-000177.

2016

P. Thodoroff, J. Pineau, A. Lim. ``Learning robust features using deep learning for automatic seizure detection". Machine Learning and Healtcare Conference (MLHC) 2016.
[paper]

C.W. Liu, R. Lowe, I.V. Serban, N. Noseworthy, L. Charlin, J. Pineau. ``How NOT to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation". EMNLP. 2016.
[paper]

R. Lowe, I.V. Serban, M. Noseworthy, L. Charlin, J. Pineau. "On the Evaluation of Dialogue Systems with Next Utterance Classification". Annual Meeting on Discourse and Dialogue (SIGdial). 2016.
[paper]

B. Wang, J. Pineau. "Online Bagging and Boosting for Imbalanced Data Streams". IEEE Transactions on Knowledge and Data Engineering. 2016.
[paper]

A. Emami, J. El Youssef, R. Rabasa-Lhoret, J. Pineau, J. Castle, A. Haidar. "Modelling Glucagon Action in Patients with Type 1 Diabetes". IEEE Journal of Biomedical and Health Informatics. 2016.
[paper]

A.M.S. Barreto, D. Precup, J. Pineau. "Practical Kernel-Based Reinforcement Learning". Journal of Machine Learning Research. 17(67):1:70. 2016.
[paper]

B. Wang, J. Pineau. "Generalized Dictionary for Multitask Learning with Boosting". International Joint Conference on Artificial Intelligence (IJCAI). 2016.


C. Zhou, B.B. Balle, J. Pineau. "Learning Time Series Models for Pedestrian Motion Prediction". International Conference on Robotics and Automation (ICRA). 2016.
[paper], [code].

I.V. Serban, A. Sordoni, Y. Bengio, A. Courville, J. Pineau. "Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models". American Association for Artificial Intelligence (AAAI). 2016. arXiv 1507.04808.
[paper], [code], dataset available upon request.

B. Wang, B.B. Balle, J. Pineau. "Multitask Generalized Eigenvalue Program". American Association for Artificial Intelligence (AAAI). 2016.
[paper].

A.M.S. Barreto, R.L. Beirigo, J. Pineau, D. Precup. "Incremental Stochastic Factorization for On-line Reinforcement Learning". American Association for Artificial Intelligence (AAAI). 2016.
[paper], [code].

S.M. Shortreed, E.B. Laber, J. Pineau, S.A. Murphy. "Imputing Missing Data from Sequential Multiple Assignment Randomized Trials". Book chapter. To appear in Adaptive Treatment Strategies in Practice: Planning Trials and Analyzing Data for Personalized Medicine. M.R. Kosorok and E.E.M. Moodie (eds). 2016.
[code] (including artificial CATIE dataset and code to impute data from the artificial dataset.

R. Vincent, J. Pineau. "Practical reinforcement learning in dynamic treatment regimes". Book chapter. To appear in Adaptive Treatment Strategies in Practice: Planning Trials and Analyzing Data for Personalized Medicine. M.R. Kosorok and E.E.M. Moodie (eds). 2016.
[code].

2015

M. Ghavamzadeh, S. Mannor, J. Pineau, A. Tamar. "Bayesian Reinforcement Learning: A Survey". Foundations and Trends in Machine Learning. Vol. 8: No. 5-6, pp 359-483.
[paper]

R. Lowe, N. Pow, I. Serban, J. Pineau. "The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems". Annual Meeting on Discourse and Dialogue (SIGdial). 2015.
[paper]
[code] (as used in the SIGdial paper)
[Ubuntu Corpus v1.0] (as used in the SIGdial paper)
[Ubuntu Corpus v2.0] (RECOMMENDED, as of January 2016.)

B. Kim, J. Pineau. "Socially Adaptive Path Planning in Dynamic Environments Using Inverse Reinforcement Learning". International Journal of Social Robotics (SORO). 2015.
[paper]

A. Leigh, J. Pineau, N. Olmedo, H. Zhang. "Person Tracking and Following with 2D Laser Scanners". International Conference on Robotics and Automation (ICRA). 2015.
[paper], [code], [datasets]

A. Barreto, R. Beirigo, J. Pineau, D. Precup. "An Expectation-Maximization Algorithm to Compute a Stochastic Factorization". International Joint Conference on Artificial Intelligence (IJCAI). 2015.
[paper]

B. Wang, J. Pineau. "Online Boosting Algorithms for Anytime Transfer and Multitask Learning". American Association for Artificial Intelligence (AAAI). 2015.
[paper], [supplementary material]

H. Ma, J. Pineau. "Information Gathering and Reward Exploitation of Subgoals for POMDPs". American Association for Artificial Intelligence (AAAI). 2015.
[paper]

H.K. Yuen, J. Pineau, P. Archambault. "Automatically characterizing driving activities onboard smart wheelchairs from accelerometer data". IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 2015.
[paper], [code]

P.-L. Bacon, E. Bengio, J. Pineau, D. Precup. "Conditional computation in neural networks using a decision-theoretic approach". Multi-disciplinary Conference on Reinforcement Learning and Decision Making (RLDM). 2015.
[paper]

J. Pineau, P.-L. Bacon. "Analyzing Open Data from the City of Montreal". International Conference on Machine Learning (ICML) Workshop on Mining Urban Data. 2015.
[paper]

2014

B. Balle, W. Hamilton, J. Pineau. "Methods of Moments for Learning Stochastic Languages: Unified Presentation and Empirical Comparison". International Conference on Machine Learning (ICML). 2014.
[paper], [supplementary material], [code]

A.M.S. Barreto, J. Pineau, D. Precup. "Policy Iteration Based on Stochastic Factorization". Journal of Artificial Intelligence Research (JAIR). vol.50, pp.763-803.
[paper]

W. Hamilton, M.M. Fard, J. Pineau. "Efficient Learning and Planning with Compressed Predictive States". Journal of Machine Learning Research (JMLR). 2014.
[paper], [code]

J. Pineau, A.K. Moghaddam, H.K.Yuen, P. Archambault, F. Routhier, F. Michaud, P. Boissy. "Automatic Detection and Classification of Unsafe Events during Power Wheelchair Use". IEEE Journal of Translational Engineering in Health and Medicine (JTEHM). 2014.
[paper]

S.M. Shortreed, E. Laber, T.S. Stroup, J. Pineau, S.A. Murphy. "A multiple imputation strategy for sequential multiple assignment randomized trials". Statistics in Medicine. vol.33(24). pp.4202-4214.
Contact authors for a copy of the paper.
[code] (including artificial CATIE dataset and code to impute data from the artificial dataset.

P. Rushton, D. Kairy, P. Archambault, E. Pituch, C. Torkia, A. El-Fathi, P. Stone, F. Routhier, R. Forget, J. Pineau, R. Gourdeau, L. Demers. "The Potential Impact of Intelligent Power Wheelchair Use on Social Participation: Perspectives of Users, Caregivers, and Clinicians". Disability and Rehabilitation: Assistive Technology. 2014. 7p.
[.pdf]

D. Kairy, P. Rushton, P. Archambault, E. Pituch, C. Torkia, A. El Fathi, P. Stone, F. Routhier, R. Forget, L. Demers, J. Pineau, R. Gourdeau. "Exploring Powered Wheelchair Users and Their Caregivers' Perspectives on Potential Intelligent Power Wheelchair Use: A Qualitative Study". International Journal of Environmental Research and Public Health. 2014. vol.11. pp.2244-2261.
[.pdf]

O. Alsharif, P. Bachman, J. Pineau. "Representation as a Service". arXiv 1401.4108. 2014.
[paper]

A. Barreto, D. Precup, J. Pineau. "Praactical Kernel-Based Reinforcement Learning". arXiv 1407.5358. 2014.
[paper]

2013

• B. Kim, A.M. Farahmand, J. Pineau, D. Precup, "Learning from Limited Demonstrations". Neural Information Processing Systems (NIPS). 2013.
  [.pdf]

• M. M. Fard, Y. Grinberg, A.M. Farahmand, J. Pineau, D. Precup, "Bellman Error Based Feature Generation using Random Projections on Sparse Spaces". Neural Information Processing Systems (NIPS). 2013.
  [.pdf]

• Patrice Boucher, Amin Atrash, Sousso Kelouwani, Wormser Honoré, Hai Nguyen, Julien Villemure, François Routhier, Paul Cohen, Louise Demers, Robert Forget, Joelle Pineau, "Design and validation of an intelligent wheelchair towards a clinically-functional outcome", Journal of NeuroEngineering and Rehabilitation, vol.10:58. pp.1-16. 2013.
  [.pdf]

• G. Panuccio, A. Guez, R. Vincent, M. Avoli, J. Pineau. "Adaptive control of epileptiform excitability in an in vivo model of limbic seizures". Experimental Neurology. 241: 179-83.
  [.pdf (unformatted)]

• J. Frank, S. Mannor, J. Pineau, D. Precup. "Time Series Analysis Using Geometric Template Matching". Transactions on Pattern Matching and Machine Intelligence (PAMI). 35(3): 740-754.
  [Link]

• W. Hamilton, M. M. Fard, J. Pineau "Modelling sparse dynamical systems with compressed predictive state representations". International Conference on Machine Learning (ICML). 2013.
  [.pdf]

• B. Kim, J. Pineau. "Maximum Mean Discrepancy Imitation Learning". Robotics: Science and Systems (RSS). 2013.
  [.pdf]

• S.C.W. Ong, Y. Grinberg, J. Pineau. "Mixed Observability Predictive State Representations". AAAI Conference on Artificial Intelligence. 2013.
  [.pdf]

  O. Alsharif, J. Pineau. "End-to-End Text Recognition with Hybrid HMM Maxout Models". arXiv 1310.1811. 2013.
  [paper]

  B. Wang, J. Pineau. "Online Ensemble Learnig for Imbalanced Data Streams". arXiv 1310.8004. 2013.
  [paper]

• C. Paduraru, D. Precup, J. Pineau, G. Comanici. "An empirical analysis of off-policy learning in discrete MDPs.". JMLR: Workshop and Conference Proceedings. 10th European Workshop on Reinforcement Learning. vol.24. pp.89-101.
  [.pdf]

• D. Kairy, P. Archambault, P.W. Rushton, E. Pituch, A. El Fathi, C. Torkia, P. Stone, F. Routhier, R. Forget, L. Demers, J. Pineau, R. Gourdeau. "Users' Perspectives of Intelligent Power Wheelchair Use". RESNA Annual Conference. 2013.
  

2012

• A.M.S. Barreto, D. Precup, J. Pineau. "On-line reinforcement learning using incremental kernal-based stochastic factorization". Neural Information Processing Systems (NIPS). 2012.
  [.pdf] (main paper)
  [.pdf] (supplemental material)

• S. Png, J. Pineau, B. Chaib-draa. "Buildling adaptive dialogue systems via Bayes-adaptive POMDP". IEEE Journal of Selected Topics in Signal Processing. vol.6(8). 2012.
  [.pdf]

• G. Shani, J. Pineau, R. Kaplow. "A survey of point-based POMDP solvers". Autonomous Agents and Multi-Agent Systems. 2012.
  [.pdf]

• K. Bush, G. Panuccio, M. Avoli, J. Pineau. "Evidence-based modeling of network discharge dynamics during periodic pacing to control epileptiform activity". Journal of Neuroscience Methods. 2012. vol.204. pp.318-325.
  [.pdf]

• F. Doshi-Velez, J. Pineau, N. Roy. "Reinforcement learning with limited reinforcement: Using Bayes risk for active learning in POMDPs". Artifical Intelligence. vol.187-188. August 2012. pp.115-132.
  [.pdf]

• M. M. Fard, Y. Grinberg, J. Pineau, D. Precup, "Compressed Least-Squares Regression on Sparse Spaces", Twenty-Sixth AAAI Conference on Artificial Intelligence (AAAI'12). 2012.
  [.pdf]

• M. M. Fard, Y. Grinberg, J. Pineau, D. Precup. "Random Projections Preserve Linearity in Sparse Spaces. Technical Report. 2012. (Companion to our AAAI'12 paper.)
  [.pdf]

• E. Tsang, S. C. W. Ong, J. Pineau. "Design and Evaluation of a Flexible Interface for Spatial Navigation". Canadian Conference on Computer and Robot Vision. 2012.
  [.pdf]

• C. Paduraru, D. Precup, J. Pineau, G. Comanici. "A Study of Off-policy Learning in Computational Sustainabiity". European Workshop on Reinforcement Learning (EWRL). 2012.
  [.pdf]

• M. M. Fard, Y. Grinberg, J. Pineau, D. Precup. "Bellman Error Based Feature Generation Using Random Projections". European Workshop on Reinforcement Learning (EWRL). 2012.
  [.pdf]

2011

• A. M. S. Barreto, D. Precup, J. Pineau. "Reinforcement Learning using Kernel-Based Stochastic Factorization". Neural Information Processing Systems (NIPS-24). 2011.
  [.pdf]

• S. Ross, J. Pineau, B. Chaib-draa, P. Kreitmann. "A Bayesian Approach for Learning and Planning in Partially Observable Markov Decision Processes". Journal of Machine Learning. 12. pp.1655-1696. 2011.
  [.pdf]

• M. M. Fard, J. Pineau. "Non-Deterministic Policies in Markovian Decision Processes". Journal of Artificial Intelligence Research (JAIR). 40. pp.1-24. 2011.
  [.pdf]

• S. M. Shortreed, E. Laber, D. J. Lizotte, S. Stroup, J. Pineau, S. Murphy. "Informing sequential clinical decision-making through reinforcement learning: an empirical study". Machine Learning. 84(1). pp.109-136. 2011.
  [Link] (Or email me for a copy.)

• J. Pineau, R. West, A. Atrash, J. Villemure, F. Routhier. "On the Feasibility of Using a Standardized Test for Evaluating a Speech-Controlled Smart Wheelchair". International Journal of Intelligent Control and Systems. 16(2). pp.121-128. 2011.
  [.pdf]

• R.D. Vincent, A. Courville, J. Pineau. "A bistable computational model of recurring epileptiform activity as observed in rodent slice preparation". Neural Networks. 24(6) pp.526-537. 2011.
  [paper], [code for the model]

• M. Fard, J. Pineau, C. Szepesvari. "PAC-Bayesian Policy Evaluation for Reinforcement Learning". Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI). 2011.
  [.pdf]

• K. Deng, J. Pineau and S.A. Murphy. "Active Learning for Developing Personalizing Treatment". Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI). 2011.
  [.pdf]

• S. Png, J. Pineau. "Bayesian Reinforcement Learning for POMDP-based dialogue systems". International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2011.
  [.pdf]

• A. K. Moghaddam, J. Pineau, J. Frank, P. S. Archambault, F. Routhier, T. Audet, J. Polgar, F. Michaud, P. Boissy. "Mobility Profile and Wheelchair Driving Skills of Powered Wheelchair Users: Sensor-Based Event Recognition Using a Support Vector Machine Classifier". 33rd Annual International IEEE EMBS Conference. 2011.
  [.pdf]

• S.C.W. Ong, Y. Grinberg, J. Pineau. "Goal-directed online learning of predictive models". European Workshop on Reinforcement Learning (EWRL). LNCS. Springer. 2011.
  

• C. Paduraru, D. Precup, J. Pineau. "A framework for computing bounds for the return of a policy". European Workshop on Reinforcement Learning (EWRL). LNCS. Springer. 2011.
  

• K. Deng, J. Pineau, S. Murphy. "Active Learning for Personalizing Treatment". IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL). 2011.
  [.pdf]

• Y. Grinberg, M. M. Fard, J. Pineau, "Least-Squares Regression on Sparse Spaces", NIPS Workshop on Sparse Representation and Low-rank Approximation (NIPS'11). 2011.
  [.pdf]

• Y. Grinberg, M. M. Fard, J. Pineau, "LSTD on Sparse Spaces", NIPS Workshop on New Frontiers in Model Order Selection (NIPS'11). 2011.
  [.pdf]

2010

• M. M. Fard, J. Pineau. "PAC-Bayesian Model Selection for Reinforcement Learning". Neural Information Processing Systems (NIPS-23). 2010.
  [.pdf]

• R. West, D. Precup, J. Pineau. "Automatically Suggesting Topics for Augmenting Text Documents". The 19th ACM Conference on Information and Knowledge Management (CIKM). 2010.
  [.pdf]

• W. Honore, A. Atrash, P. Boucher, R. Kaplow, S. Kelouwani, H. Nguyen, J. Villemure, R. West, F. Routhier, P. Stone, C. Dufour, J.-P. Dussault, D. Rock, P. Cohen, L. Demers, R. Forget, J. Pineau. "Human-Oriented Design and Initial Validation of an Intelligent Powered Wheelchair". RESNA Annual Conference. 2010.
  [.pdf] [.html]

• A. Guez, J. Pineau. "Multi-Tasking SLAM". International Conference on Robotics and Automation (ICRA). 2010.
  [.pdf]

• R. Kaplow, A. Atrash, J. Pineau. "Variable Resolution Decomposition For Robotic Navigation Under a POMDP Framework". International Conference on Robotics and Automation (ICRA). 2010.
  [.pdf]

• J. Pineau, R. West, A. Atrash, J. Villemure, F. Routhier. "Towards a Standardized Test for Intelligent Wheelchairs". Performance Metrics for Intelligent Systems (PerMIS). 2010.
  [.pdf]

• J. Pineau, A. Atrash, R. Kaplow, J. Villemure. "On the design and validation of an intelligent powered wheelchair: Lessons from the SmartWheeler project". CIM Symposium on Brain, Body and Machine. 2010.
  [.pdf]

2009

• A. Atrash, R. Kaplow, J. Villemure, R. West, H. Yamani, J. Pineau. "Development and Validation of a Robust Interface for Improved Human-Robot Interaction". International Journal of Social Robotics. 2009.
  [.pdf]

• J. Pineau, A. Guez, R. Vincent, G. Panuccio, M. Avoli. "Treating epilepsy via adaptive neurostimulation: A reinforcement learning approach". International Journal of Neural Systems. 19(4). pp.227-240. 2009.
  (Email me for a copy.)

• K. Bush, J. Pineau. "Manifold Embeddings for Model-Based Reinforcement Learning under Partial Observability". Neural Information Processing Systems (NIPS-22). 2009.
  [.pdf]

• R. West, D. Precup, J. Pineau. "Completing Wikipedia's Hyperlink Structure through Dimensionality Reduction". The 18th ACM Conference on Information and Knowledge Management (CIKM). 2009.
  [.pdf]

• R. West, J. Pineau and D. Precup. "Wikispeedia: An Online Game for Inferring Semantic Distances between Concepts". International Joint Conferences on Artificial Intelligence (IJCAI). 2009.
  [.pdf]

• A. Atrash and J. Pineau. "A Bayesian Reinforcement Learning Approach for Customizing Human-Robot Interfaces". International Conference on Intelligent User Interfaces (IUI). 2009.
  [.pdf]

• K. Bush, J. Pineau & M. Avoli. "Manifold Embeddings for Model-Based Reinforcement Learning of Neurostimulation Policies". ICML/UAI/COLT Workshop on Abstraction in Reinforcement Learning. 2009.
  [.pdf]

2008

• S. Ross, J. Pineau, S. Paquet, B. Chaib-draa. "Online Planning Algorithms for POMDPs". Journal of Artificial Intelligence Research (JAIR). 32. pp.663-704. 2008.
  [.pdf]

• M. M. Fard and J. Pineau. "MDPs with Non-Deterministic Policies". Neural Information Processing Systems (NIPS-21). 2008.
  [.pdf]

• S. Ross & J. Pineau. "Model-Based Bayesian Reinforcement Learning in Large Structured Domains". Uncertainty in Artificial Intelligence (UAI). 2008.
  [.pdf]

• M. M. Fard, J. Pineau and P. Sun. "A Variance Analysis for POMDP Policy Evaluation". AAAI Conference on Artificial Intelligence. 2008.
  [.pdf]

• A. Guez, R. Vincent, M. Avoli, & J. Pineau. "Adaptive Treatment of Epilepsy via Batch-mode Reinforcement Learning". Innovative Applications of Artificial Intelligence (IAAI). 2008.
  [.pdf]

• F. Doshi, J. Pineau and N. Roy. "Reinforcement Learning with Limited Reinforcement: Using Bayes Risk for Active Learning in POMDPs". International Conference on Machine Learning (ICML). 2008.
  [.pdf]

• S. Ross, B. Chaib-draa, & J. Pineau. "Bayesian Reinforcement Learning in Continuous POMDPs with Application to Robot Navigation". International Conference on Robotics and Automation (ICRA). 2008.
  [.pdf]

2007

• J. Pineau, M.G. Bellemare, A.J. Rush, A. Ghizaru, & S.A. Murphy. "Constructing evidence-based treatment strategies using methods from computer science." Drug and Alcohol Dependence. 88S Elsevier. p.S52-S60. 2007. (Email me for a copy.)

• R. Jaulmes, J. Pineau & D. Precup. "Apprentissage actif dans les Processus Decisionnels de Markov Partiellement Observables''. Revue d'Intelligence Artificielle. 2(1). pp.9-34. 2007.
  [.pdf]

• S. Ross, B. Chaib-draa, & J. Pineau. "Bayes-Adaptive POMDPs". Neural Information Processing Systems (NIPS-20). 2007.
  [.pdf]
  Tech report version with the proofs:
  [.pdf]

• S. Ross, J. Pineau & B. Chaib-draa. "Theoretical Analysis of Heuristic Search Methods for Online POMDPs". Neural Information Processing Systems (NIPS-20). 2007.
  [.pdf]

• R. Jaulmes, J. Pineau & D. Precup. "A formal framework for robot learning and control under model uncertainty." IEEE International Conference on Robotics and Automation (ICRA). 2007.
  [.pdf]

• R. Vincent, J. Pineau, P. de Guzman & M. Avoli. "Recurrent Boosting for Classification of Natural and Synthetic Time-Series Data". Canadian Conference on Artificial Intelligence (CanAI). pp.192-293. 2007.
  [.pdf]

• J. Pineau & A. Atrash for the SmartWheeler team. "SmartWheeler: A robotic wheelchair test-bed for investigating new models of human-robot interaction." AAAI Spring Symposium on Multidisciplinary Collaboration for Socially Assistive Robotics. 2007.
  [.pdf]

2006

• J. Pineau, G. Gordon & S. Thrun. "Anytime point-based approximations for large POMDPs." Journal of Artificial Intelligence Research (JAIR). 27. pp.335-380. 2006.
  [.pdf]

• R. Gavalda, P.W. Keller, J. Pineau and D. Precup. "PAC-Learning of Markov Models with Hidden State". European Conference on Machine Learning (ECML). 2006.
  [.pdf]

• C. Hundt, P. Panangaden, J. Pineau & D. Precup "Representing systems with hidden state''. National Conference of Artificial Intelligence (AAAI). 2006.
  [.pdf]

• D. Burfoot, J. Pineau & D. Dudek "RRT-Plan: a Randomized Algorithm for STRIPS Planning''. International Conference on Automated Planning and Scheduling (ICAPS). 2006.
  [.pdf]

• A. Atrash & J. Pineau "Efficient Planning and Tracking in POMDPs with Large Observation Spaces". AAAI-06 Workshop on Empirical and Statistical Approaches for Spoken Dialogue Systems. 2006.
  [.pdf]

• R. Vincent, J. Pineau, P. de Guzman, & M. Avoli "Recurrent Boosting Method for Time-Dependent Classification of Epileptiform Signals". North Easth Student Colloquium on Artificial Intelligence (NESCAI). 2006
  [.pdf]

2005

• J. Pineau & G. Gordon "POMDP Planning for Robust Robot Control''. International Symposium on Robotics Research (ISRR) San Francisco, CA. 2005.
  [.pdf]

• R. Jaulmes, J. Pineau & D. Precup "Active Learning in Partially Observable Markov Decision Processes". European Conference on Machine Learning (ECML). Porto, Portugal. 2005.
  [.pdf]

• R. Jaulmes, J. Pineau & D. Precup "Active Learning in Partially Observable Markov Decision Processes". NIPS Workshop on Value of Information in Inference, Learning and Decision-Making. Whistler, Canada. 2005
  [.pdf]

• R. Jaulmes, J. Pineau & D. Precup "Probabilistic Robot Planning Under Model Uncertainty: An Active Learning Approach". NIPS Workshop on Machine Learning Based Robotics in Unstructured Environments. Whistler, Canada. 2005
  [.pdf]

• R. Jaulmes, J. Pineau & D. Precup "Learning in Non-Stationary Partially Observable Markov Decision Processes". ECML Workshop on Reinforcement Learning in Non-Stationary Environments. Porto, Portugal. 2005.
  [.pdf]

2004

• J. Pineau, G. Gordon & S. Thrun "Applying Metric-Trees to Belief-Point POMDPs''. Neural Information Processing Systems (NIPS-16). Vancouver, Canada. 2004.
  [.pdf]

2003

• J. Pineau, M. Montemerlo, M. Pollack, N. Roy, & S. Thrun "Towards robotic assistants in nursing homes: Challenges and results''. Special issue on Socially Interactive Robots, Robotics and Autonomous Systems 42 (3-4). pp.271-281. 2003.
  [.pdf]

• J. Pineau, G. Gordon & S. Thrun "Point-based value iteration: An anytime algorithm for POMDPs''. International Joint Conference on Artificial Intelligence (IJCAI). Acapulco, Mexico. pp. 1025-1032. Aug. 2003.
  [.pdf]

• J. Pineau, G. Gordon & S. Thrun. "Policy-contingent abstraction for robust robot control''. Conference on Uncertainty in Articifical Intelligence (UAI). Acapulco, Mexico. pp. 477-484. Aug. 2003.
  [.pdf]

2002

• M. Montemerlo, J. Pineau, N. Roy, S. Thrun & V. Verma "Experiences with a Mobile Robotic Guide for the Elderly''. National Conference on Artificial Intelligence (AAAI). Edmonton, AB. pp. 587-592. Aug. 2002.
  [.pdf]

• J. Pineau, M. Montemerlo, M. Pollack, N. Roy & S. Thrun. "Probabilistic control of human robot interaction: Experiments with a robotic assistant for Nursing Homes''. The second IARP/IEEE/RAS Joint Workshop on Technical Challenges for Robots in Human Environments (DRHE). Toulouse, France. Oct. 2002.
  [.pdf]

• J. Pineau, & S. Thrun. "High-level robot behaviour control with POMDPs''. AAAI Workshop on Cognitive Robotics. Edmonton, Canada. Aug. 2002.
  [.pdf]

• M. Pollack, S. Engberg, J.T. Matthews, S. Thrun, L. Brown, D. Colbry, C. Orosz, B. Peintner, S. Ramakrishnan, J. Dunbar-Jacob, C. McCarthy, M. Montemerlo, J. Pineau, & N. Roy. "Pearl: A Mobile Robotic Assistant for the Elderly''. Workshop on Automation as Caregiver: the Role of Intelligent Technology in Elder Care (AAAI). Edmonton, AB. Aug. 2002.
  

2001

• J. Pineau, N. Roy & S. Thrun. "A Hierarchical Approach to POMDP Planning and Execution''. ICML Workshop on Hierarchy and Memory in Reinforcement Learning. Williams College, MA. June 2001. June 2001.
  [.pdf]

• N. Roy, G. Baltus, D. Fox, F. Gemperle, J. Goetz, T. Hirsch, D. Margaritis, M. Montemerlo, J. Pineau, J. Schulte & S. Thrun. "Towards Personal Service Robots for the Elderly''. Workshop on Interactive Robots and Entertainment (WIRE). Pittsburgh, PA. 2000.
  [.pdf]

2000

• N. Roy, J. Pineau & S. Thrun. "Spoken Dialog Management Using Probabilistic Reasoning''. Association for Computational Linguistics (ACL). Hong Kong, Oct. 2000.
  [.pdf]

• D. Goddeau & J. Pineau "Fast Reinforcement Learning of Dialog Strategies''. IEEE Conference on Acoustics, Speech and Signal Processing (ICASSP). Istanbul, Turkey. June 2000.
  [.pdf]

Book chapters

• N. Roy & J. Pineau "Robotics and Independence for the Elderly''. In Growing Old in a Technological Society. G. Lesnoff-Caravaglia (Ed.) C. Thomas of Springfield. Illinois, USA. pp.209-242. 2007.

Edited volumes

• N. Vlassis, G. Gordon, & J. Pineau, editors. "Reasoning with Uncertainty in Robotics". Proceedings from the IJCAI-05 Workshop on Reasoning with Uncertainty in Robotics (RUR-05). International Joint Conference on Artificial Intelligence. Edinburgh, Scotland. 2005
  [.pdf]

Technical Reports

• S. Ross, B. Chaib-draa, & J. Pineau. "Bayes-Adaptive POMDPs". SOCS-TR-2007. School of Computer Science. McGill University. 2007. (NOTE: This is a long version of the identically-titled NIPS paper above. It includes proofs for the lemmas and theorems presented in the paper.)
  [.pdf]

• D. Burfoot, J. Pineau & D. Dudek "RRT-Plan: a Randomized Algorithm for STRIPS Planning''. CIM-TR-2006. McGill University, Center for Intelligent Machines.2006. (NOTE: This is a long version of the identically-titled ICAPS paper above.)
  [.pdf]

• J. Pineau, G. Gordon & S. Thrun. "Point-based approximations for fast POMDP solving". SOCS-TR-2005.4. McGill University. School of Computer Science. 2005.
  [.pdf]

• J. Pineau & S. Thrun. "An integrated approach to hierarchy and abstraction for POMDPs". CMU-RI-TR-02-21. Carnegie Mellon University. Robotics Institute. 2002.
  [.pdf]

Thesis

• J. Pineau. "Tractable Planning Under Uncertainty: Exploiting Structure''. PhD Thesis. August 2004.
  [.pdf]