Preprints

  1. P. Marbach and Ying Qiu, " Cooperation in Wireless Ad Hoc Networks: A Market-Based Approach,"(Gzipped Postscript), submitted.


Journal Papers

  1. P. Marbach, " Analysis of a Static Pricing Scheme for Priority Services,"(Gzipped Postscript), to appear in IEEE/ACM Transactions on Networking.

  2. P. Marbach, " Priority Service and Max-Min Fairness,"(Gzipped Postscript), to appear in IEEE/ACM Transactions on Networking.

  3. P. Marbach and J. N. Tsitsiklis, "Approximate Gradient Methods in Policy-Space Optimization of Markov Reward Processes,"(Gzipped Postscript), Journal of Discrete Event Dynamical Systems, Vol. 13, pp. 111-148, 2003.

  4. P. Marbach, "Differentiated Services Networks: Pricing and Software Agents,"(Gzipped Postscript), Int. Journal of Parallel and Distributed Systems and Networks - Special Issue on the Application of Intelligent Control and Optimization to Communications Systems and Networks, Vol. 4, No. 4, 2001.

  5. P. Marbach and J. N. Tsitsiklis, "Simulation-Based Optimization of Markov Reward Processes,"(Gzipped Postscript), IEEE Transactions on Automatic Control, Vol. 46, No. 2, pp. 191-209, February 2001.

  6. P. Marbach, O. Mihatsch, and J. N. Tsitsiklis, "Call Admission Control and Routing in Integrated Service Networks Using Neuro-Dynamic Programming,"(Gzipped Postscript), IEEE Journal on Selected Areas in Communications, Vol. 18, No. 2, February 2000, pp. 197-208.


Conference Papers

  1. C. Yuen and P. Marbach, " End-to-End Rate Control for Networks with Random Access Links,"(Gzipped Postscript), IEEE CCECE, Niagra Falls, April 2004.

  2. X. Wu and P. Marbach, " Pricing and Rate Control in a Non-Cooperative Environment,"(Gzipped Postscript), IEEE Conference on Decision and Control, 2003.

  3. C. Yuen and P. Marbach, " Rate Control and Slotted Aloha,"(Gzipped Postscript), 41th Annual Allerton Conference on Communication, Control, and Computing, Monticello, IL, October 2003.

  4. Y. Qiu and P. Marbach, " Bandwith Allocation in Ad-Hoc Networks: A Price-Based Approach,"(Gzipped Postscript), INFOCOM, 2003.

  5. P. Marbach and Randall Berry, " Downlink Resource Allocation and Pricing for Wireless Networks,"(Gzipped Postscript), INFOCOM, 2002.

  6. P. Marbach, " Priority Service and Max-Min Fairness,"(Gzipped Postscript), INFOCOM, 2002.

  7. P. Marbach, " Pricing Differentiated Services Networks: Bursty Traffic,"(Gzipped Postscript), INFOCOM, 2001.

  8. P. Marbach and J. N. Tsitsiklis, "Simulation-Based Optimization of Markov Reward Processes: Implementation Issues,"(Gzipped Postscript), IEEE Conference on Decision and Control, 1999.

  9. P. Marbach, "Pricing Priority Classes in Differentiated Services Networks,"(Gzipped Postscript), 37th Annual Allerton Conference on Communication, Control, and Computing, Monticello, IL, September 1999.

  10. P. Marbach, O. Mihatsch, and J. N. Tsitsiklis, "Reinforcement Learning for Call Admission Control and Routing in Integrated Service Networks"(Gzipped Postscript),IEEE Conference on Decision and Control, 1998.

  11. P. Marbach and J. N. Tsitsiklis, "Simulation-Based Optimization of Markov Reward Processes,"(Gzipped Postscript), IEEE Conference on Decision and Control, 1998.

  12. P. Marbach, O. Mihatsch, M. Schulte and J. N. Tsitsiklis, "Reinforcement Learning for Call Admission Control and Routing in Integrated Service Networks"(Gzipped Postscript), Advances in Neural Information Processing Systems, 1998.

  13. P. Marbach and J. N. Tsitsiklis, "A Neuro-Dynamic Approach to the Admission Control in ATM Networks: The Single Single Link Case"(Gzipped Postscript), ICASSP, 1997.


Technical Reports

  1. C. Yuen and P. Marbach, "Service Differentiation in Random Access Networks," Technical Report, CSRG-472, Computer System Research Group, Department of Computer Science, University of Toronto, July 2003.

  2. P. Marbach, "Simulation-Based Optimization of Markov Decision Processes,"(Gzipped Postscript) Ph.D. Thesis, Department of EECS, MIT, September 1998, Technical Report LIDS-TH-2429, Laboratory for Information and Decision Systems.

  3. P. Marbach, and J.N. Tsitsiklis, "A Neuro-Dynamic Programming Approach to Call Admission Control in Integrated Service Networks: The Single Link Case,"(Gzipped Postscript) Technical Report LIDS-P-2402, Laboratory for Information and Decision Systems, M.I.T., November 1997.