{"id":65,"date":"2021-04-15T15:09:39","date_gmt":"2021-04-15T15:09:39","guid":{"rendered":"https:\/\/meyn.ece.ufl.edu\/?page_id=65"},"modified":"2026-04-13T13:36:26","modified_gmt":"2026-04-13T18:36:26","slug":"archive","status":"publish","type":"page","link":"https:\/\/faculty.eng.ufl.edu\/meyn\/archive\/","title":{"rendered":"Publication and Document Archive"},"content":{"rendered":"<h2>Bib Files<\/h2>\n<p><a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/strings.bib\"><strong>strings.bib<\/strong><\/a> | <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/markov.bib\"><strong>markov.bib<\/strong><\/a> | <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/q.bib\"><strong>q.bib<\/strong><\/a><\/p>\n<hr \/>\n<table>\n<tbody>\n<tr>\n<td><a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/CTCN\/CTCN.html\"><b>Control Techniques for Complex Networks<\/b><\/a>Appendix is an expanded <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/CTCN\/MonographTocBib.pdf\"><i>Crash Course on Markov Chains &amp; Stochastic Stability<\/i><\/a><br \/>\n<a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/meyn93crash.pdf\">Here is the original <i>crash course<\/i><\/a><\/p>\n<p>G. Wang, M. Negrete-Pincetic, A. Kowli, E. Shafieepoorfard, S. Meyn and U. Shanbhag. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/MarketsIFAC2011\/MarketsIFAC2011.html\">Dynamic Competitive Equilibria in Electricity Markets<\/a><\/p>\n<p>G. Wang, M. Negrete-Pincetic, A. Kowli, E. Shafieepoorfard, and S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Entropic%20Prices\/EntropicPrices.html\">Real-Time Prices in an Entropic Grid<\/a><\/p>\n<p>G. Wang, A. Kowli, M. Negrete-Pincetic, E. Shafieepoorfard, S. Meyn and U. Shanbhag. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/MarketsIFAC2011\/MarketsIFAC2011.html\">A Control Theorist&#8217;s Perspective on Dynamic Competitive Equilibria in Electricity Markets<\/a><\/p>\n<p>S. Meyn, M. Negrete-Pincetic, G. Wang, A. Kowli, and E. Shafieepoorfard. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/wind2010\/Wind10.html\">The Value of Volatile Resources in Electricity Markets<\/a><span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>G. Wang, U. V. Shanbhag, T. Zheng, E. Litvinov, and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Pivot\/PivotConvexHull_PES2011.html\">A Pivot-Based Global Optimization Technique for Convex Hull Pricing<\/a><\/p>\n<p>T. Yang, P. G. Mehta, S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Feedback%20Filter%202011\/FPF2011.html\">Feedback Particle Filter with Mean-field Coupling<\/a><\/p>\n<p>S. Meyn and A. Surana. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/TD%20with%20Exploration\/TD2011.html\">TD-Learning with Exploration<\/a><\/p>\n<p>P. G. Mehta and S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Q2009\/Q09.html\"><i>Q<\/i>-learning and Pontryagin&#8217;s Minimum Principle<\/a> (convergence recently resolved using D. Shirodkar and S. Meyn, <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Q2009\/Q09.html\"><i>Quasi Stochastic Approximation<\/i><\/a>)<\/p>\n<p>S. Meyn, W. Chen, and D. O&#8217;Neill. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/TD_Crosslayer\/TDX.html\">Optimal Cross-layer Wireless Control Policies using TD-Learning<\/a><\/p>\n<p>W. Chen, D. Huang, A. Kulkarni, J. Unnikrishnan, Q. Zhu, P. Mehta, S. Meyn, and A. Wierman. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/TD5552009\/TD555.html\">Approximate Dynamic Programming using Fluid and Diffusion Approximations with Applications to Power Management<\/a><\/p>\n<p>H. Yin, P. G. Mehta, S. Meyn and U. V. Shanbhag. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/OscillatorGame\/OscillatorGame.html\">Synchronization of Coupled Oscillators is a Game<\/a><\/p>\n<p>D. Huang and S. Meyn. <a href=\"http:\/\/arxiv.org\/abs\/1001.3090\">Feature Extraction for Universal Hypothesis Testing via Rank-constrained Optimization<\/a><\/p>\n<p>R. Tomastik, S. Narayanan, A. Banaszuk, and S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/PED08\/PED.html\">Model-based Real-Time Estimation of Building Occupancy During Emergency Egress<\/a>.<\/p>\n<p>S. Meyn, A. Surana, Y. Lin, S. M. Oggianu, S. Narayanan, and T. A. Frewen. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/PED08\/PED.html\">A Sensor-Utility-Network Method for Estimation of Occupancy Distribution in Buildings<\/a><\/p>\n<p>K. Deng, P.G. Mehta, and S.P. Meyn, <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/PhaseTransitions\/PhaseTransitions.html\">An Information-Theoretic Framework to Aggregate a Markov Chain<span class=\"Apple-converted-space\">\u00a0<\/span><\/a><\/p>\n<p>K. Deng, P.G. Mehta, and S.P. Meyn, <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/PhaseTransitions\/PhaseTransitions.html\">A Simulation-Based Method for Aggregating Markov Chains<\/a><\/p>\n<p>S. Meyn, A. Surana, Y. Lin, S. Narayanan, <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Mismatch\/Mismatch.html\">Anomaly Detection Using Projective Markov Models in a Distributed Sensor Network<\/a><\/p>\n<p>K. Deng, W. Chen, P. G. Mehta, S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/PED08\/PED.html\">Resource Pooling for Optimal Evacuation of a Large Building<\/a>.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>G. Mathew and S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/ITA08\/ITA08.html\">Shannon meets Bellman: Feature based Markovian models for detection and optimization<\/a><\/p>\n<p>I.-K. Cho and S.P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Market06\/Market06.html\">Efficiency and Marginal Cost Pricing in Dynamic Competitive Markets with Friction<\/a><\/p>\n<p>I.-K. Cho and S.P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/newsboy2010-8-23.pdf\">A Dynamic Newsboy Model for Optimal Reserve Management in Electricity Markets<\/a>.<\/p>\n<p>G. Fort, S. Meyn, E. Moulines, and P. Priouret. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/ODEMCMC\/ODEMCMC.html\">ODE methods for skip-free Markov chain stability with applications to MCMC<\/a><\/p>\n<p>D. Huang, J. Unnikrishnan, S. Meyn, V. Veeravalli, and A. Surana. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Mismatch\/Mismatch.html\">Statistical SVMs for robust detection, supervised learning, and universal classification<\/a> (ITW 2009).<\/p>\n<p>E. Abbe, M. M\u00e9dard, S. P. Meyn, and L. Zheng. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Mismatch\/Mismatch.html\">Finding the Best Mismatched Detector for Channel Coding and Hypothesis Testing<\/a><\/p>\n<p>C. Pandit, J. Huang, S. Meyn, M. M\u00e9dard, and V. Veeravalli. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/HMM05meynIMA.pdf\">Entropy, Inference, and Channel Coding<\/a> (<a href=\"http:\/\/www.ima.umn.edu\/matter\/SP6.22-7.1.05\/\">IMA Summer Workshop on Wireless Communications, 2005<\/a>)<\/p>\n<p>C. Pandit, J. Huang, S. Meyn, V. Veeravalli. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/PMVit04.pdf\">Extremal Distributions in Information Theory and Hypothesis Testing<\/a> (ITW 2004)<\/p>\n<p>S. Kyriazopoulou-Panagiotopoulou, I. Kontoyiannis and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/kyrkonmey08.pdf\">Control Variates as Screening Functions<\/a><\/p>\n<p>I. Kontoyiannis and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Screened07\/screened07.html\">Computable exponential bounds for screened estimation and simulation<\/a><\/p>\n<p>I. Kontoyiannis, L.A. Lastras-Monta\u00f1o, and S.P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/markovISIT05.pdf\">Relative Entropy and Exponential Deviation Bounds for General Markov Chains<\/a> (ISIT 2005)<\/p>\n<p>S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/MaxWeight06\/MaxWeight06.html\">Stability and asymptotic optimality of generalized MaxWeight policies<\/a><\/p>\n<p>D. Gamarnik and S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/GMcounterexample\/GM06.html\">On Exponential Ergodicity of Multiclass Queueing Networks<\/a>.<\/p>\n<p>S. Yuksel, T. Basar, and S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/yukbasmey08.pdf\">Optimal causal coding of Markov sources in continuous alphabets with applications in linear control systems<\/a>.<\/p>\n<p>I. Kontoyiannis and S. P. Meyn. <a href=\"http:\/\/arxiv.org\/abs\/0906.0259\">Approximating a diffusion by a Hidden Markov Model<\/a>.<\/p>\n<p>I. Kontoyiannis and S. P. Meyn. <a href=\"http:\/\/arxiv.org\/abs\/0906.5322\">Geometric ergodicity and the spectral gap of non-reversible Markov chains<\/a>.<\/p>\n<p>V. Borkar and S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Oja08\/Oja08.html\">Oja&#8217;s Algorithm for Graph Clustering and Markov Spectral Decomposition<\/a>.<\/p>\n<p>C. Lin, V. V. Veeravalli, and S. Meyn. <a href=\"http:\/\/arxiv.org\/abs\/0806.3023\">Distributed Beamforming with Feedback: Convergence Analysis<\/a>.<\/p>\n<p>W. Chen, D. Traskov, M. Heindlmaier, M. M\u00e9dard, S. Meyn, and A. Ozdaglar. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/Erlang10-20.pdf\">Coding and control for communication networks<\/a><\/p>\n<p>K. R. Duffy and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/SkipFreeSims\/SkipFreeSims.html\">Most likely paths to error when estimating the mean of a reflected random walk<\/a>.<\/p>\n<p>J. Blanchet, P. Glynn and S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/SkipFreeSims\/SkipFreeSims.html\">Large Deviations for the Empirical Mean of an M\/M\/1 Queue<\/a>.<\/p>\n<p>K. R. Duffy and S. P. Meyn. <a href=\"http:\/\/arxiv.org\/abs\/0910.5431\">Estimating loynes&#8217; exponent<\/a><\/p>\n<p>J. Unnikrishnan, D. Huang, S. Meyn, A. Surana, and V. Veeravalli. <a href=\"http:\/\/arxiv.org\/abs\/0909.2234\">Universal and composite hypothesis testing via mismatched divergence.<\/a><\/p>\n<p>J. Unnikrishnan, V. V. Veeravalli, and S. Meyn. <a href=\"http:\/\/arxiv.org\/abs\/0911.2551\">Minimax robust quickest change detection<\/a>.<\/p>\n<p>J. Unnikrishnan, V. Venugopal, and S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/unnveemeyISIT09.pdf\">Least favorable distributions for robust quickest change detection<\/a><\/p>\n<p>C. Pandit and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/PMac05.pdf\">Robust Measurement-Based Admission Control Using Markov&#8217;s Theory of Canonical Distributions<\/a>.<\/p>\n<p>J. Huang and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Signal%20constellation\/HuangConstellations.html\">Characterization and Computation of Optimal Distributions for Channel Coding<\/a>.<\/p>\n<p>A. G. Alleyne, D. J. Block, S. P. Meyn, W. R. Perkins, and M. W. Spong. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/CoE.pdf\">An Interdisciplinary, Inter-Departmental Control Systems Laboratory at the University of Illinois<\/a>. (<a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/ieeexplore.ieee.org\/iel5\/37\/30230\/01388785.html\"><i>IEEE explore<\/i><\/a>).<\/p>\n<p>I. Kontoyiannis and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/second.pdf\">Large deviations asymptotics and the spectral theory of multiplicatively regular Markov Processes<\/a><\/p>\n<p>S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/valueTAC05.pdf\">Workload Models for Stochastic Networks: Value Functions and Performance Evaluation<\/a>.<\/p>\n<p>S. P. Meyn, <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/DynamicSS\/DSS.html\">Dynamic safety-stocks for asymptotic optimality in stochastic networks<\/a>.<\/p>\n<p>S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/OneSideLDP.pdf\">Large deviation asymptotics and control variates for simulating large functions<\/a>.<\/p>\n<p>V. Tadic, S.P. Meyn and R. Tempo. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/tmt08.pdf\">Randomized Algorithms for Semi-Infinite Programming Problems<\/a> (Springer Verlag, 2005)<\/p>\n<p>C. Pandit, and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/PM05.pdf\">Worst-Case Large-Deviations with Application to Queueing and Information Theory<\/a>.<\/p>\n<p>M. Chen, I.-K. Cho, and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/Automatica05.pdf\">Reliability by design in a distributed power transmission network<\/a><\/p>\n<p>J. Huang, S. Meyn, M. M\u00e9dard. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/huameymed.pdf\">Error Exponents for Channel Coding and Signal Constellation Design<\/a><\/p>\n<p>V. S. Borkar and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/risk.pdf\">Risk sensitive optimal control: existence and synthesis for models with unbounded cost<\/a><\/p>\n<p>W. Huisinga, S. P. Meyn, and C. Schuette. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/PhaseTransitions\/PhaseTransitions.html\">Phase transitions and metastability in Markovian and molecular systems<\/a><\/p>\n<p>I. Kontoyiannis and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/first.pdf\">Spectral theory and Limit theory for geometrically ergodic Markov processes<\/a><span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>M. M\u00e9dard, J. Huang, A. J. Goldsmith, S. P. Meyn, and T. P. Coleman. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/aloha.pdf\">Capacity of Time-Slotted ALOHA Packetized Multiple-Access Systems Over the AWGN Channel<\/a><\/p>\n<p>S. G. Henderson, S. P. Meyn, and V. Tadic. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/HMT03\/HMT03.html\">Performance evaluation and policy selection in multiclass networks<\/a>.<\/p>\n<p>S. Shakkottai, R. Srikant, and S. Meyn. <a href=\"http:\/\/www.meyn.ece.ufl.edu\/archive\/spm_files\/Papers_pdf\/ssmToN.pdf\">Boundedness of utility function based congestion controllers in the presence of delay<\/a>.<\/p>\n<p>M. Chen, C. Pandit, and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/CPM03.pdf\">In search of sensitivity in network optimization<\/a>.<\/p>\n<p>R. Dubrawski, M. Chen and S. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/DCM03_short.pdf\">Management of demand-driven production systems<\/a><\/p>\n<p>S. P. Meyn, <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/Net01.pdf\">Sequencing and routing in multiclass queueing networks. Part I: feedback regulation<\/a>.<\/p>\n<p>S. P. Meyn, <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/38376.pdf\">Sequencing and routing in multiclass queueing networks. Part II: Workload Relaxations<\/a><\/p>\n<p>J. Huang, Kontoyiannis, I. and S.P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/RM.pdf\">The O.D.E. Method and Spectral Theory of Markov Operators<\/a><\/p>\n<p>V. S. Borkar and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/ode.pdf\">The O.D.E. method for convergence of stochastic approximation and reinforcement learning<\/a><\/p>\n<p>S. Balaji and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/countable.pdf\">Multiplicative ergodicity and large deviations for an irreducible Markov chain<\/a><\/p>\n<p>S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/DP199X\/DP199X.html\">The Policy Iteration Algorithm for Average Reward Markov Decision Processes with General State Space<\/a><\/p>\n<p>S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/Sadhana96.pdf\">Algorithms for optimization of controlled Markov chains<\/a><\/p>\n<p>S.P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/stabilityFeinberShwartz.pdf\">Stability, Performance Evaluation, and Optimization<\/a><\/p>\n<p>R-R. Chen and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/DP199X\/DP199X.html\">Value iteration and optimization of multiclass queueing networks<\/a><\/p>\n<p>D. Down and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/PLinear.pdf\">Piecewise linear test functions for stability of queueing networks<\/a><\/p>\n<p>S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/FluidExplosion.pdf\">Transience of multiclass queueing networks via fluid limit models<\/a><\/p>\n<p>S. P. Meyn and J. G. Dai. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/DaiMeyn.pdf\">Stability and convergence of moments for multiclass queueing networks via fluid limit models<\/a>.<\/p>\n<p>S.P. Meyn, <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/WilliamPaper.pdf\">Stability and Optimization of Queueing Networks and Their Fluid Models<\/a><\/p>\n<p>S. P. Meyn and R. L. Tweedie. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/State-Dependent.pdf\">State-dependent criteria for convergence of Markov chains<\/a>.<\/p>\n<p>S. P. Meyn and R. L. Tweedie. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/rates.pdf\">Computable bounds for convergence rates of Markov chains<\/a><\/p>\n<p>P. R. Kumar and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/Dual.pdf\">Duality and linear programs for stability and performance analysis of queueing networks and<br \/>\nscheduling policies<\/a><\/p>\n<p>P. R. Kumar and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/stability.pdf\">Stability of queueing networks and scheduling policies<\/a><\/p>\n<p>S. P. Meyn and D. Down. Stability of generalized Jackson networks<\/p>\n<p>R. Lund, S. P. Meyn, and R. L. Tweedie. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/95-25LundMeynTweedie.pdf\">Exponential convergence rates of convergence of stochastically monotone Markov processes<\/a><\/p>\n<p>D. Down and S. P. Meyn, and R. L. Tweedie. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/dmt.pdf\">Exponential and uniform ergodicity of Markov processes<\/a><\/p>\n<p>Meyn, S.P. and R.L. Tweedie, <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/resolvents.pdf\">Generalized Resolvents and Harris Recurrence of Markov Processes<\/a><\/p>\n<p>P. Glynn and S. P. Meyn. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/Fish.pdf\">A Lyapunov bound for solutions of Poisson&#8217;s equation<\/a><\/p>\n<p>S. P. Meyn. Ergodic theorems for discrete time stochastic systems using a stochastic Lyapunov function<\/p>\n<p>L. J. Brown, S. P. Meyn and R. A. Weber. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/tctWeld.pdf\">Adaptive dead-time compensation with application to a robotic welding system<\/a><\/p>\n<p>S. P. Meyn and P. E. Caines. Asymptotic behavior of stochastic systems possessing Markovian realizations.<\/p>\n<p>S. P. Meyn and L. Brown. Model reference adaptive control of time varying and stochastic systems<\/p>\n<p>S. P. Meyn and R. L. Tweedie. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/meytweIII.pdf\">Criteria for stability of Markovian processes III: Foster-Lyapunov criteria for continuous time processes, with examples<\/a><\/p>\n<p>S. P. Meyn and R. L. Tweedie. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/meytweII.pdf\">Criteria for stability of Markovian processes II: continuous time processes and sampled chains<\/a><\/p>\n<p>S. P. Meyn and R. L. Tweedie. <a href=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/archive\/spm_files\/Papers_pdf\/meytweI.pdf\">Criteria for stability of Markovian processes I: Discrete time chains<\/a><\/p>\n<p>S. P. Meyn, and P. E. Caines. A new approach to stochastic adaptive control<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"<p>Bib Files strings.bib | markov.bib | q.bib Control Techniques for Complex NetworksAppendix is an expanded Crash Course on Markov Chains &amp; Stochastic Stability Here is the original crash course G. Wang, M. Negrete-Pincetic, A. Kowli, E. Shafieepoorfard, S. Meyn and U. Shanbhag. Dynamic Competitive Equilibria in Electricity Markets G. Wang, M. Negrete-Pincetic, A. Kowli, E. [&hellip;]<\/p>\n","protected":false},"author":1347,"featured_media":0,"parent":0,"menu_order":7,"comment_status":"closed","ping_status":"closed","template":"page-templates\/page-section-nav.php","meta":{"_acf_changed":false,"inline_featured_image":false,"featured_post":"","footnotes":"","_links_to":"","_links_to_target":""},"class_list":["post-65","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages\/65","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/users\/1347"}],"replies":[{"embeddable":true,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/comments?post=65"}],"version-history":[{"count":1,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages\/65\/revisions"}],"predecessor-version":[{"id":2869,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages\/65\/revisions\/2869"}],"wp:attachment":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/media?parent=65"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}