+ # plot(ell, dim^ep*sx1/it) + result = list(ell, accr, dim^ep * sx1/it) + return(result) + } Subsequently, one <strong>ca</strong>n s<strong>ca</strong>n through the returned vectors easily using the following code, which also yields theoreti<strong>ca</strong>l curves for the same example: > S<strong>ca</strong>nGam = function(it = 5e+05, dim = 50, ep = 0, n = 50) { + ell = 10 + (1:n) * 3 + ER = 1/75 + vsd = ell/dim^ep + a = 5 + # initialize the speed measure + esp = 0 + for (i in (1:it)) { + x = rgamma(2 * n, a, 1) + y = rnorm(2 * n, x, rep(vsd^0.5, each = 2)) + eps = matrix(log(dgamma(y, a, 1)/dgamma(x, a, 1)), 2, + n) + # <strong>ca</strong>lculate the ratio + eps = (eps[1, ] + eps[2, ] - ell * ER/2)/sqrt(ell * ER) + esp = esp + pnorm(eps) + } + # s<strong>ca</strong>n the vectors + ell[which.max(2 * ell * esp/it)] + OAR = 2 * esp[which.max(2 * ell * esp/it)]/it + plot(2 * esp/it, 2 * ell * esp/it, type = "l") + result = list(ell, 2 * esp/it, 2 * ell * esp/it, which.max(2 * + ell * esp/it), ellhat, OAR) + return(result) + } Acknowledgement. Words <strong>ca</strong>nnot express the gratitude I have for my supervisor, Professor Jeffrey S. Rosenthal. He graciously lent me this time and introduced me to the exciting field of optimal s<strong>ca</strong>ling of Monte Carlo algorithms, providing positive encouragement throughout the process. Without his guidance, none of this would have been possible. 48
References [Béd06] Bédard, M. (2006). On the Robustness of Optimal S<strong>ca</strong>ling for Random Walk Metropolis Algorithms. Ph.D. dissertation, Department of Statistics, University of Toronto. [Béd07] Bédard, M. (2007). Weak Convergence of Metropolis Algorithms for Non-iid Target Distributions. Ann. Appl. Probab. 17, 1222-44. [Béd08a] Bédard, M. (2008). Optimal Acceptance Rates for Metropolis Algorithms: Moving Beyond 0.234. Stochastic Process. Appl. 118, 2198-222. [Béd08b] Bédard, M. (2008). Efficient Sampling using Metropolis Algorithms: Appli<strong>ca</strong>tions of Optimal S<strong>ca</strong>ling Results. J. Comput. Graph. Statist. 17, 312-32. [Béd10] Bédard, M. (2010). On the Optimal S<strong>ca</strong>ling Problem of Metropolis Algorithms for Hierarchi<strong>ca</strong>l Target Distributions, Unpublished. [BR08] Bédard, M., Rosenthal, J.S. (2008). Optimal s<strong>ca</strong>ling of Metropolis algorithms: Heading toward general target distributions. Canadian Journal of Statistics, 36(4), 483-503. [BPR06] Beskos, A., Papaspiliopoulos, O. and Roberts, G.O. (2006). Retrospective exact simulation of diffusion sample paths with appli<strong>ca</strong>tions. Bernoulli, 12, 1077-1098. [BPR08] Beskos, A., Papaspiliopoulos, O. and Roberts, G.O. (2008). A factorisation of diffusion measure and finite sample path constructions. Methodoloogy and Computing in Applied Probability, 10, 85-104. [BPR09] Beskos, A., Papaspiliopoulos, O. and Roberts, G.O. (2009). Monte Carlo maximum likelihood estimation for discretely observed diffusion porcesses. The Annals of Statistics, 37, 223-245. [BPRF06] Beskos, A., Papaspiliopoulos, O. Roberts, G.O., and Fearnhead, P. (2006) Exact and computationally efficient likelihood-based estimation for discretely observed diffusion processes. Journal of Royal Statisti<strong>ca</strong>l Society, Series B: Statisti<strong>ca</strong>l Methodology, 68, 333-382. [BRS09] Beskos, A., Roberts, G.O., and Stuart, A.M. (2009). Optimal s<strong>ca</strong>lings for lo<strong>ca</strong>l Metropolis-Hastings on non-product targets in high dimensions. Annals of Applied Probability, 19(3), 863-898. [BRSV08] Beskos, A., Roberts, G.O., Stuart, A.M., and Voss, J. (2008) MCMC methods for diffusion bridges. Stochastic Dynamics, 8, 319-350. [BS09] Beskos, A. and Stuart, A.M. (2009). MCMC methods for sampling function space. In Invited Lectures, Sixth International Congres on Industrial and Applied Mathematics, ICIAM07, Editiors Rolf Jeltsch and Gerhard Wanner, European Mathemati<strong>ca</strong>l Society, 337-364. [BR00] Breyer, L.A., and Roberts, G.O. (2000). From Metropolis to diffusions: Gibbs states and optimal s<strong>ca</strong>ling. Stochastic Processes and their Appli<strong>ca</strong>tions, 90, 181-206. [Da06] Da Prato, G. (2006). An Introduction to Infinite-Dimensional Analysis. Springer, New York. [EK86] Ethier, S.N. and Kurtz, T.G. (1986). Markov processes, characterization and convergence, Wiley, New York. [GRG96] Gelman, A., Roberts, G.O., and Gilks, W.R. (1996). Efficient Metropolis jumping rules. Bayesian Statistics 5, 599-608. [HSV07] Hairer, M., Stuart, A.M., and Voss, J. (2007). Analysis of SPDES Arising in Path Sampling. Part II: The Nonlinear Case. Annals of Applied Probability, 17(5-6), 1657-1706. [HSV10] Hairer, M., Stuart, A.M., and Voss, J. (2010). Signal Processing Problems on Function Space: Bayesian Formulation, Stochastic PDEs and Effective MCMC Methods. The Oxford Handbook of Nonlinear Filtering, D. Crisan and B. Rozovsky (editors). [HSVW05] Hairer, M., Stuart, A.M., Voss, J., and Wiberg, P. (2005). Analysis of SPDES Arising in Path Sampling. Part I: The Gaussian Case. Communi<strong>ca</strong>tions in Mathemati<strong>ca</strong>l Sciences, 3, 587-603. 49