# The monte carlo newton-raphson algorithm

@article{Kuk1997TheMC, title={The monte carlo newton-raphson algorithm}, author={Anthony Y. C. Kuk and Yuk W. Cheng}, journal={Journal of Statistical Computation and Simulation}, year={1997}, volume={59}, pages={233-250} }

It is shown that the Monte Carlo Newton-Raphson algorithm is a viable alternative to the Monte Carlo EM algorithm for finding maximum likelihood estimates based on incomplete data. Both Monte Carlo procedures require simulations from the conditional distribution of the missing data given the observed data with the aid of methods like Gibbs sampling and rejective sampling. The Newton-Raphson algorithm is computationally more efficient than the EM algorithm as it converges faster. We further… Expand

#### 56 Citations

Employing a Monte Carlo Algorithm in Newton-Type Methods for Restricted Maximum Likelihood Estimation of Genetic Parameters

- Physics, Medicine
- PloS one
- 2013

The results indicate the importance of defining a suitable convergence criterion and critical value in order to obtain an efficient Newton-type method utilizing a MC algorithm and encourage testing of these methods with different kinds of large-scale problem settings. Expand

Pointwise and functional approximations in Monte Carlo maximum likelihood estimation

- Mathematics, Computer Science
- Stat. Comput.
- 1999

A comparison between the marginal likelihood and the recently proposed hierarchical likelihood which avoids integration altogether is compared, which is applied to fit a latent process model to a set of polio incidence data. Expand

Monte Carlo approximation through Gibbs output in generalized linear mixed models

- Mathematics
- 2005

Geyer (J. Roy. Statist. Soc. 56 (1994) 291) proposed Monte Carlo method to approximate the whole likelihood function. His method is limited to choosing a proper reference point. We attempt to improve… Expand

Combining MM-Algorithms and MCMC Procedures for Maximum Likelihood Estimation in Mallows-Bradley-Terry Models

- Mathematics
- 2019

This paper is devoted to the computation of the maximum likelihood estimates of the Mallows-Bradley-Terry ranking model parameters. The maximum likelihood method is avoid because of the normalizing… Expand

ESTIMATION FOR STATE-SPACE MODELS BASED ON A LIKELIHOOD APPROXIMATION

- Mathematics
- 2005

Typically, the likelihood function for non-Gaussian state-space models cannot be computed explicitly and simulation-based procedures, such as impor- tance sampling or MCMC, are commonly used to… Expand

Automatic Differentiation to Facilitate Maximum Likelihood Estimation in Nonlinear Random Effects Models

- Mathematics
- 2002

Maximum likelihood estimation in random effects models for non-Gaussian data is a computationally challenging task that currently receives much attention. This article shows that the estimation… Expand

Statistical models for autocorrelated count data.

- Mathematics, Medicine
- Statistics in medicine
- 2006

Compared the parameter estimation of the various methods in the modelling of a count data set, the incidence of polio in the USA over the period 1970-1983, using a longlinear generalized linear mixed model with an autoregressive correlation structure finds that parameter estimates and standard errors differ substantially between analyses. Expand

Laplace Importance Sampling for Generalized Linear Mixed Models

- Mathematics
- 1999

It is well known that the standard Laplace approximation of the integrated marginal likelihood function of a random effects model may be invalid if the dimension of the integral increases with the… Expand

Estimation for State-Space Models; an Approximate Likelihood Approach

- Mathematics
- 2003

Typically, the likelihood function for non-Gaussian state-space models can not be computed explicitly and so simulation based procedures, such as importance sampling or MCMC, are commonly used to… Expand

Whither PQL?

- 2017

Generalized linear mixed models (GLMM) are generalized linear models with normally distributed random effects in the linear predictor. Penalized quasi-likelihood (PQL), an approximate method of… Expand

#### References

SHOWING 1-10 OF 17 REFERENCES

Practical Markov Chain Monte Carlo

- Computer Science
- 1992

The case is made for basing all inference on one long run of the Markov chain and estimating the Monte Carlo error by standard nonparametric methods well-known in the time-series and operations research literature. Expand

Monte Carlo EM Estimation for Time Series Models Involving Counts

- Mathematics
- 1995

Abstract The observations in parameter-driven models for time series of counts are generated from latent unobservable processes that characterize the correlation structure. These models result in… Expand

A Monte Carlo Implementation of the EM Algorithm and the Poor Man's Data Augmentation Algorithms

- Mathematics
- 1990

Abstract The first part of this article presents the Monte Carlo implementation of the E step of the EM algorithm. Given the current guess to the maximizer of the posterior distribution, latent data… Expand

A gradient algorithm locally equivalent to the EM algorithm

- Mathematics
- 1995

In many problems of maximum likelihood estimation, it is impossible to carry out either the E-step or the M-step of the EM algorithm. The present paper introduces a gradient algorithm that is closely… Expand

A Monte Carlo method for Bayesian inference in frailty models.

- Computer Science, Medicine
- Biometrics
- 1991

This paper sets out a Bayesian representation of the model in the spirit of Kalbfleisch (1978) and discusses inference using Monte Carlo methods. Expand

Asymptotically Unbiased Estimation in Generalized Linear Models with Random Effects

- Mathematics
- 1995

SUMMARY Obtaining estimates that are nearly unbiased has proven to be difficult when random effects are incorporated into a generalized linear model. In this paper, we propose a general method of… Expand

Finding the Observed Information Matrix When Using the EM Algorithm

- Mathematics
- 1982

A procedure is derived for extracting the observed information matrix when the EM algorithm is used to find maximum likelihood estimates in incomplete data problems. The technique requires… Expand

Non-Uniform Random Variate Generation

- Mathematics
- 1986

This is a survey of the main methods in non-uniform random variate generation, and highlights recent research on the subject. Classical paradigms such as inversion, rejection, guide tables, and… Expand

A mixture model combining logistic regression with proportional hazards regression

- Mathematics
- 1992

SUMMARY A model is proposed for the analysis of censored data which combines a logistic formulation for the probability of occurrence of an event with a proportional hazards specification for the… Expand

Generalized linear models with random effects; salamander mating revisited.

- Medicine, Mathematics
- Biometrics
- 1992

This paper casts the problem in a Bayesian framework and uses a Monte Carlo method, the Gibbs sampler, to avoid current computational limitations in regression methodology for crossed designs. Expand