The Numerical Simulations of Inverse Problems on the Parameter Estimation

Julan Hernadi Ahmad


The problem of determination an estimator through sample data is a part of the inverse problems. Generally, the inverse problem has no solution in ordinary sense since the observation data have been contaminated by noises. The minimizer of the least square functional is usually taken as the solution of the inverse problem.  The optimal design on parameter estimation uses the Fisher information matrix (FIM) as a tool for optimal criteria that minimizes some cost functional over set of FIM's. The consideration is based on the Cramer-Rao lower bound inequality can only be attained by the inverse of FIM.

This article demonstrates how to implement the inverse problems in connection with parameter estimation numerically where the set of noises is generated independently from one trial to another. The numerical simulation is applied to a distributed parameter system of parabolic equation to find the optimal sensor locations for the parameter. The simulation is also carried out to a model of dynamical system to obtain the optimal time for measurements. Correspondingly, two algorithms are composed to do numerical realization by computer. The results from numerical experiments are confirmed to theoretical background. In particular,  the accuracy of estimators are compared to the prior supposed nominal parameters and the variance of estimators are contrasted with the lower bound of Cramer-Rao inequality through the functional value acting on FIM's. The numerical results are also confirmed to the premise used in the parameter estimation that the information content on the parameter may vary considerably from one time measurement to another.


Numerical simulation, optimal design, FIM, parameter estimation, inverse problem

Full Text:



Aster, R. C, Borcher, B. and Clifford H. T., Parameter Estimation and Inverse Problems, Elseiver Academic Press, Burlington, MA, 2005.

Bank, H.T, Arias, A.C. and Kappel, F., Parameter Selection Methods in Invers Problems Formulation, Technical Report, CRSC, North Carolina State University, Nopember (2010).

Bank, H.T, Dediu, S. and Ernstberger, S.L., Sensitivity Function and Their Use in Inverse Problems, J. Inverse Ill-posed Problem, Vol. 15 (2007), 683-708.

Bank, H.T, Dediu, S., Ernstberger, S.L. and Kappel, F., Generalized Sensitivity and Optimal Experimental Design, J. Inverse Ill-posed Problem, Vol. 18 (2010), 25-88.

Bank, H.T, Holm, K. and Kappel, F., Comparation of Optimal Design Methods in Inverse Problems, Technical Report TR10-11, CRSC, North Carolina State University, Inverse Problems, Submitted, September (2010)

Doicu, A., Trautmann, and Schreier, F., Numerical Regularization for Atmospheric Inverse Problems, Springer-Verlag, Berlin Heidelberg, 2010.

Goodwin, C.G. and Payne, R.L., Dynamic System Identification: Experimental Design and Data Analysis, Academic-Press, 1977.

Hernadi, J., The Experimental Strategy for Parameter Estimation of Dynamic System Models, Preprint, (2011)

Hernadi, J and and Kappel, F., Optimal Design of Experiment: Sensitivity and Parameter Identification, Technical Report KF Univ-Graz, Austria, Desember (2010)

Muller, W.G., Collecting Spatial Data: Optimum Design of Experiment for Random Fields, Springer-Verlag, Berlin Heidelberg, 2007.

Thomaseth, K. and Cobelli, C., Generalized Sensitivity Functions in Physiological System Identification, Annals of Biomedical Engineering, Vol. 27 (1999), 607-616.

Ucinski, D., Optimal Measurement Methods for Distributed Parameter System Identification, CRC Press LLC, 2005.

Vogel C.R., Computational Methods for Inverse Problems, SIAM, Frontier in Applied Mathematics FR34, Philadelphia, 2002.



  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.