Variable Selection by Using a Genetic Algorithm for Regression Model

Yigiter A., Cetin M.

INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS & STATISTICS, cilt.57, sa.4, ss.1-9, 2018 (ESCI) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 57 Sayı: 4
  • Basım Tarihi: 2018
  • Dergi Adı: INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS & STATISTICS
  • Derginin Tarandığı İndeksler: Emerging Sources Citation Index (ESCI), zbMATH
  • Sayfa Sayıları: ss.1-9
  • Hacettepe Üniversitesi Adresli: Evet

Özet

Variable selection is an important process to obtain the best subset of variables in a regression model. Forward, backward, stepwise methods are known as classical variable selection methods in the regression model. As a search-based method, Genetic Algorithm (GA) is also used for variable selection. The aim of this study is to select the subsets of independent variables in the regression model using GA. GA method is known as a heuristic search algorithm used to solve complex optimization problems. Additionally, GA could be used as a conventional method for variable selection in regression analysis as in many statistical areas. In this study, the GA method is described, and then, the subset is obtained by minimizing information criteria such as Akaike information criterion (AIC). Mallow's Cp (Cp), Bozdogan's index of informational complexity (ICOMP) and robust AIC (ROAIC), and by maximizing Akaike information criterion with Fisher information (AICF) (Cetin and Erar, 2006). A simulation study is used to evaluate the performance of the criterian in GA in case of an outlier or without an outlier in the data.