• web of science banner
  • web of science banner
  • scopus banner
  • Engineering Information banner
  • Inspec Direct banner
  • Dialog banner
  • EBSCO banner
Subscription button Subscription button
ETRI J award winner banner
Article  <  Archive  <  Home
Structure Learning in Bayesian Networks Using Asexual Reproduction Optimization
Ali Reza Khanteymoori, Mohammad Bagher Menhaj, and Mohammad Mehdi Homayounpour
vol. 33, no. 1, Feb. 2011, pp. 39-49.
Keywords : Bayesian networks, structure learning, evolutionary algorithms, genetic algorithms.
  • Abstract
    • Abstract.

      A new structure learning approach for Bayesian networks based on asexual reproduction optimization (ARO) is proposed in this paper. ARO can be considered an evolutionary-based algorithm that mathematically models the budding mechanism of asexual reproduction. In ARO, a parent produces a bud through a reproduction operator; thereafter, the parent and its bud compete to survive according to a performance index obtained from the underlying objective function of the optimization problem: This leads to the fitter individual. The convergence measure of ARO is analyzed. The proposed method is applied to real-world and benchmark applications, while its effectiveness is demonstrated through computer simulations. Results of simulations show that ARO outperforms genetic algorithm (GA) because ARO results in a good structure and fast convergence rate in comparison with GA.
  • Authors
    • Authors

      Ali Reza Khanteymoori
      Amirkabir University of Technology
      Mohammad Bagher Menhaj
      Amirkabir University of Technology
      Mohammad Mehdi Homayounpour
      Amirkabir University of Technology
  • References
    • References

      [1] J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, San Mateo, CA: Morgan Kaufmann, 1988.
      [2] R.E. Neapolitan, Learning Bayesian Networks, Upper Saddle River, NJ: Prentice Hall, 2004.
      [3] S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 2nd ed., Upper Saddle River, NJ: Prentice Hall, 2003.
      [4] F.V. Jensen, "Introduction to Bayesian Networks," Dept. of Mathematics and Computer Science, Univ. of Aalborg, Denmark, Technical Report IR 93–2003, 1993.
      [5] M.L. Wong and K.S. Leung, "An Efficient Data Mining Method for Learning Bayesian Networks Using an Evolutionary Algorithm-Based Hybrid Approach," IEEE Trans. Evolutionary Computing, vol. 8, no. 4, Aug. 2004, pp. 378-404.
      [6] D.M. Chickering, D. Geiger, and D. Heckerman, "Learning Bayesian Networks: Search Methods and Experimental Results," 5th Int. Workshop Artificial Intell. Statistics, 1995, pp. 112-128.
      [7] H. Wang, D. Dash, and M.J. Druzdzel, "A Method for Evaluating Elicitation Schemes for Probabilistic Models," IEEE Trans. Syst. Man Cybern. B, vol. 32, no. 1, Feb. 2002, pp. 38-43.
      [8] G.M. Provan, "Model Selection for Diagnosis and Treatment Using Temporal Influence Diagrams," Proc. 4th Int. Workshop Artificial Intell. Statistics, 1995, pp. 469-480.
      [9] P. Larranaga et al., "Structure Learning of Bayesian Network by Genetic Algorithms: A Performance Analysis of Control Parameters," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, no. 9, Sept. 1996, pp. 912-926.
      [10] G.F. Cooper and E.A. Herskovits, "A Bayesian Method for the Induction of Probabilistic Networks from Data," Mach. Learning, vol. 9, no. 4, 1992, pp. 309-347.
      [11] X. Li, X. He, and S. Yuan, "Learning Bayesian Networks Structures from Incomplete Data Based on Extending Evolutionary Programming," Proc. Int. Conf. Mach. Learning Cybern., vol. 4, Aug. 2005, pp. 2039-2043.
      [12] D.M. Chickering, "Learning Bayesian Networks is NP-Complete," Learning from Data, Artificial Intelligence and Statistics, Springer Verlag, 1996.
      [13] http://en.wikipedia.org/wiki/Bayesian_network
      [14] D. Heckerman, D. Geiger, and D.M. Chickering, "Learning Bayesian Networks: The Combination of Knowledge and Statistical Data," Mach. Learning, vol. 20, 1995, pp. 197-243.
      [15] R.W. Robinson, "Counting Unlabeled Acyclic Digraphs," Combinatorial Mathematics V: Proc. 5th Australian Conf., Aug. 24-26, 1976.
      [16] D.M. Chickering, "Optimal Structure Identification with Greedy Search," J. Machine Learning Research, vol. 3, 2002, pp. 507-554.
      [17] C. Chow and C. Liu, "Approximating Discrete Probability Distributions with Dependence Trees," IEEE Trans. Inf. Theory, vol. 14, no. 3, 1968, pp. 462-467.
      [18] M.A. Faust and R.A. Gulledge, "Identifying Harmful Marine Dinoflagellates," Smithsonian Inst. Contrib. U.S. Natl. Herb., vol. 42, 2002, pp. 1-144.
      [19] S. Willcox, N.A. Moltschaniwskyj, and C. Crawford, "Asexual Reproduction in Scyphistomae of Aurelia sp.: Effects of Temperature and Salinity in an Experimental Study," J. Experimental Marine Biology Ecology, vol. 353, no. 1, 2007, pp. 107-114.
      [20] C. Zilberberg, A.M. Solé-Cava, and M. Klautau, "The Extent of Asexual Reproduction in Sponges of the Genus Chondrilla (Demospongiae: Chondrosida) from the Caribbean and the Brazilian Coasts," J. Experimental Marine Biology Ecology, vol. 336, no.
      [21] K. Holmstrom and H.J. Jensen, "Who Runs Fastest in an Adaptive Landscape: Sexual Versus Asexual Reproduction," Physica A: Statistical Theoretical Physics, vol. 337, no. 1-2, 2004, pp. 185-195.
      [22] W. Song, "Morphogenesis of Cyrtohymena tetracirrata (Ciliophora, Hypotrichia, Oxytrichidae) during Binary Fission," European J. Protistology, vol. 40, no. 3, 2004, pp. 245-254.
      [23] K. Lee et al., "Light Regulation of Asexual Development in the Rice Blast Fungus, Magnaporthe Oryzae," Fungal Genetics Biology, vol. 43, no. 10, 2006, pp. 694-706.
      [24] T. Yanagi, T. Yachi and N. Okuda, "Photoperiodic Reaction of Sexual and Asexual Reproduction in Fragaria Chiloensis L. CHI-24-1 Plants Grown at Various Temperatures," Scientia Horticulturae, vol. 110, no. 2, 2006, pp. 187-191.
      [25] F. Prall and C. Ostwald, "High-Degree Tumor Budding and Podia-Formation in Sporadic Colorectal Carcinomas with K-Ras Gene Mutations," Hum. Pathol., vol. 38, 2007, pp. 1696-702.
      [26] A.V. Ramayya et al., "Binary and Ternary Fission Studies with 252Cf," Progress Particle Nuclear Physics, vol. 46, no. 1, 2001, pp. 221-229.
      [27] S. Stertz et al., "The Intracellular Sites of Early Replication and Budding of SARS-Coronavirus," Virology, vol. 361, no. 2, 2007, pp. 304-315.
      [28] R.F. Green and D.L.G. Noakes, "Is a Little Bit of Sex as Good as a Lot?" J. Theoretical Biology, vol. 174, no. 1, 1995, pp. 87-96.
      [29] M.T. Ghiselin, "The Evolution of Sex: A History of Competing Points of View," The Evolution of Sex: An Examination of Current Ideas, R.E. Michod and B.R. Levin, Eds., Sunderland: Sinauer Associates Inc., 1988, pp. 7-23.
      [30] M. Clerc and J. Kennedy, "The Particle Swarm–Explosion, Stability, and Convergence in a Multidimensional Complex Space," IEEE Trans. Evolutionary Computation, vol. 6, 2002, pp. 58-73.
      [31] M. Mitchel, An Introduction to Genetic Algorithms, MIT Press, 1999.
      [32] M. Dorigo and T. Stützle, Ant Colony Optimization, India, New Delhi: Prentice-Hall, 2005.
      [33] http://www.norsys.com/networklibrary.html
      [34] I.A. Beinlinch et al., "The ALARM Monitoring System: A Case Study with Two Probabilistic Inference Techniques for Belief Networks," Proc. 2nd European Conf. Artificial Intell. Medicine, 1989, pp. 247-256.
  • Cited by
  • Metrics
    • Metrics

      Article Usage