Learning functions represented as multiplicity automata

Amos Beimel, Francesco Bergadano, Nader H. Bshouty, Eyal Kushilevitz, Stefano Varricchio, E. Kushilevitz

Research output: Contribution to journalArticlepeer-review

81 Scopus citations

Abstract

We study the learnability of multiplicity automata in Angluin's exact learning model, and we investigate its applications. Our starting point is a known theorem from automata theory relating the number of states in a minimal multiplicity automaton for a function to the rank of its Hankel matrix. With this theorem in hand, we present a new simple algorithm for learning multiplicity automata with improved time and query complexity, and we prove the learnability of various concept classes. These include (among others): The class of disjoint DNF, and more generally satisfy-O(1) DNF. The class of polynomials over finite fields. The class of bounded-degree polynomials over infinite fields. The class of XOR of terms. Certain classes of boxes in high dimensions. In addition, we obtain the best query complexity for several classes known to be learnable by other methods such as decision trees and polynomials over GF(2). While multiplicity automata are shown to be useful to prove the learnability of some subclasses of DNF formulae and various other classes, we study the limitations of this method. We prove that this method cannot be used to resolve the learnability of some other open problems such as the learnability of general DNF formulas or even k-term DNF for k = ω(log n) or satisfy-s DNF formulas for s = ω(1). These results are proven by exhibiting functions in the above classes that require multiplicity automata with super-polynomial number of states.

Original languageEnglish
Pages (from-to)506-530
Number of pages25
JournalJournal of the ACM
Volume47
Issue number3
DOIs
StatePublished - 1 Jan 2000
Externally publishedYes

Keywords

  • Computational learning
  • DNF
  • Learning disjoint
  • Learning polynomials
  • Multiplicity automata

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Information Systems
  • Hardware and Architecture
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Learning functions represented as multiplicity automata'. Together they form a unique fingerprint.

Cite this