Abstract
Learning from streams is a process in which a group of learners separately obtain information about the target to be learned, but they can communicate with each other in order to learn the target. We are interested in machine models for learning from streams and study its learning power (as measured by the collection of learnable classes). We study how the power of learning from streams depends on the two parameters m and n, where n is the number of learners which track a single stream of input each and m is the number of learners (among the n learners) which have to find, in the limit, the right description of the target. We study for which combinations m,n and m′,n′ the following inclusion holds: Every class learnable from streams with parameters m,n is also learnable from streams with parameters m′,n′. For the learning of uniformly recursive classes, we get a full characterization which depends only on the ratio \(\frac{m}{n}\); but for general classes the picture is more complicated. Most of the noninclusions in team learning carry over to noninclusions with the same parameters in the case of learning from streams; but only few inclusions are preserved and some additional noninclusions hold. Besides this, we also relate learning from streams to various other closely related and well-studied forms of learning: iterative learning from text, learning from incomplete text and learning from noisy text.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ambainis, A.: Probabilistic inductive inference: a survey. Theoretical Computer Science 264, 155–167 (2001)
Angluin, D.: Inductive inference of formal languages from positive data. Information and Control 45, 117–135 (1980)
Baliga, G., Case, J., Jain, S.: The synthesis of language learners. Information and Computation 152, 16–43 (1999)
Baliga, G., Jain, S., Sharma, A.: Learning from multiple sources of inaccurate data. SIAM Journal on Computing 26, 961–990 (1997)
Blum, L., Blum, M.: Toward a mathematical theory of inductive inference. Information and Control 28, 125–155 (1975)
Case, J., Lynes, C.: Machine inductive inference and language identification. In: Nielsen, M., Schmidt, E.M. (eds.) ICALP 1982. LNCS, vol. 140, pp. 107–115. Springer, Heidelberg (1982)
Fulk, M.: Prudence and other conditions on formal language learning. Information and Computation 85, 1–11 (1990)
Fulk, M., Jain, S.: Learning in the presence of inaccurate information. Theoretical Computer Science 161, 235–261 (1996)
Mark Gold, E.: Language identification in the limit. Information and Control 10, 447–474 (1967)
Jain, S., Osherson, D., Royer, J.S., Sharma, A.: Systems That Learn: An Introduction to Learning Theory, 2nd edn. MIT Press, Cambridge (1999)
Jain, S., Sharma, A.: Team learning of computable languages. Theory of Computing Systems 33, 35–58 (2000)
Odifreddi, P.: Classical Recursion Theory. North-Holland, Amsterdam (1989)
Osherson, D., Stob, M., Weinstein, S.: Systems That Learn: An Introduction to Learning Theory for Cognitive and Computer Scientists. MIT Press, Cambridge (1986)
Osherson, D., Weinstein, S.: Criteria of language learning. Information and Control 52, 123–138 (1982)
Pitt, L.: Probabilistic inductive inference. Journal of the ACM 36, 383–433 (1989)
Pitt, L., Smith, C.H.: Probability and plurality for aggregations of learning machines. Information and Computation 77, 77–92 (1988)
Rogers, H.: Theory of Recursive Functions and Effective Computability. McGraw-Hill, New York (1967); Reprinted in MIT Press (1987)
Smith, C.H.: The power of pluralism for automatic program synthesis. Journal of the ACM 29, 1144–1165 (1982)
Smith, C.H.: Three decades of team learning. In: Arikawa, S., Jantke, K.P. (eds.) AII 1994 and ALT 1994. LNCS, vol. 872, pp. 211–228. Springer, Heidelberg (1994)
Wiehagen, R.: Limes-Erkennung rekursiver Funktionen durch spezielle Strategien. Elektronische Informationsverbarbeitung und Kybernetik (EIK) 12, 93–99 (1976)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jain, S., Stephan, F., Ye, N. (2009). Learning from Streams. In: Gavaldà, R., Lugosi, G., Zeugmann, T., Zilles, S. (eds) Algorithmic Learning Theory. ALT 2009. Lecture Notes in Computer Science(), vol 5809. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04414-4_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-04414-4_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04413-7
Online ISBN: 978-3-642-04414-4
eBook Packages: Computer ScienceComputer Science (R0)