Ir al contenido

Documat


Data stream treatment using sliding windows with MapReduce

  • María José Basgall [1] ; Waldo Hasperué [1] ; Marcelo Naiouf [1]
    1. [1] Universidad Nacional de La Plata

      Universidad Nacional de La Plata

      Argentina

  • Localización: Journal of Computer Science and Technology, ISSN-e 1666-6038, Vol. 16, Nº. 2, 2016, págs. 76-83
  • Idioma: inglés
  • Enlaces
  • Resumen
    • Knowledge Discovery in Databases (KDD) techniques present limitations when the volume of data to process is very large. Any KDD algorithm needs to do several iterations on the complete set of data in order to carry out its work. For continuous data stream processing it is necessary to store part of it in a temporal window. In this paper, we present a technique that uses the size of the temporal window in a dynamic way, based on the frequency of the data arrival and the response time of the KDD task. The obtained results show that this technique reaches a great size window where each example of the stream is used in more than one iteration of the KDD task.


Fundación Dialnet

Mi Documat

Opciones de artículo

Opciones de compartir

Opciones de entorno