Optimized Web Scraping System Using Multithreading Techniques for Corporate Information Extraction

• Francisco Hermo ^[1] ; Ángel Gómez ^[1] ; Carlos Dafonte ^[1]
  1. [1] Universidade da Coruña

     Universidade da Coruña

     A Coruña, España

     
• Localización: Proceedings XoveTIC 2025: Impulsando el talento científico / coord. por Manuel Lagos Rodríguez, Hilda Romero-Velo, Álvaro Leitao , Javier Pereira-Loureiro , Manuel Penedo , 2026, ISBN 978-84-9749-925-5, págs. 53-58
• Idioma: inglés
• Enlaces
  • Texto completo
• Resumen

  • This study aims to automatically identify the various ICT innovations implemented bycompanies on their websites. To achieve this, web scraping techniques are proposed as the mosteffective approach. However, the need to process large sets of companies presents challengesin terms of execution time and system performance. To address these issues, our system incor-porates multithreading techniques, enabling the concurrent execution of analysis drivers thatextract the targeted elements. As a complement to our extraction system, we developed a webapplication that allows users to visualize the obtained results, organized on a map of Spanishprovinces and grouped by the analyzed companies