DESIGNING A TELEGRAM BOT WITH WEB SCRAPING CAPABILITIES FOR AUTOMATING SCIENTIFIC ARTICLE DOWNLOADS
Abstract
Smartphones have become indispensable tools for a wide range of daily activities, including those related to academics. They serve not only as devices for communication and social interaction but also as powerful tools for self-study and information gathering. One key resource for academics is scientific journals, which provide valuable insights and information. In recent years, advancements in technology have made it possible to integrate instant messaging and access to scientific articles into a single platform. Telegram, a popular instant messaging service, offers an Open API and Protocol that enables developers to create custom bots with diverse functionalities. One such innovative application is a Telegram bot programmed in Python, designed to facilitate the downloading of research papers and articles from the Sci-Hub website using web scraping techniques. This bot allows users to streamline the process of retrieving multiple articles by submitting a list of URLs or DOIs in a simple .txt file format. The bot demonstrates impressive efficiency, with an average response time of 7.48 seconds to download PDF files. Additionally, its message-response time is highly optimized, averaging just 1.06 seconds. By integrating these capabilities, the bot effectively combines academic research needs with the convenience of instant messaging, providing a practical solution for researchers and students alike. This innovation not only simplifies access to scientific resources but also enhances productivity by minimizing the time and effort required for retrieving academic materials, ultimately supporting scholarly goals.
References
H. Elmi, A. Ambiyar, Y. Huda, and D. Novaliendry, “The Role of Information and Communication Technology in Interactive Learning,” Jurnal SAINTIKOM (Jurnal Sains Manajemen Informatika dan Komputer), vol. 23, no. 1, p. 193, Feb. 2024. DOI: 10.53513/jis.v23i1.9549
A. Haleem, M. Javaid, M. A. Qadri, and R. Suman, “Understanding the role of digital technologies in education: A review,” Sustainable Operations and Computers, vol. 3, pp. 275–285, 2022. DOI: 10.1016/j.susoc.2022.05.004
K. A. Persichitte and A. Suparman, Educational Technology to Improve Quality and Access on a Global Scale. Cham: Springer International Publishing, 2018. DOI: 10.1007/978-3-319-66227-5
S. Nawaz, “Rethinking classifications and metrics for problematic smartphone use and dependence: Addressing the call for reassessment,” Computers in Human Behavior Reports, vol. 12, p. 100327, Dec. 2023. DOI: 10.1016/j.chbr.2023.100327
L. Thomas and S. Bhat, “A Comprehensive Overview of Telegram Services - A Case Study,” International Journal of Case Studies in Business, IT, and Education, pp. 288–301, May 2022. DOI: 10.47992/IJCSBE.2581.6942.0165
I. R. Kalantarov and D. Y. Volkov, “Development of A Telegram-Bot For Automating The Educational Process,” Current Problems Of Teaching Mathematics At Technical University, vol. 10, pp. 53–56, 2023. DOI: 10.25206/2307-5430-2023-10-53-56
G. F. Avisyah, I. J. Putra, and S. S. Hidayat, “Open Artificial Intelligence Analysis using ChatGPT Integrated with Telegram Bot,” Jurnal ELTIKOM, vol. 7, no. 1, pp. 60–66, Jun. 2023. DOI: 10.31961/eltikom.v7i1.724
A. Abodayeh, R. Hejazi, W. Najjar, L. Shihadeh, and R. Latif, “Web Scraping for Data Analytics: A BeautifulSoup Implementation,” in 2023 Sixth International Conference of Women in Data Science at Prince Sultan University (WiDS PSU), 2023, pp. 65–69. DOI: 10.1109/WiDS-PSU57071.2023.00025
C. Lotfi, S. Srinivasan, M. Ertz, and I. Latrous, “Web Scraping Techniques and Applications: A Literature Review,” in SCRS Conference Proceedings on Intelligent Systems, Soft Computing Research Society, 2021, pp. 381–394. DOI: 10.52458/978-93-91842-08-6-38
N. Adila, “Implementation of Web Scraping for Journal Data Collection on the SINTA Website,” Sinkron, vol. 7, no. 4, pp. 2478–2485, Oct. 2022. DOI: 10.33395/sinkron.v7i4.11576
G. F. Avisyah, I. J. Putra, and S. S. Hidayat, “Open Artificial Intelligence Analysis using ChatGPT Integrated with Telegram Bot,” Jurnal ELTIKOM, vol. 7, no. 1, pp. 60–66, Jun. 2023. DOI: 10.31961/eltikom.v7i1.724
S. Bahrurozi, A. Asroni, and C. Damarjati, “Advanced Development of a Prayer Schedule Bot Application on Telegram Using PHP,” Emerging Information Science and Technology, vol. 1, no. 4, pp. 144–148, Oct. 2022. DOI: 10.18196/eist.v1i4.16596
N. Adila, “Implementation of Web Scraping for Journal Data Collection on the SINTA Website,” Sinkron, vol. 7, no. 4, pp. 2478–2485, Oct. 2022. DOI: 10.33395/sinkron.v7i4.11576
V. Joey Ferelestian, B. Susanto, and I. K. D. Senapartha, “Pengembangan Telegram Chatbot Informasi Mahasiswa Menggunakan Wit.ai,” Jurnal Terapan Teknologi Informasi, vol. 7, no. 2, pp. 89–97, Oct. 2023. DOI: 10.21460/jutei.2023.72.257
Farid Asroful Anam, “Telegram Chatbot Implementation Using Rasa Framework to Recommend Tourism in Semarang City,” Jurnal Ilmiah Komputasi, vol. 23, no. 1, Mar. 2024. DOI: 10.32409/jikstik.23.1.3569
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a copyright form (JACTA) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
