- Home /
need bulk data collector,Need Bulk data collector
I want to collect bulk data from a website http://eboardresults.com/app/stud/ or http://www.educationboardresults.gov.bd/ for each student of a certain range of roll. I want to store this data in a Excel file spreadsheet/database.
To do this task manually is very difficult. Is there any free software/tools to collect this data automatically?
Answer by Strixie13 · Jul 22, 2018 at 12:55 AM
Definitely not Unity :) You would need to do something called web scraping. There is software to speed up the process, but to gather information from a specific site you will have to write it yourself. Essentially you need to write a program that gathers information under specific HTML tags, cycles through the options over and over again, then saves it to a file format. Look up tutorials on something like Selenium. Disclaimer, websites usually don't want you scraping from them.
Your answer
Follow this Question
Related Questions
Find or make sound effects. 2 Answers
I want to make an undertale kinda game, how do I implement pixl art? 1 Answer
anyone use mindmapping software for planning out and referencing etc? 4 Answers
Qué programa es mejor para crear personajes para luego usarlos en mi juego? 1 Answer
No response when I click Play for the first time I open the computer 0 Answers