At present, there are mainly two kinds of reptiles on the market:
Python crawler, you can customize and write crawler scripts directly according to your own needs. This is more suitable for people with computer language foundation, and the cost is higher.
The general crawler system basically uses software for visual acquisition directly. This is suitable for everyone, especially reptiles and amateurs.
Our company's business needs often need all kinds of data, and the commonly used software is: ForeSpider data acquisition system, which can basically upload the public data of all websites and is quite convenient to use.