A web crawler (also known as a web SPIDER or web robot) is a program or automated script
which browses the in a methodical, automated manner. Other less frequently used names for
web crawlers are ants, automatic indexers, bots, and worms (Kobayashi and Takeda, 2000).來源。
