There are a variety of tools available. You need to take into account the specific needs you have and then map it with the tools available. You can think of a web scraping service, programming libraries like BeautifulSoup or Scrapy in Python or software tools like Import.io or Octoparse
