Scraper site

This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed. Find sources: "Scraper site" – news · newspapers · books · scholar · JSTOR (August 2011) (Learn how and when to remove this message)

A scraper site is a website that copies content from other websites using web scraping. The content is then mirrored with the goal of creating revenue, usually through advertising and sometimes by selling user data.

Scraper sites come in various forms: Some provide little if any material or information and are intended to obtain user information such as e-mail addresses to be targeted for spam e-mail. Price aggregation and shopping sites access multiple listings of a product and allow a user to rapidly compare the prices.

Search engines such as Google could be considered a type of scraper site. Search engines gather content from other websites, save it in their own databases, index it and present the scraped content to the search engines' own users. The majority of content scraped by search engines is copyrighted.^[1]

The scraping technique has been used on various dating websites as well. These sites often combine their scraping activities with facial recognition.^{[2][3][4][5][6][7][8][9][10][11][excessive citations]}

Scraping is also used on general image analysis (recognition) websites, as well as websites specifically made to identify images of crops with pests and diseases.^[12][13]

Some scraper sites are created to make money by using advertising programs. In such case, they are called Made for

Made for AdSense sites are considered search engine spam that dilute the search results with less-than-satisfactory search results. The scraped content is redundant compared to content shown by the search engine under normal circumstances, had no MFA website been found in the listings.

Some scraper sites link to other sites in order to improve their

require that a republisher of Wikipedia inform its readers of the conditions on these licenses, and give credit to the original author.

Techniques

This section does not cite any sources. Please help improve this section by adding citations to reliable sources. Unsourced material may be challenged and removed. (November 2007) (Learn how and when to remove this message)

This section possibly contains original research. Please improve it by verifying the claims made and adding inline citations. Statements consisting only of original research should be removed. (September 2007) (Learn how and when to remove this message)

Depending upon the objective of a scraper, the methods in which websites are targeted differ. For example, sites with large amounts of content such as airlines, consumer electronics, department stores, etc. might be routinely targeted by their competition just to stay abreast of pricing information.

Another type of scraper will pull snippets and text from websites that rank high for keywords they have targeted. This way they hope to rank highly in the

RSS

feeds are vulnerable to scrapers.

Other scraper sites consist of advertisements and paragraphs of words randomly selected from a dictionary. Often a visitor will click on a

pay-per-click

advertisement on such site because it is the only comprehensible text on the page. Operators of these scraper sites gain financially from these clicks. Advertising networks claim to be constantly working to remove these sites from their programs, although these networks benefit directly from the clicks generated at this kind of site. From the advertisers' point of view, the networks don't seem to be making enough effort to stop this problem.

Scrapers tend to be associated with link farms and are sometimes perceived as the same thing, when multiple scrapers link to the same target site. A frequent target victim site might be accused of link-farm participation, due to the artificial pattern of incoming links to a victim website, linked from multiple scraper sites.

This section does not cite any sources. Please help improve this section by adding citations to reliable sources. Unsourced material may be challenged and removed. (December 2015) (Learn how and when to remove this message)

Some programmers who create scraper sites may purchase a recently expired

Services at some expired domain name registration agents provide both the facility to find these expired domains and to gather the HTML that the domain name used to have on its web site.^{[citation needed]}

• Scraping
• Contact scraping
• Domain parking
• Web scraping
• Blog scraping
• Multi-protocol messengers
  : can connect to several networks, yet require to have an account on all of these, so don't violate any terms of the networks
• Content farm
• Search engine optimization (SEO)