Scrapinghub

Scrapinghub

Enterprise level, full stack web scraping suite for business

4.7/5 (28 reviews)

Scrapinghub Overview

What is Scrapinghub?

Scrapinghub is a provider of full stack web scraping solutions, offering a suite of platform products for transforming websites into data at scale. Combining technology and services to meet the needs of business users and developers from entry to Enterprise-level, Scrapinghub's custom on-demand data extraction plans are backed by qualified web scraping engineers. In addition, its Crawlera product promises "smart" IP proxy management that operates via HTTP request sends to its API, providing automatic proxy rotation and ban management. Available across scalable pricing plans designed for small to Enterprise-level scraping based on monthly and concurrent requests; Crawlera offers automatic ban detection, user behavior simulation and unlimited bandwidth. Also supported by headless browsers, Scrapinghub's own Splash browser is a purpose-built solution available as an open source project or hosted SaaS product. This lightweight headless browser scrapes data from websites at scale, including JavaScript-generated content, while simulating user behavior via custom scripting. Scrapy Cloud is the provider's cloud-based platform for managing and automating the deployment of web crawlers or "spiders" via a real time dashboard interface. Built-in QA tools and integration of Scrapinghub’s own Spidermon framework join intelligent scheduling options and customizable containers. Lastly, Scrapinghub's automatic data extraction API (beta) provides eCommerce and article data extraction at scale. The Select Product API returns structured data such as product information from eCommerce URLs, while the Select Article API scrapes news articles and blog posts.

Scrapinghub Overview

Pricing

Starting from
US$9.00/month

Pricing options

Free Trial
Free
Open Source
Subscription
Value for money

Data on demand:
Once-off: From $500 per site
Data Subscription: $250 per month
Custom: From $2,000 annually

Scrapy Cloud
Starter: FREE
Professional: $9 per unit, per month

Splash
Small: $25 per month
Medium: $50 per month
Large: $100 per month
Enterprise: Custom

Crawlera
C10 Plan: $25 per month
C50 Plan: $100 per month
C100 Plan: $250 per month
C200 Plan: $500 per month
Enterprise: From $1,000 per month


Scrapinghub Features

Devices
Business size
S M L
Markets
United States
Supported Languages
English

Screenshots

Scrapinghub screenshot: Splash is Scrapinghub's headless browser designed specifically for web scraping and rendering at any scale, promising lightweight performance while supporting the scraping of JavaScript content
Scrapinghub screenshot: Splash is Scrapinghub's headless browser designed specifically for web scraping and rendering at any scale, promising lightweight performance while supporting the scraping of JavaScript content Scrapinghub screenshot: The Splash headless browser showing Splash instances and the option to generate new Splash keys and URL links for multiple users Scrapinghub screenshot: Scrapy Cloud provides cloud-based web crawler management with an online real time dashboard for deploying, scheduling, running and controlling spiders with a suite of QA tools Scrapinghub screenshot: Scrapy Cloud's online dashboard UI showing a searchable list of spiders, ordered by last running times Scrapinghub screenshot: A project usage graph visualization shown within Scrapy Cloud's dashboard Scrapinghub screenshot: Crawlera's Overview screen showing plan statistics including usage, requests breakdowns and top websites scraped most recently Scrapinghub screenshot: Create a new project dialog showing the options for deploying spiders using Portia or Scrapy technologies

Scrapinghub Reviews

Scrapinghub Reviews

Overall rating
4.7
/
5 28 reviews
Excellent
20

Very good
7

Average
1

Poor
0

Terrible
0

Value for Money
4.6
Features
4.6
Ease of Use
4.7
Customer Support
4.9
96% recommended this app
Aminah N.

When it just works

It makes me work really fast but still secure for my clients. I look really professional even though what I did was only suggesting and installing Crawlera. It's awesome!


Neil joseph Y.

Relatively Easy To Use

Our company, whatoplay.com, aggregates data from multiple sources around the world. Since we started using Crawlera, we haven't really encountered big issues. Our common ones in the last 6 months is just reaching our limit, so we just had to increase our plan.


Jose iram D.

K-LIX

I have a good experience with scrappinhumb, in a matter of minutes I can develop and publish a new spider.


Mikhail K.

Why do you need that title?

I use and recommend that platform for years for my customers which need production-ready enterprise-grade data scraping systems.


Verified Reviewer

Simple, reliable and powerful service

Never had a problem, and customer services always replied to our requests promptly, and with attention to detail.


Aminah N.
Industry: Management Consulting
Company size: 2-10 Employees

When it just works

Used Daily for 2+ years
Reviewed on 18/12/2018
Review Source: Capterra

It makes me work really fast but still secure for my clients. I look really professional even though what I did was only suggesting and installing Crawlera. It's awesome!

Pros

It really saves my time as a web scraping specialists. I always need rotated proxies for my client needs. I keep creating a new project and it is a lot of hassle of I have to buy proxies, renew proxies, and create proxy rotation on my own. I am glad I don't even need to think about it. It just works!

Cons

Well, it's just doesn't have enough advanced documentation on Scrapy Splash combined with Crawlera. Their development team in Github is very responsive though.

Rating breakdown

Value for Money
Ease of Use
Customer Support

Likelihood to recommend: 10.0/10

Neil joseph Y.
Industry: Computer Software
Company size: 13-50 Employees

Relatively Easy To Use

Used Daily for 2+ years
Reviewed on 21/1/2019
Review Source: Capterra

Our company, whatoplay.com, aggregates data from multiple sources around the world. Since we started using Crawlera, we haven't really encountered big issues. Our common ones in the last 6 months is just reaching our limit, so we just had to increase our plan.

Pros

We're only using Crawlera for our data scraping needs and it has worked seamlessly since we started using it in 2016. When we had to upgrade to a higher limit, the transition was fast, and no dev time was wasted updating our existing codebase.

Cons

Pricing can be a bit tricky especially if your need is right in between the plans.

Rating breakdown

Value for Money
Ease of Use
Customer Support

Likelihood to recommend: 10.0/10

Jose iram D.
Industry: Food & Beverages
Company size: 2-10 Employees

K-LIX

Used Daily for 1+ year
Reviewed on 10/12/2018
Review Source: Capterra

I have a good experience with scrappinhumb, in a matter of minutes I can develop and publish a new spider.

Pros

The software delivers the exactly promised result. It has a friendly interface and an efficient support.

Cons

You need a roadmap of new features and the pricing of third-party services.

Response from Scrapinghub

Thank you for the review. All new features will be announced in our Support Center.(https://support.scrapinghub.com/support/home) We also have an Ideas Forum (https://support.scrapinghub.com/support/discussions/forums/22000200101) where we would love your input on ideas or new features you would like to see. We appreciate all input from our Customers to continue to help us improve our products.

Rating breakdown

Value for Money
Ease of Use
Customer Support

Likelihood to recommend: 10.0/10

Mikhail K.
Industry: Computer Software
Company size: Self Employed

Why do you need that title?

Used Weekly for 2+ years
Reviewed on 26/11/2018
Review Source: Capterra

I use and recommend that platform for years for my customers which need production-ready enterprise-grade data scraping systems.

Pros

- Original and flexible technology
- No vendor-lock
- Easy to use for professionals
- Pretty convenient API system for integration with third-party solutions

Cons

- Not so easy to use by non-professional IT person that still wants to use data scraping
- Lack of ability to create some kind of simple and clear user interface for such a persons
- No simple solution for distributed/high-volume crawling
- Lack of monitoring and alerting, non convenient logging system
- Overpriced Crawlera

Response from Scrapinghub

Thank you for your review we appreciate all customer feedback. We do have a managed service offering for non IT professional who want access to the Data without having any scraping skills.

Rating breakdown

Value for Money
Ease of Use
Customer Support

Likelihood to recommend: 9.0/10

Verified Reviewer
Industry: Retail
Company size: 2-10 Employees

Simple, reliable and powerful service

Used Daily for 2+ years
Reviewed on 18/12/2018
Review Source: Capterra

Never had a problem, and customer services always replied to our requests promptly, and with attention to detail.

Pros

We are very happy with Crawlera. It works like a charm with our Scrapy projects, just adding a few lines of code we completely forgot about proxies that ended up failing anyway.

Cons

Some requests end up being very slow, but good news is most of them end up going through.

Rating breakdown

Value for Money
Ease of Use
Customer Support

Likelihood to recommend: 10.0/10

User recommendation
9.2/10
Based on 28 user ratings
Compare user recommendation rating with alternatives
Compare with alternatives

Scrapinghub Pricing

Scrapinghub Pricing

Starting from
US$9.00/month
Free Trial
Free
Open Source
Subscription
Value for money

Data on demand:
Once-off: From $500 per site
Data Subscription: $250 per month
Custom: From $2,000 annually

Scrapy Cloud
Starter: FREE
Professional: $9 per unit, per month

Splash
Small: $25 per month
Medium: $50 per month
Large: $100 per month
Enterprise: Custom

Crawlera
C10 Plan: $25 per month
C50 Plan: $100 per month
C100 Plan: $250 per month
C200 Plan: $500 per month
Enterprise: From $1,000 per month

Data on demand:
Once-off: From $500 per site
Data Subscription: $250 per month
Custom: From $2,000 annually

Scrapy Cloud
Starter: FREE
Professional: $9 per unit, per month

Splash
Small: $25 per month
Medium: $50 per month
Large: $100 per month
Enterprise: Custom

Crawlera
C10 Plan: $25 per month
C50 Plan: $100 per month
C100 Plan: $250 per month
C200 Plan: $500 per month
Enterprise: From $1,000 per month

Value for Money
4.6/5
Based on 28 user ratings
Compare value for money rating with alternatives
Compare with alternatives

Scrapinghub Features

Scrapinghub Features

API
Activity Dashboard
Ad hoc Reporting
Business Intelligence
Charting
Collaboration Tools
Customisable Reporting
Dashboard Creation
Data Filtering
Data Import/Export
Data Visualisation
Drag & Drop Interface
Filtered Views
Monitoring
Real Time Analytics
Real Time Data
Reporting & Statistics
Third Party Integration
Trend Analysis
Visual Analytics
Features
4.6/5
Based on 28 user ratings
Compare features rating with alternatives
Compare with alternatives

Categories

Video Tutorials

Video Tutorials

Additional information for Scrapinghub

Additional information for Scrapinghub

Key features of Scrapinghub

  • Email Address Extraction
  • Phone Number Extraction
  • Web Data Extraction

Benefits

• Scrapinghub is a full stack web scraping platform for business startups and Enterprises, comprising a suite of developer tools alongside managed services for data on demand applications.

• Custom data extraction services are also available, supported by a team of over 100 qualified web scraping engineers.

• Crawlera is a proxy network designed for scalable web scraping based on monthly requests, with main features including automatic ban detection and IP rotation, persistent sessions, headless browser support, plus unlimited bandwidth.

• Splash is Scrapinghub's lightweight headless browser that facilitates the scraping of JavaScript generated content and the simulation of user behavior with custom scripts.

• Scrapy Cloud offers cloud-based management of the deployment and running of web crawlers, comprising a real time dashboard, built-in QA tools including spider monitoring, scheduling, customizable containers etc.

Scrapinghub FAQs

Scrapinghub FAQs

Below are some frequently asked questions for Scrapinghub.

Q. What type of pricing plans does Scrapinghub offer?

Scrapinghub offers the following pricing plans:

Starting from: US$9.00/month

Pricing model: Free, Open Source, Subscription

Free Trial: Available

Data on demand: Once-off: From $500 per site Data Subscription: $250 per month Custom: From $2,000 annually Scrapy Cloud Starter: FREE Professional: $9 per unit, per month Splash Small: $25 per month Medium: $50 per month Large: $100 per month Enterprise: Custom Crawlera C10 Plan: $25 per month C50 Plan: $100 per month C100 Plan: $250 per month C200 Plan: $500 per month Enterprise: From $1,000 per month

Q. What are the main features of Scrapinghub?

Scrapinghub offers the following features:

  • Email Address Extraction
  • Phone Number Extraction
  • Web Data Extraction

Q. Who are the typical users of Scrapinghub?

Scrapinghub has the following typical customers:

Large Enterprises, Mid Size Business, Small Business

Q. What languages does Scrapinghub support?

Scrapinghub supports the following languages:

English

Q. What type of pricing plans does Scrapinghub offer?

Scrapinghub has the following pricing plans:

Free, Open Source, Subscription

Q. Does Scrapinghub support mobile devices?

We do not have any information about what devices Scrapinghub supports

Q. What other apps does Scrapinghub integrate with?

Scrapinghub integrates with the following applications:

Dropbox, GitHub, Google Drive

Q. What level of support does Scrapinghub offer?

Scrapinghub offers the following support options:

Online Support, Phone Support