WebScrapingAPI Docs
HomeLoginRegister
  • Introduction
    • Registration
    • Pricing
    • Free APIs
    • API Errors
    • Custom Response Headers
  • Browser API
    • Getting Started
      • Access the API
      • Authentication
      • API Parameters
    • Basic API Requests
      • GET Request
      • POST, PUT & PATCH Requests
      • Proxy Mode
    • Advanced API Features
      • Awaiting
      • Geolocation
      • Sessions
      • Forcing Timeouts
      • Custom Headers
      • Custom Cookies
      • Device Type
      • Viewport Sizing
      • Screenshot
      • Screenshot Options
      • Extraction Rules
      • JavaScript Instructions
      • Full JSON Response
      • JSON DOM Response
      • Block Resources
      • Captcha Solving
  • WebScrapingAPI
    • Getting Started
      • Access the API
      • API Parameters
    • Basic API Requests
      • GET Request
      • POST, PUT & PATCH Requests
    • Advanced API Features
      • Geolocation
      • Extraction Rules
      • Full JSON Response
      • JSON DOM Response
      • Rendering JavaScript
  • WebStealthProxy
    • Getting Started
      • Access the Proxy
      • Usage and Statistics
    • Basic Proxy Requests
    • Advanced Proxy Requests
      • Sessions
      • Geolocation
      • Custom Headers
      • Custom Cookies
      • Screenshots
  • Google Search API
    • Getting Started
      • Access the API
      • API Parameters
    • Google Search Engines
      • Google Search API
      • Google Maps API
      • Google Maps Reviews API
      • Google Reverse Image API
      • Google Trends API
        • Geo Parameter Options List
        • Google Trends Categories List
  • WB CUSTOM SEARCH API
    • Getting Started
      • Access the API
      • API Parameters
    • WB Custom Search Engines
      • Wayfair Product API
      • Best Buy Product API
      • Nordstrom Product API
  • Amazon Search API
    • Getting Started
      • API Parameters
      • Access the API
      • Supported Domains
    • Amazon Search Types
      • Amazon Search
      • Amazon Seller
        • Amazon Seller Products
        • Amazon Seller Profile
        • Amazon Seller Feedback
      • Amazon Product
      • Amazon Category
      • Amazon Bestsellers
      • Amazon New Releases
      • Amazon Deals
  • Bing Search API
    • Getting Started
      • Access the API
      • API Parameters
    • Basic API Requests
Powered by GitBook
On this page
  • The url parameter
  • Supported HTTP Methods
  1. WebScrapingAPI

Basic API Requests

WebScrapingAPI is not limited to GET requests. You can now easily scrape the internet by sending POST, PUT or PATCH requests as well.

PreviousAPI ParametersNextGET Request

Last updated 10 months ago

Only basic understanding of how the web works is required to scrape the web using WebScrapingAPI. Our team made it so that anyone can extract HTML from almost any website, without having to write an entire application.

The url parameter

The url parameter has to be encoded in order for your request to pass!

Before diving into the more advanced features of WebScrapingAPI, it is important to understand how the API works. In order to scrape a web page using our services, simply append the URL of the page you want to scrape to the API’s base endpoint, along with your API key.

The url parameter represents the webpage that you are targeting and is required to make a request on our API. Failing to pass this parameter will result in 400: Bad Request.

This being said, it only takes two parameters to extract the full HTML code of the page you want to scrape using WebScrapingAPI: api_key and url.

Supported HTTP Methods

Whilst GET requests are quite common in web scraping, more advanced users may want to send POST or PUT requests to scrape forms or even other APIs. Currently, WebScrapingAPI offers support for the following HTTP requests:

GET requests
POST requests
PUT requests
PATCH requests