Article

get

https://api.diffbot.com/v3/article

Automatically extract clean article text and other data from news articles, blog posts and other text-heavy pages.

Query Params

url

string

required

Defaults to https://www.technologyreview.com/2020/09/04/1008156/knowledge-graph-ai-reads-web-machine-learning-natural-language-processing/

Target URL to extract

fields

string

enum

Specify optional fields to be returned from any fully-extracted pages (e.g. fields=querystring,links)

Allowed:

timeout

int32

Sets a value in milliseconds to wait for the retrieval/fetch of content from the requested URL. The default timeout for the third-party response is 30 seconds (30000).

callback

string

Use for jsonp requests. Needed for cross-domain ajax.

proxy

string

Specify an IP address of a custom proxy that will be used to fetch the target page. (Ex: &proxy or &proxy=0.0.0.0)

proxyAuth

string

Used to specify the authentication parameters that will be used with a custom proxy specified in the &proxy parameter. (Ex: proxyAuth=username:password)

useProxy

string

Set to default to use Diffbot's datacenter proxy for this request. none will instruct Extract to not use proxies, even if proxies have been enabled for this particular URL globally.

paging

boolean

Pass paging=false to disable automatic concatenation multiple-page articles.

maxTags

int32

Set the maximum number of automatically-generated tags to return. (Default: 10)

tagConfidence

float

Set the minimum relevance score of tags to return, between 0.0 and 1.0. By default only tags with a score equal to or above 0.5 will be returned.

categoryConfidence

float

Set the minimum relevance score of categories to return, between 0.0 and 1.0. By default only categories with a score equal to or above 0.5 will be returned.

discussion

boolean

Pass discussion=false to disable automatic extraction of article comments.

naturalLanguage

string

enum

Run extracted text and title through the Diffbot Natural Language API. Example: &naturalLanguage=entities,facts,categories,sentiment.

summaryNumSentences

int32

Sets the maximum number of sentences for summary generation when using naturalLanguage=summary (Default: 3).

renderDelay

integer

≤ 180000

Add additional time for rendering before the page is closed and the DOM is extracted. This can cause page timeouts, so a timeout parameter may be needed to extend the timeout. Note that the renderer closes automatically at 180 seconds.

scroll

string

enum

Direct the browser to scroll down the page, to trigger lazy-loaded content.

Allowed:

Responses

200Successful API Response

500Internal Server Error