Dark Web - Output Reference

The output includes 3 sections. The "Meta Info" provides information concerning API consumption and the request itself. The "Item Object" includes information about a particular post in a thread or dark web page. A post could be the article, i.e the first post, or a comment to the article; the "Thread Object" contains information about the thread in which the item appeared.

Meta Info

Field Name
Description
Type

totalResults

The total number of posts matching your query

Integer

moreResultsAvailable

How many more results are available

Integer

next

A URL to get the next batch of posts matching your query.

String

requestsLeft

How many more requests are available in your current subscription plan.

Integer

Item Object

Field Name
Description
Searchable?
Type

uuid

A unique ID representing the thread

False

String

url

The link to the page

True

String

site

The top level domain of the site

True

String

title

The title of the thread

True

String

text

The text in the page or post

True

String

published

The date/time when the page or post was published (if detected).
The timezone is GMT+3

Tue

language

The language of the text

True

String

external_links

A list of URLs that are linked from the page or post

True

String

external_images

A list of URLs to image that are linked from the page or post

True

String

is_live

A Boolean value (true/false) stating if the site is online or offline

True

Boolean

crawled

The date/time when the post was crawled. The timezone is GMT+3

True

cacheLink

A link to a cached HTML snapshot of the page

False

String

file_type

The file type that was crawled

True

String

required_login

A Boolean value (true/false) stating if the content is protected by a password.

True

Boolean

categories

A list of categories for the post text.

True

String

rating

The rating parameter provides the star rating for the review, a floating number between 0.0 to 5.0.

True

Float

files_links

A list of all files (internal & external) URLs that we found in the current post

False

String

external_videos

A list of links to videos files

False

String

referring_url

The URL that referred our crawler to the current doc URL

False

String

Thread Object

Field Name
Description
Searchable?
Type

url

The link to the top of the thread

True

String

site_section

A link to the section in the site where the thread was created

True

String

section_title

The title of the section in the site where the thread was created

True

String

title

The title of the thread

True

String

title_full

The title of the section in the site where the thread was created

True

String

published

The date/time when the thread was published.
The timezone is GMT+3

True

replies_count

How many replies are there to the main post

True

Integer

participants_count

How many different people participated in the discussion

True

Integer

site_type

Is the site a blog/news/discussion

True

String

spam_score

A score value between 0 to 1, indicating how spammy the thread text is.

True

Float

main_image

A link to the main image presented with the article

False

String

{
      "url": "http://tmskhzavkycdupbr.onion/viewtopic.php?id=60894",
      "uuid": "2c99ecf25c0c497bb87abf1160f6b1ff3bbef7a7",
      "source": {
        "site": "tmskhzavkycdupbr.onion",
        "is_live": true
      },
      "title": "SELL BANK LOGIN / BANK TRANSFER / Off Topic / DreamMarket Forum",
      "text": "DreamMarket Forum DreamMarket user forum. \nIndex Search Register Login You are not logged in.\nTopics: Active | Unanswered Index » Off Topic » SELL BANK LOGIN / BANK TRANSFER Pages: 1 \nDo not open links which you will find below. ....",
      "highlightText": "",
      "highlightTitle": "",
      "published": null,
      "author": null,
      "language": "english",
      "thread": {
        "url": null,
        "site_section": null,
        "section_title": null,
        "title": null,
        "title_full": null,
        "published": null,
        "replies_count": null,
        "participants_count": null,
        "site_type": null,
        "spam_score": null,
        "main_image": null
      },
      "ord_in_thread": null,
      "external_links": [
        "http://fluxbb.org/"
      ],
      "external_images": [],
      "external_videos": [],
      "file_links": [],
      "rating": null,
      "file_type": "html",
      "network": "tor",
      "required_login": false,
      "referring_url": null,
      "referring_file_type": null,
      "categories": [
        "financial"
      ],
      "crawled": "2018-06-01T13:18:51.033+03:00",
      "cacheLink": "/dark-cache?token=xxxxxxxxxxxxxxxxxxxxxxx&id=http%3A%2F%2Ftmskhzavkycdupbr.onion%2..."
    }

Dark Web - Output Reference