Output Reference

The output includes 3 sections:
"Meta Info" - provides information concerning API consumption and the request itself
"Item Object" - includes information about a particular post in a thread or dark web page. A post could be the article (i.e. the first post, or a comment to the article)
"Thread Object" - contains information about the thread in which the item appeared

Meta Info

Field Name
Description
Type

totalResults

The total number of posts matching your query

Integer

moreResultsAvailable

How many more results are available

Integer

next

A URL to get the next batch of posts matching your query

String

requestsLeft

How many more requests are available in your current subscription plan

Integer

Item Object

Main Fields as appear in the CyberDoc Object

Field Name
Description
Searchable?
Type

uuid

A unique ID representing the thread

False

String

parent_uuid

The unique ID of the parent doc

False

String

url

The link to the page

True

String

title

The title of the thread

True

String

text

The text in the page or post

True

String

author

The list of usernames/authors/actors that wrote the content of the post

True

Array[String]

published

The date/time when the page or post was published (if detected)
The timezone is GMT+3

True

language

The language of the text

True

String

external_links

A list of URLs that are linked from the page or post

True

String

external_images

A list of image URLs that are linked from the page or post

True

String

crawled

The date/time when the post was crawled. The timezone is GMT+3

True

cacheLink

A link to a cached HTML snapshot of the page

False

String

rating

The rating parameter provides the star rating for the review, a floating number between 0.0 to 5.0

True

Float

referring_url

The URL that referred our crawler to the current doc URL

False

String

ord_in_thread

The post number in the context of the thread:
0 - means first post

True

Integer

Site Object

Field Name
Description
Searchable?
Type

domain

The top level domain of the site

True

String

is_live

A Boolean value (true/false) stating if the site is online or offline

True

Boolean

type

Possible site types:

  • News
  • Blogs
  • Discussions
  • Messaging
  • Marketplaces
  • Shops

True

String

categories

Type of Illicit content that appear on the site (e.g. PII, carding, etc.)

True

Array[String]

Thread Object

Field Name
Description
Searchable?
Type

url

The link to the top of the thread

True

String

site_section

A link to the section in the site where the thread was created

True

String

section_title

The title of the section in the site where the thread was created

True

String

title

The title of the thread

True

String

full_title

The title of the section in the site where the thread was created

False

String

published

The date/time when the thread was published.
The timezone is GMT+3

True

replies_count

How many replies are there to the main post

True

Integer

participants_count

How many different people participated in the discussion

True

Integer

spam_score

A score value between 0 to 1, indicating how spammy the thread text is

True

Float

main_image

A link to the main image presented with the article

False

String

Extended Object

An Object that provides additional metadata on the visible content.

Field Name
Description
Searchable?
Type

external_links

A list of URLs that are linked from the page or post

True

Array[String]

external_videos

A list of URLs to videos from the page

True

Array[String]

file_links

A list of URLs to files from the page

True

Array[String]

file_type

Possible file types:

  • html
  • zip
  • rar
  • tar
  • 7z
  • pdf
  • txt
  • xls
  • xlsx
  • doc
  • docx
  • sql

True

String

network

Dark Network that contained the page/post
This could be one of the following:

  • TOR
  • ZeroNet
  • I2P
  • Open Bazaar
  • Telegram
  • Discord
  • IRC
  • Open Web

True

String

required_login

A Boolean value (true/false) stating if the content is protected by a password

True

Boolean

Enriched Object

The Enriched OBject contains all analyzed / deducted fields

Field Name
Description
Searchable?
Type

categories

One or more cyber categeries that the post/page content belong to.
Categories include:

  • drugs
  • pii
  • hacking
  • terror
  • weapons
  • sexual
  • financial

True

Array[String]

persons

one or more people entities found in the post/page

True

Array[String]

organizations

one or more organization entities found in the post/page

True

Array[String]

locations

one or more location entities found in the post/page

True

Array[String]

emails

one or more email entities found in the post/page

True

Array[String]

phones

one or more phone number entities found in the post/page

True

Array[String]

credit_cards

one or more organization entities found in the post/page

True

Array[String]

ssns

one or more social security number (ssn) entities found in the post/page

True

Array[String]

wallet_ids

one or more wallet_id entities found in the post/page

True

Array[String]

External Images Object

Field Name
Description
Searchable?
Type

url

The link to the actual image

yes

String

meta_info

Link to more information about the image

no

String

uuid

A unique ID for the image by its content. Multiple posts could link to the same image, even if its on different locations.

yes

String

label

A list of labels that describe the visual content of the image.

yes

Array

An example cyber doc object:

    {
      "url": "http://e2rlc42c2hah6tgj.onion/viewProduct?offer=393694.312665#post-0",
      "uuid": "bf416cecda38b308dd02d987a41f6ad7ba11bd70",
      "parent_uuid": "6dbcd81bbe1b5afe53ee761e06304700a538ec99",
      "title": "Uber.com Logins ✅✴️⚡",
      "text": "When you place an order, you will receive the login information which includes username and password. All information is fresh, and are never resold. Only you will have exclusive access to the account. Here is a sample of what you will get: Username: Beevives9 Password: MACritte$3 Last Checked: 02-14-2017 Country: USA / UK / CHINA (Sometimes Provided) These accounts are valid and 100% working...........",
      "highlightText": "",
      "highlightTitle": "",
      "author": [
        "Theme_Song"
      ],
      "language": "english",
      "referring_url": null,
      "referring_file_type": null,
      "rating": null,
      "published": "2018-07-30T12:03:00.000+03:00",
      "site": {
        "name": "Dream Market Login - Featured anonymous marketplace",
        "is_live": true,
        "domain": "e2rlc42c2hah6tgj.onion",
        "type": "discussions",
        "country": null,
        "categories": null
      },
      "thread": {
        "url": "http://e2rlc42c2hah6tgj.onion/viewProduct?offer=393694.312665",
        "uuid": "6dbcd81bbe1b5afe53ee761e06304700a538ec99",
        "title": "Uber.com Logins ✅✴️⚡",
        "full_title": "Uber.com Logins ✅✴️⚡",
        "published": "2018-07-30T12:03:00.000+03:00",
        "site_section": "http://e2rlc42c2hah6tgj.onion/?ai=1675",
        "section_title": "Dream Market",
        "replies_count": 5,
        "participants_count": 2,
        "spam_score": 0.207,
        "main_image": ""
      },
      "ord_in_thread": 0,
      "extended": {
        "external_links": [
          
        ],
        "external_images": [
          
        ],
        "external_videos": [
          
        ],
        "file_links": [
          
        ],
        "file_type": "html",
        "network": "tor",
        "required_login": true
      },
      "enriched": {
        "categories": [
          "pii",
          "financial"
        ],
        "persons": null,
        "organizations": {
          "value": [
            "walmart"
          ],
          "count": 1
        },
        "locations": {
          "value": [
            "usa",
            "uk"
          ],
          "count": 2
        },
        "emails": null,
        "phones": null,
        "credit_cards": null,
        "ssns": null,
        "wallet_ids": null
      },
      "crawled": "2018-07-30T04:03:40.018+03:00",
      "cache_link": "/dark-cache?token=XXXX-XXXX-XXXX&id=http%3A%2F%2Fe2rlc42c2hah6tgj.onion%2FviewProduct%3Foffer%3D393694.312665"
    }
  ],
  "totalResults": 2306,
  "moreResultsAvailable": 2296,
  "next": "/cyberFilter?token=XXXX-XXXX-XXXX&format=json&ts=1532912620018&q=fullz+AND+credit+is_structured%3Atrue+extended.network%3Ator",
  "requestsLeft": 8926
}