Release Notes

October 25th, 2018 - Cyber API Data Feed

  • Added to the Dark Web coverage 7 new dark networks:
    I2P (Invisible Internet Project) - Anonymous P2P network, we cover forums, marketplaces, shops
    ZeroNet - Decentralized network, we cover forums, marketplaces, news feeds and shops
    IRC (Internet Relay Chat) - we cover illicit channels
    Telegram - we cover illicit channels
    OpenBazaar - we cover illicit shops
    Discord - we cover illicit channels
    Deepweb - Paste sites and password protected illicit websites
  • New field - wallet_ids: a list of cryptocurrencies addresses
  • New field - wallet_ids count: the total number of wallet IDs found in the post
  • New field - ssns: a list of social security numbers
  • New field - ssn count: the total number of social security numbers found in the post
  • New field - credit_cards: a list of credit card numbers
  • New field - credit cards count: the total number of credit card numbers found in the post
  • New field - phones: a list of phone numbers
  • New field - phones count: the total number of phone numbers found in the post
  • New field - emails: a list of email addresses
  • New field - email count: the total number of emails found in the post
  • New field - locations: a list of mentioned locations
  • New field - locations count: the total number of locations found in the post
  • New field - organizations: a list of mentioned organizations
  • New field - organizations count: the total number of organizations found in the post
  • New field - persons: a list of mentioned persons
  • New field - persons count: the total number of persons found in the post
  • New field - site.name: the name of a site, enabling search across mirrors of the same site

June 3rd, 2018 - Dark Web Data Feed

  • Crawling TOR V3: we now automatically discover and scan the more anonymous & secure TOR V3 onions.

  • Crawling external files content: Webhose data crawler downloads and scans the content of external files, even if they are compressed. The following formats are supported: zip, rar, tar, 7z, pdf, txt, xls, xlsx, doc, docx, sql.

  • Darkweb only: our system automatically crawls content behind password protected forums and marketplaces. Captchas and passwords are no longer a barrier.

  • Saving structured data from news & blogs: we now supply content from news sites and blogs on the dark web, not only forums and marketplaces.

  • Text Categorization: using machine learning, Webhose is now trained to identify and categorize relevant posts in eight categories: Drugs, IDs & Passwords, Passports (PII), Hacking, Terror, Weapons, Pirate, Sexual, and Financial, giving you the ability to consume relevant data by category.

  • New field - rating: for reviews only on marketplaces.

  • New field - files_links: list of all files (internal & external) URLs that we found in the current post.

  • New field - external_videos: list of links to videos files.

  • New field - referring_url: The URL that referred our crawler to the current doc URL.

  • New field - file_type: The format of the file that contains the content crawled (zip, rar, tar, 7z, pdf, txt, xls, xlsx, doc, docx, sql).

  • New field - required_login: Boolean field that specifies if the current content was found in a password protected site.

Check out filters reference, and output reference to learn more about how you can search and filter content from the dark web