Current ThreatQ Version Filter

PhishTank CDF

The web format of this guide reflects the most current release.  Guides for older iterations are available in PDF format.  

Integration Details

ThreatQuotient provides the following details for this integration:

Introduction

PhishTank returns to ThreatQ a collection of Indicators which we normalize and relate to their associated structures. Within this document details how the data is normalized and constructed in the platform. Mainly, URLs form relationships to IPs, and IPs relate to the reported CIDR Blocks. Attributes are only attributed to the URLs in which they are assigned.

The integration provides the following feed:

  • PhishTank - ingests URLs and related IP Addresses, CIDR Blocks.

The integration ingests the following Indicator types:

  • CIDR Block
  • IP Address
  • URL - this may be normalized to FQDN.

Installation

Perform the following steps to install the integration:

The same steps can be used to upgrade the integration to a new version.

  1. Log into https://marketplace.threatq.com/.
  2. Locate and download the integration file.
  3. Navigate to the integrations management page on your ThreatQ instance.
  4. Click on the Add New Integration button.
  5. Upload the integration file using one of the following methods:
    • Drag and drop the file into the dialog box
    • Select Click to Browse to locate the integration file on your local machine

    ThreatQ will inform you if the feed already exists on the platform and will require user confirmation before proceeding. ThreatQ will also inform you if the new version of the feed contains changes to the user configuration. The new user configurations will overwrite the existing ones for the feed and will require user confirmation before proceeding.

  6. If prompted, select the individual feeds to install and click Install. The feed will be added to the integrations page. 

You will still need to configure and then enable the feed.

Configuration

ThreatQuotient does not issue API keys for third-party vendors. Contact the specific vendor to obtain API keys and other integration-related credentials.

To configure the integration:

  1. Navigate to your integrations management page in ThreatQ.
  2. Select the OSINT option from the Category dropdown (optional).

    If you are installing the integration for the first time, it will be located under the Disabled tab.

  3. Click on the integration entry to open its details page.
  4. Enter the following parameters under the Configuration tab:
    Parameter Description
    Application Key Optional - your PhishTank Application Key.
    Feed URL Display Only - update the name that will display in the ThreatQ UI.
    Verify SSL If enabled, the integration will verify SSL connections with the provider.  
    Context Filter Multi-select yielding control of attribute selection to the user.
    Ingest ASNs As Select how Autonomous System Number (ASN) values are ingested. You can ingest ASNs as Attributes, Indicators (Type: ASN), or both.
  5. Review any additional settings, make any changes if needed, and click on Save.
  6. Click on the toggle switch, located above the Additional Information section, to enable it.

ThreatQ Mapping

PhishTank

The PhishTank feed returns a compressed file online-valid.json.gz.  The sample response below shows the file in a uncompressed format.

GET https://data.phishtank.com/data/{{user_fields.app_key}}/online-valid.json.gz

Sample Response:

[
    {
        "details": [
            {
                "announcing_network": "44476",
                "cidr_block": "185.176.43.0/24",
                "country": "BG",
                "detail_time": "2022-10-03T15:13:50+00:00",
                "ip_address": "185.176.43.98",
                "rir": "ripencc"
            }
        ],
        "online": "yes",
        "phish_detail_url": "http://www.phishtank.com/phish_detail.php?phish_id=7809274",
        "phish_id": "7809274",
        "submission_time": "2022-10-03T15:02:29+00:00",
        "target": "Other",
        "url": "http://movilappitau3hgm.c1.biz/",
        "verification_time": "2022-10-03T15:13:36+00:00",
        "verified": "yes"
    },
    {
        "details": [
            {
                "announcing_network": "44476",
                "cidr_block": "185.176.43.0/24",
                "country": "BG",
                "detail_time": "2022-10-03T15:13:50+00:00",
                "ip_address": "185.176.43.98",
                "rir": "ripencc"
            }
        ],
        "online": "yes",
        "phish_detail_url": "http://www.phishtank.com/phish_detail.php?phish_id=7809269",
        "phish_id": "7809269",
        "submission_time": "2022-10-03T15:02:25+00:00",
        "target": "HSBC Group",
        "url": "http://itau--000000.royalwebhosting.net/",
        "verification_time": "2022-10-03T15:13:36+00:00",
        "verified": "yes"
    }
]

ThreatQuotient provides the following default mapping for this feed:

Feed Data Path ThreatQ Entity ThreatQ Object Type or Attribute Key Published Date Examples Notes
url URL Indicator N/A http://itau--000000.royalwebhosting.net Main URL reported by PhishTank, draws a relationships to the IP and CIDR Block.
details.ip_address IP Address Related Indicator N/A 1.2.3.4 IP which the URL is related to
details.cidr_block CIDR Block Related Indicator N/A 198.23.171.0/20 CIDR Block of related IP
phish_id Indicator.Attribute PhishTank ID N/A 7809269 If Phishtank ID Context Filter is selected
phish_detail_url Indicator.Attribute PhishTank URL N/A http://www.phishtank.com/phish_detail.php?phish_id=7809269 If Phishtank Details URL Context Filter is selected
target Indicator.Attribute Target N/A HSBC Group If Target Context Filter is selected
details.announcing_network Indicator.Attribute ASN N/A 44476 If ASN is selected in Context Filter and Attributes is selected in Ingest ASNs As
details.announcing_network Related Indicator ASN N/A 44476 If ASN is selected in Context Filter and Indicators (Type: ASN) is selected in Ingest ASNs As
details.country Indicator.Attribute Country Code N/A BG If Country Code Context Filter is selected
details.rir Indicator.Attribute RIR N/A ripencc If RIR Context Filter is selected

Average Feed Run

Object counts and Feed runtime are supplied as generalities only - objects returned by a provider can differ based on credential configurations and Feed runtime may vary based on system resources and load.

Metric Result
Run Time 80 Minutes
Indicators 72,761
Indicator Attributes 440,297

Change Log

  • Version 2.1.1
    • Renamed the Announcing Network mapping to ASN for improved clarity and consistency.
    • Added support for ingesting ASN values as related ASN indicators, in addition to storing them as attributes.
    • Added a new configuration parameter, Ingest ASNs As, allowing you to choose whether ASN values are ingested as Attributes, ASN indicators, or both.
    • Renamed the Country mapping to Country Code to more accurately reflect the mapped data.
  • Version 2.1.0
    • Updated the Report Structure to provide better organization of relational data and attributes.  
  • Version 2.0.0
    • Initial release

PDF Guides

Document ThreatQ Version
PhishTank CDF Guide v2.1.0 4.56.0 or Greater
PhishTank CDF Guide v2.1.0 4.56.0 or Greater