Current ThreatQ Version Filter
 

The Hacker News CDF

The web format of this guide reflects the most current release.  Guides for older iterations are available in PDF format.  

Integration Details

ThreatQuotient provides the following details for this integration:

Introduction

The "The Hacker News" CDF enables analysts to automatically ingest posts from the "The Hacker News" blog. This allows analysts to stay up-to-date on data breaches, vulnerabilities, and cyber-attacks via the published articles.

The integration provides the following feed:

  • The Hacker News - ingests posts from the Hacker news blog in the form of reports.  

The integration ingests report and report attribute type objects.

Installation

Perform the following steps to install the integration:

The same steps can be used to upgrade the integration to a new version.

  1. Log into https://marketplace.threatq.com/.
  2. Locate and download the integration yaml file.
  3. Navigate to the integrations management page on your ThreatQ instance.
  4. Click on the Add New Integration button.
  5. Upload the integration yaml file using one of the following methods:
    • Drag and drop the file into the dialog box
    • Select Click to Browse to locate the file on your local machine
  6. Select the individual feeds to install, when prompted and click Install.

    ThreatQ will inform you if the feed already exists on the platform and will require user confirmation before proceeding. ThreatQ will also inform you if the new version of the feed contains changes to the user configuration. The new user configurations will overwrite the existing ones for the feed and will require user confirmation before proceeding.

The feed(s) will be added to the integrations page. You will still need to configure and then enable the feed.

Configuration

ThreatQuotient does not issue API keys for third-party vendors. Contact the specific vendor to obtain API keys and other integration-related credentials.

To configure the integration:

  1. Navigate to your integrations management page in ThreatQ.
  2. Select the OSINT option from the Category dropdown (optional).

    If you are installing the integration for the first time, it will be located under the Disabled tab.

  3. Click on the integration entry to open its details page.
  4. Enter the following parameters under the Configuration tab:
    Parameter Description
    Post Categories Select the categories of posts to pull from.  Options include:
    • Data Breaches (default)
    • Cyber Attacks (default)
    • Vulnerabilities (default)
    Enable SSL Verification When checked, validates the host-provided SSL certificate.  This option is enabled by default.
    Disable Proxies Enable this option if the feed should not honor proxies set in the ThreatQ UI. 

    Configuration Screen
  5. Review any additional settings, make any changes if needed, and click on Save.
  6. Click on the toggle switch, located above the Additional Information section, to enable it.

ThreatQ Mapping

The Hacker News

The Hacker News CDF periodically pulls threat research posts from the The Hacker News blog, and ingests them into ThreatQ as Report Objects.

GET https://thehackernews.com/{{ category }}

This request returns HTML. The HTML is parsed for the title, date, links, etc. The blog itself is then fetched.

GET https://thehackernews.com/{{ uri }}

The mapping for this feed is based on the information parsed out of the blog's HTML content

Feed Data Path ThreatQ Entity ThreatQ Object Type or Attribute Key Published Date Examples Notes
N/A Report.Value N/A N/A Iranian Hackers Deploy New BugSleep Backdoor in Middle East Cyber Attacks Parsed from HTML
N/A Report.Description N/A N/A N/A Parsed from HTML
N/A Report.Description N/A N/A https://thehackernews.com/2024/07/iranian-hackers-deploy-new-bugsleep.html Parsed from HTML
N/A Report.Tag N/A N/A Vulnerability Parsed from HTML
N/A Report.Attribute Published At N/A Jul 17, 2024 Parsed from HTML

Average Feed Run

Object counts and Feed runtime are supplied as generalities only - objects returned by a provider can differ based on credential configurations and Feed runtime may vary based on system resources and load.

Metric Result
Run Time 1 minute
Reports 5
Report Attributes 10

Known Issues / Limitations

  • The feed utilizes since and until dates to ensure entries are not re-ingested if they haven't been updated.
  • If you need to ingest historical blog posts, run the feed manually by setting the since date back.
  • This feed will only pull at maximum, the latest page of blog posts for each category.

Change Log

  • Version 1.0.2
    • Resolved a timeout error by adding URL encoding to the source.  
  • Version 1.0.1
    • Resolved a parsing error that would occur when the provider API returned entries using a timestamp format other than MMM DD, YYYY.
  • Version 1.0.0
    • Initial release

PDF Guides

Document ThreatQ Version
The Hacker News CDF Guide v1.0.2 5.12.1 or Greater
The Hacker News CDF Guide v1.0.1 5.12.1 or Greater
The Hacker News CDF Guide v1.0.0 5.12.1 or Greater