Data feed

What is a data feed?

A data feed is a mechanism for delivering structured data from one system to another in a continuous or regularly updated stream. It allows applications, platforms, and services to receive up-to-date information without manually retrieving it.

How does a data feed work?

A data feed operates through one of two models: publish-subscribe, where the source automatically sends data to an intermediary that delivers it to the receiving systems when data changes, or request-response, where the receiving system asks for data at set intervals.

A data provider generates or aggregates information and packages it in a structured format, such as XML, JSON, or CSV. The receiving system then consumes this data either by polling the source (periodically checking for new data) or by receiving automatic pushes, usually via a webhook, when new data is available.

The data is typically parsed, meaning each value is mapped to the correct field, and integrated into the receiving system's database or interface for display or further processing.

Data feed use cases

Data feeds are commonly categorized by the kind of content they carry and the systems they connect:

E-commerce data feeds: Share product details, like titles, descriptions, prices, availability, and images, across shopping channels.
Content syndication feeds: Publish updates from sites and blogs in formats that allow feed readers and other services to retrieve new content automatically.
Event and integration feeds: Send structured event data between services via APIs or webhooks, keeping connected systems in sync as activity occurs.
Financial feeds: Deliver live market data, stock prices, and trading signals to financial platforms and automated systems.
Threat intelligence feeds: Share structured data about cyber threats between security systems and organizations.

Security and privacy concerns

Data feeds introduce several security and privacy considerations, particularly when they carry sensitive or regulated information.

Inaccurate or manipulated data can lead to incorrect outputs, flawed decisions, or corrupted records.
Lack of authentication or access controls can expose sensitive data to unauthorized systems or users.
Unencrypted data can be intercepted or tampered with in transit.
Non-compliant use of a feed can result in fines, legal action, or loss of access.
Consuming feeds from external providers introduces dependency on their data quality and security practices.

FAQ

What is the difference between a data feed and an API?

A data feed is the stream of information itself. An API is the interface that lets software request, send, or receive that information. Some feeds are delivered through APIs, while others are shared as files.

Are data feeds secure by default?

No. A feed is only as secure as its transport, access controls, validation, and configuration. A feed that lacks proper authentication, integrity checks, or endpoint protection can expose data or spread malware.

What formats do data feeds use?

Common formats include JSON, CSV, and XML. Content syndication feeds often use RSS or Atom, while security feeds use STIX data exchanged through TAXII.

How are data feeds used in cybersecurity?

They’re used to share machine-readable threat indicators and related context between tools and organizations. That helps monitoring and defense systems detect known threats faster and respond more consistently.

Can a data feed expose private information?

Yes. A feed can expose sensitive information if it includes personally identifiable information (PII), is misconfigured, or is shared too broadly. That risk grows when automated systems move the data across multiple tools or partners.