StreamingFast Firehose frequently asked questions
Firehose is an extremely efficient blockchain data indexing solution. Rich data is extracted from blockchain nodes and saved to simple flat files providing capture and processing speeds previously thought to be impossible. Firehose is primarily written in the Go programming language and takes full advantage of the parallel computing aspects available. Firehose makes paramount improvements in the speed and performance of data availability for any blockchain.
Firehose is available for developers creating decentralized applications, creating blockchain data-related solutions, or wanting to capture data from non-Firehose instrumented blockchains.
Substreams and Firehose can be used together and typically are. The two complement each other in terms of the functionality they provide. Substreams uses blockchain data extracted and provided by Firehose. Firehose is responsible for extraction and provision and Substreams handles transforming and manipulating the data.
Firehose does not work directly with GraphQL. Subgraphs use GraphQL and Substreams can be used to populate subgraphs. Firehose extracts data from blockchain nodes and provides it to Substreams. Substreams sinks are responsible for bringing data to storage engines that can then be queries by different means.
In a way, the
graph-nodesoftware, which powers Subgraphs, can connect directly to Firehose for Ethereum and Cosmos, and power the traditional Subgraphs there. Substreams can also be used directly to power Subgraphs, in which case Firehose is not directly involved (only as an implementation detail within Substreams).
Firehose was created by StreamingFast working as a core developer with The Graph Foundation.
Authentication tokens are required to connect to the public Firehose endpoint provided by StreamingFast made available to developers for testing. Full instructions for obtaining a StreamingFast authentication token are available in the Substreams documentation.
The StreamingFast team is available in Discord to assist with problems related to obtaining or using authentication tokens.
The authentication documentation also provides general instructions surrounding authentication tokens.
Firehose is made available as an open-source project, published under the Apache 2.0 license. As such, there are no direct fees involved. Running the Firehose and serving live blockchain data is a service that is offered by StreamingFast and other providers, with the goal of being served directly on The Graph network.
StreamingFast was originally called dfuse. The company changed the name and is in the process of phasing the old brand out.
The public StreamingFast endpoints are rate-limited and offer no guaranteed support or SLAs. Reach out to us for production usage keys.