In this workshopp we'll build a subgraph for querying NTF data from the Misfits smart contract, implementing queries for fetching NFTs as well as their owners, and building relationships between them.
You can view the example codebase we will be building here.
To be successful in this tutorial, you should have Node.js installed on your machine. These days, I recommend using either nvm or fnm to manage Node.js versions.
To get started, open The Graph dashboard and either sign in or create a new account.
Next, click on Add Subgraph to create a new subgraph.
Configure your subgraph with the following properties:
- Subgraph Name - Nearmisfits
- Subtitle - A subgraph for querying NFTs
- Optional - Fill the description and GITHUB URL properties
Once the subgraph is created, we will initialize the subgraph locally using the Graph CLI.
Next, install the Graph CLI:
$ npm install -g @graphprotocol/graph-cli
# or
$ yarn global add @graphprotocol/graph-cliOnce the Graph CLI has been installed you can initialize a new subgraph with the Graph CLI init command.
There are two ways to initialize a new subgraph:
1 - From an example subgraph
$ graph init --from-example <GITHUB_USERNAME>/<SUBGRAPH_NAME> [<DIRECTORY>]2 - From an existing smart contract
If you already have a smart contract deployed to Ethereum mainnet or one of the testnets, initializing a new subgraph from this contract is an easy way to get up and running.
$ graph init --from-contract <CONTRACT_ADDRESS> \
[--network <ETHEREUM_NETWORK>] \
[--abi <FILE>] \
<GITHUB_USER>/<SUBGRAPH_NAME> [<DIRECTORY>]In our case we'll be starting with the Misfits NFT contract so we can initialize from that contract address by passing in the contract address using the --from-contract flag:
$ graph init --from-contract misfits.tenk.near --contract-name Token
? Protocol › near
? Subgraph name › your-username/nearmisfits
? Directory to create the subgraph in › nearmisfits
? NEAR network › near-mainnet
? Contract account › misfits.tenk.near
? Contract Name · TokenThis command will generate a basic subgraph based off of the contract address passed in as the argument to --from-contract. By using this contract address, the CLI will initialize a few things in your project to get you started.
The main configuration and definition for the subgraph lives in the subgraph.yaml file. The subgraph codebase consists of a few files:
- subgraph.yaml: a YAML file containing the subgraph manifest
- schema.graphql: a GraphQL schema that defines what data is stored for your subgraph, and how to query it via GraphQL
- AssemblyScript Mappings: AssemblyScript code that translates from the event data in Ethereum to the entities defined in your schema (e.g. mapping.ts in this tutorial)
The entries in subgraph.yaml that we will be working with are:
description(optional): a human-readable description of what the subgraph is. This description is displayed by the Graph Explorer when the subgraph is deployed to the Hosted Service.dataSources.source: the address of the account that the subgraph sources.dataSources.source.startBlock(optional): the number of the block that the data source starts indexing from. In most cases we suggest using the block in which the contract was created.dataSources.mapping.entities: the entities that the data source writes to the store. The schema for each entity is defined in the the schema.graphql file.dataSources.mapping.receiptHandlers: lists the receipts this subgraph reacts to and the handlers in the mapping — ./src/mapping.ts in the example — that transform these events into entities in the store.
With The Graph, you define entity types in schema.graphql, and Graph Node will generate top level fields for querying single instances and collections of that entity type. Each type that should be an entity is required to be annotated with an @entity directive.
The entities / data we will be indexing are the Token and User. This way we can index the Tokens created by the users as well as the users themselves. We'll also enable full text search for searching by account name as well as the kind of Misfit NFT.
To do this, update schema.graphql with the following code:
type _Schema_
@fulltext(
name: "tokenSearch"
language: en
algorithm: rank
include: [{ entity: "Token", fields: [{ name: "ownerId" }, { name: "kind" }] }]
)
type Token @entity {
id: ID!
owner: User!
ownerId: String!
tokenId: String!
image: String!
metadata: String!
kind: String!
seed: Int!
}
type User @entity {
id: ID!
tokens: [Token!]! @derivedFrom(field: "owner")
}Reverse lookups can be defined on an entity through the @derivedFrom field. This creates a virtual field on the entity that may be queried but cannot be set manually through the mappings API. Rather, it is derived from the relationship defined on the other entity. For such relationships, it rarely makes sense to store both sides of the relationship, and both indexing and query performance will be better when only one side is stored and the other is derived.
For one-to-many relationships, the relationship should always be stored on the 'one' side, and the 'many' side should always be derived. Storing the relationship this way, rather than storing an array of entities on the 'many' side, will result in dramatically better performance for both indexing and querying the subgraph. In general, storing arrays of entities should be avoided as much as is practical.
Now that we have created the GraphQL schema for our app, we can generate the entities locally to start using in the mappings created by the CLI:
graph codegenIn order to make working smart contracts, events and entities easy and type-safe, the Graph CLI generates AssemblyScript types from a combination of the subgraph's GraphQL schema and the contract ABIs included in the data sources.
Now we can configure the subgraph.yaml to use the entities that we have just created and configure their mappings.
To do so, first update the dataSources.mapping.entities field with the User and Token entities:
entities:
- Token
- UserNext, update the configuration to add the startBlock and change the contract address to the main proxy contract address:
source:
account: "misfits.tenk.near"
startBlock: 53472065Next, we'll want to enable a couple of features like Full Text Search as well as the IPFS API.
To do this, add the following feature flags as top level configurations (after the schema declaration):
features:
- ipfsOnEthereumContracts
- fullTextSearchFinally, update the specVersion to be 0.0.4:
specVersion: 0.0.4The final subgraph.yaml should look like this:
specVersion: 0.0.4
schema:
file: ./schema.graphql
features:
- ipfsOnEthereumContracts
- fullTextSearch
dataSources:
- kind: near
name: Token
network: near-mainnet
source:
account: "misfits.tenk.near"
startBlock: 53472065
mapping:
apiVersion: 0.0.5
language: wasm/assemblyscript
entities:
- Token
- User
receiptHandlers:
- handler: handleReceipt
file: ./src/mapping.ts
Next, open src/mappings.ts to write the mappings that we defined in our subgraph subgraph eventHandlers.
Update the file with the following code:
import { near, JSONValue, json, ipfs, log } from "@graphprotocol/graph-ts"
import { Token, User } from "../generated/schema"
export function handleReceipt(
receipt: near.ReceiptWithOutcome
): void {
const actions = receipt.receipt.actions;
for (let i = 0; i < actions.length; i++) {
handleAction(actions[i], receipt)
}
}
function handleAction(
action: near.ActionValue,
receiptWithOutcome: near.ReceiptWithOutcome
): void {
if (action.kind != near.ActionKind.FUNCTION_CALL) {
return;
}
const outcome = receiptWithOutcome.outcome;
const functionCall = action.toFunctionCall();
const ipfsHash = 'bafybeiew2l6admor2lx6vnfdaevuuenzgeyrpfle56yrgse4u6nnkwrfeu'
const methodName = functionCall.methodName
if (methodName == 'buy' || methodName == 'nft_mint_one') {
for (let logIndex = 0; logIndex < outcome.logs.length; logIndex++) {
const outcomeLog = outcome.logs[logIndex].toString();
log.info('outcomeLog {}', [outcomeLog])
const parsed = outcomeLog.replace('EVENT_JSON:', '')
const jsonData = json.try_fromString(parsed)
const jsonObject = jsonData.value.toObject()
const eventData = jsonObject.get('data')
if (eventData) {
const eventArray:JSONValue[] = eventData.toArray()
const data = eventArray[0].toObject()
const tokenIds = data.get('token_ids')
const owner_id = data.get('owner_id')
if (!tokenIds || !owner_id) return
const ids:JSONValue[] = tokenIds.toArray()
const tokenId = ids[0].toString()
let token = Token.load(tokenId)
if (!token) {
token = new Token(tokenId)
token.tokenId = tokenId
token.image = ipfsHash + '/' + tokenId + '.png'
const metadata = ipfsHash + '/' + tokenId + '.json'
token.metadata = metadata
const metadataResult = ipfs.cat(metadata)
if (metadataResult) {
const value = json.fromBytes(metadataResult).toObject()
if (value) {
const kind = value.get('kind')
if (kind) {
token.kind = kind.toString()
}
const seed = value.get('seed')
if (seed) {
token.seed = seed.toI64() as i32
}
}
}
}
token.ownerId = owner_id.toString()
token.owner = owner_id.toString()
let user = User.load(owner_id.toString())
if (!user) {
user = new User(owner_id.toString())
}
token.save()
user.save()
}
}
}
}These mappings will handle events for when a new token is minted or bought. When these actions happen, the mappings will save the data into the subgraph.
Next, let's run a build to make sure that everything is configured properly. To do so, run the build command:
$ graph buildIf the build is successful, you should see a new build folder generated in your root directory.
To deploy, we can run the deploy command using the Graph CLI. To deploy, you will first need to copy the Access token for your account, available in The Graph dashboard:
Next, run the following command:
$ graph auth https://api.thegraph.com/deploy/ <ACCESS_TOKEN>
$ yarn deployOnce the subgraph is deployed, you should see it show up in your dashboard:
When you click on the subgraph, it should open the Graph explorer:
Now that we are in the dashboard, we should be able to start querying for data. Run the following query to get a list of tokens and their metadata:
{
tokens {
id
ownerId
tokenId
image
metadata
image
kind
seed
}
}We can also configure the order direction:
{
tokens(
orderBy:id,
orderDirection: desc
) {
id
ownerId
tokenId
image
metadata
image
kind
seed
}
}Or choose to skip forward a certain number of results to implement some basic pagination:
{
tokens(
skip: 100,
orderBy:id,
orderDirection: desc
) {
id
owner
tokenId
image
metadata
image
kind
seed
}
}Or query for users and their associated content:
{
users {
id
tokens {
id
ownerId
tokenId
image
metadata
image
kind
seed
}
}
}We can also with full text search:
{
tokenSearch(text: "Normies") {
id
ownerId
tokenId
image
metadata
image
kind
seed
}
}