/Household-Object-Organization

This code repository is the code for the thesis "Transformer-Based Relationship Inference Model for Household Object Organization by Integrating Graph Topological and Ontological Information" accepted by IROS2024

Primary LanguagePython

Transformer-Based Relationship Inference Model for Household Object Organization by Integrating Graph Topological and Ontological Information

This code repository is the code for the thesis "Transformer-Based Relationship Inference Model for Household Object Organization by Integrating Graph Topological and Ontological Information", this thesis uses GAT to obtain the topology information of the household item relationship graph as well as BERT to obtain the ontology attribute information of the household items, after fusing the two kinds of information, it uses the Transformer model to train an item-relationship inference model. Thus, the relationship information between items can be accurately reasoned. The dataset constructed in this paper is not open source, but provides a sample data in the file "BERT_Input.json", and our dataset is sorted according to this format.

1. INSTALLATION

First, install the dependent python environments using the following commands

conda env create -f environment.yml

2.USAGE

Although we did not provide the original dataset, we provide the topological eigenvectors after encoding the original dataset with the GAT, GAE, GCN, and GraphSAGE models, which are available for download at the following address:

GAT_Embedding

GAE_Embedding

GCN_Embedding

GraphSAGE_Embedding

BERT_Input.

Download the above json file and put it in the root directory

After downloading the above files, you can run the following commands to train the model:

python train.py