emeryberger/CSrankings

Add SIGGRAPH / SIGGRAPH Asia conference track

przem-research opened this issue · 5 comments

Dear Emery

Request: SIGGRAPH/SIGGRAPH Asia Conference papers are currently not counted. Please add.

Justification: SIGGRAPH introduced a new conference track, which is not published in the TOG journal. The conference papers are top tier full papers limited to 7 pages. They undergo the same rigorous review as journal papers and are comparable to conference papers in other disciplines (CVPR, ICLR, ICML, etc.).

See description:

Aren't these confs already included under the Interdisciplinary Areas?

yssl commented

SIGGRAPH / SIGGRAPH Asia are already included in the list, but I guess the problem is that CSRankings counts SIGGRAPH / SIGGRAPH Asia papers only under the "ACM Trans. Graph." title.
https://github.com/emeryberger/CSrankings/blob/774a52c6e868f0cffef39ca6b639ca67ba09a469/util/regenerate_data.py#L209C37-L209C56

As przem-research said, the conference track papers are not published to TOG, so they are just listed under the conference name in DBLP, like my recent SIGGRAPH Asia conference paper:
https://dblp.org/rec/conf/siggrapha/KwonGA023.html

I believe the code for handling articles requires an update.

@yssl Yes, this is exactly what I am saying. The conference track papers are not fetched from DBLP and hence not counted.

@Xovee : I am not saying SIGGRAPH / Asia are not included, I am saying the new track is not fetched because it does not publish in the TOG journal, instead it is published in separate proceedings.

This is more of an technical issue and @yssl correctly says a code update could fix it.

@yssl Yes, this is exactly what I am saying. The conference track papers are not fetched from DBLP and hence not counted.

@Xovee : I am not saying SIGGRAPH / Asia are not included, I am saying the new track is not fetched because it does not publish in the TOG journal, instead it is published in separate proceedings.

This is more of an technical issue and @yssl correctly says a code update could fix it.

Thanks for the replay. Csrankings is relied on dblp's data/api structures and there seems no way to automatically address this.

yssl commented

@przem-research, @Xovee: After a closer examination of the code, it appears that the following line is not just counting TOG papers for SIGGRAPH / SIGGRAPH Asia, but is actually intended to count papers marked as TOG in DBLP that are from SIGGRAPH / SIGGRAPH Asia:

elif confname == Conference("ACM Trans. Graph."):

According to the next line, both string 'ACM Trans. Graph.' and 'SIGGRAPH' are considered part of the 'siggraph' area, while 'ACM Trans. Graph.' and 'SIGGRAPH Asia' are both considered part of the 'siggraph-asia' area:

Area("siggraph"): [Conference("ACM Trans. Graph."), Conference("SIGGRAPH")],

The area items mentioned above are used in the next line to construct the confdict, which maps the actual conference name strings to conference areas (i.e., confdict['ACM Trans. Graph.'] = 'siggraph', confdict['SIGGRAPH'] = 'siggraph', confdict['ACM Trans. Graph.'] = 'siggraph-asia', `confdict['SIGGRAPH Asia'] = 'siggraph-asia'. Maybe confdict['ACM Trans. Graph.'] is overwrited.).

confdict = {}

And the next line retrieves the booktitle or journal attribute from each DBLP item and save it in confname variable,

if "booktitle" in article:

And the next line stops processing if the confname retrieved from DBLP does not exist in the confdict, which includes only the conferences counted by csrankings. This part is likely responsible for filtering out the papers to be counted:

if confname not in confdict:

In the data source used by csrankings, https://dblp.org/xml/dblp.xml.gz, TOG papers (whether they are SIGGRAPH, SIGGRAPH Asia papers, or pure TOG papers) have the following entry:
<journal>ACM Trans. Graph.</journal>

SIGGRAPH Asia Conference Track papers have the following entry:
<booktitle>SIGGRAPH Asia</booktitle>

And SIGGRAPH Conference Track papers have the following:
<booktitle>SIGGRAPH (Conference Paper Track)</booktitle>

Therefore, because 'SIGGRAPH', not 'SIGGRAPH (Conference Paper Track)' is stored in the confdict, it appears that SIGGRAPH conference track papers are currently not being counted.

However, what I don't understand is why SIGGRAPH Asia conference track papers, which have 'SIGGRAPH Asia' as the booktitle and are also listed as 'SIGGRAPH Asia' in the confdict, are not counted by csrankings.

I would be grateful if someone who is knowledgeable about the relevant sections of the code could review and modify it to ensure that papers from the SIGGRAPH and SIGGRAPH Asia conference tracks are also counted.