Click data not recorded

Question

Click data not recorded

Closed this issue 7 years ago · 6 comments

Hello!

Thanks for sharing this! As a newbie to programming, I'm super excited to successfully build this by myself. However, I've noticed that everything is recording correctly but the "Click" data, which is always 0.

The only change I've made was removing the "dimensionFilterGroups" in config.py. Does this only happen to me or someone encounters the same issue as well? Which files should I look into to troubleshoot?

Thanks again!

Answer 1 · 2017-09-12T22:01:26.000Z

Where are you located? In the US? JR

…

On Tue, Sep 12, 2017 at 4:29 PM, DarrenHuangTW ***@***.***> wrote: Hello! Thanks for sharing this! As a newbie to programming, I'm super excited to successfully build this by myself. However, I've noticed that everything is recording correctly but the "Click" data, which is always 0. The only change I've made was removing the "dimensionFilterGroups" in config.py. Does this only happen to me or someone encounters the same issue as well? Which files should I look into to troubleshoot? Thanks again! — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#2>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AJuCuc7hXMt-bcrUAL8K9MVXk8kVmkSsks5shumRgaJpZM4PVM3n> .

Answer 2 · 2017-09-14T14:04:02.000Z

Yes, but my site visitors are mostly from Taiwan, which is why I remove the "dimensionFilterGroups" section. Could that be the reason why Clicks is not recorded? Thanks!

-Darren

Answer 3 · 2017-09-14T14:25:00.000Z

That is what I was thinking. I am not sure if there is a default for location. Can you send a sample of your config.py file and let me take a look? JR

…

On Thu, Sep 14, 2017 at 10:04 AM, DarrenHuangTW ***@***.***> wrote: Yes, but my site visitors are mostly from Taiwan, which is why I remove the "dimensionFilterGroups" section. Could that be the reason why Clicks is not recorded? Thanks! -Darren — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#2 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AJuCuUj3NBURPwA6_DckJWhnGiDSKqy5ks5siTJSgaJpZM4PVM3n> .

Answer 4 · 2017-09-14T14:47:16.000Z

Sure, I took some screenshots and copy/paste the code below, here's the link

Darren

`#!/usr/bin/env python

Path to your service credentials json file.

CREDENTIAL_SERVICE = "credentials/dh-gsc-logger-2-c8e6480a0d4c.json"

Your default scopes for GAE. Currently only BQ and GSC

DEFAULT_SCOPES = ["https://www.googleapis.com/auth/bigquery", "https://www.googleapis.com/auth/webmasters.readonly"]

Unique ID for your dataset.

DATASET_ID = 'dh_gsc_logger_2'

Since GCS data is dated, specify the offset from today.

OFFSET_DATE = 7

Should we auto remove DBs if we no longer have access.

Careful: Could lose data if you accidentally lose connection.

Databases can be removed manually at: https://bigquery.cloud.google.com/queries/gsc-logger

AUTO_REMOVE = False

Schema used to build the tables. If you change the data pulled from GSC, you must change this.

TABLE_SCHEMA = [
{"type": "DATE", "name": "date"},
{"type": "STRING", "name": "query"},
{"type": "STRING", "name": "page"},
{"type": "STRING", "name": "device"},
{"type": "INTEGER", "name": "clicks"},
{"type": "INTEGER", "name": "impressions"},
{"type": "FLOAT", "name": "ctr"},
{"type": "FLOAT", "name": "position"}
]

Friendly name prefix for tables.

TABLE_FRIENDLY_FRONT = "GSC Logger:"

How many retries to stream data into BigQuery

STREAM_RETRIES = 5

Whether the /cron/ path can be called publicly from the web. Should be False after testing.

ALLOW_OPEN_CRON = False

Hides Homepage data if true.

HIDE_HOMEPAGE = False

Set Timezone ('US/Eastern', 'US/Central', 'US/Pacific')

GSC_TIMEZONE = 'US/Eastern'

Base query for GSC. startDate and endDate are replaced upon call.

GSC_QUERY = {
"startDate": "2017-07-01",
"endDate": "2017-07-31",
"dimensions": [
"query",
"date",
"page",
"device"
],
"rowLimit": 5000
}
`

Answer 5 · 2017-09-14T17:49:53.000Z

Hey, I don't see aything right off the bat. I would probably try to test out the query here: https://developers.google.com/apis-explorer/#p/webmasters/v3/webmasters.searchanalytics.query Also, leave the dimensions order as-is as that is matched to the order when saving to BigQuery. Best, JR Oakes

…

On Thu, Sep 14, 2017 at 10:47 AM, DarrenHuangTW ***@***.***> wrote: Sure, I took some screenshots and copy/paste the code below, here's the link: https://imgur.com/a/wDaV4 <http://url> Darren ------------------------------ `#!/usr/bin/env python Path to your service credentials json file. CREDENTIAL_SERVICE = "credentials/dh-gsc-logger-2-c8e6480a0d4c.json" Your default scopes for GAE. Currently only BQ and GSC DEFAULT_SCOPES = ["https://www.googleapis.com/auth/bigquery", " https://www.googleapis.com/auth/webmasters.readonly"] Unique ID for your dataset. DATASET_ID = 'dh_gsc_logger_2' Since GCS data is dated, specify the offset from today. OFFSET_DATE = 7 Should we auto remove DBs if we no longer have access. Careful: Could lose data if you accidentally lose connection. Databases can be removed manually at: https://bigquery.cloud.google.com/queries/gsc-logger AUTO_REMOVE = False Schema used to build the tables. If you change the data pulled from GSC, you must change this. TABLE_SCHEMA = [ {"type": "DATE", "name": "date"}, {"type": "STRING", "name": "query"}, {"type": "STRING", "name": "page"}, {"type": "STRING", "name": "device"}, {"type": "INTEGER", "name": "clicks"}, {"type": "INTEGER", "name": "impressions"}, {"type": "FLOAT", "name": "ctr"}, {"type": "FLOAT", "name": "position"} ] Friendly name prefix for tables. TABLE_FRIENDLY_FRONT = "GSC Logger:" How many retries to stream data into BigQuery STREAM_RETRIES = 5 Whether the /cron/ path can be called publicly from the web. Should be False after testing. ALLOW_OPEN_CRON = False Hides Homepage data if true. HIDE_HOMEPAGE = False Set Timezone ('US/Eastern', 'US/Central', 'US/Pacific') GSC_TIMEZONE = 'US/Eastern' Base query for GSC. startDate and endDate are replaced upon call. GSC_QUERY = { "startDate": "2017-07-01", "endDate": "2017-07-31", "dimensions": [ "query", "date", "page", "device" ], "rowLimit": 5000 } ` — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#2 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AJuCuXp-1-kBYMkgIGZfNa5vVNAzbGnlks5siTx1gaJpZM4PVM3n> .

Answer 6 · 2017-09-14T18:01:06.000Z

Thanks JR,

I'll do more troubleshooting and let you know if any findings come up. Thanks again for your time and sharing this cool tip!

Best,
Darren Huang