How to filter out IP addresses from Google Analytics into Big Query
up vote
0
down vote
favorite
I realize that we are not able to filter ip addresses from Big Query, only Google Analytics but I have heard that I can create a custom dimension in GA with those IPs and use that custom dimension to filter them out in big query. Is this true or is there another way to do it without having to change the view that Big Query is pointing at?
Here is an example code for our users:
##standardSQL
WITH data AS (
SELECT fullVisitorId
FROM `olympicchannel-ga.168112989.ga_sessions*`
WHERE 1=1
AND [cast(parse_date('%Y%m%d', date) as date)=daterange]
AND NOT [bot_traffic]
AND trafficsource.source NOT IN ('platform.utest.com')
UNION ALL
SELECT fullVisitorId
FROM `olympicchannel-ga.178594195.ga_sessions*`
WHERE 1=1
AND [cast(parse_date('%Y%m%d', date) as date)=daterange]
AND NOT [bot_traffic]
AND trafficsource.source NOT IN ('platform.utest.com')
)
The first is our website users and the second is for our app, two different views.
sql filter google-analytics google-bigquery ip
add a comment |
up vote
0
down vote
favorite
I realize that we are not able to filter ip addresses from Big Query, only Google Analytics but I have heard that I can create a custom dimension in GA with those IPs and use that custom dimension to filter them out in big query. Is this true or is there another way to do it without having to change the view that Big Query is pointing at?
Here is an example code for our users:
##standardSQL
WITH data AS (
SELECT fullVisitorId
FROM `olympicchannel-ga.168112989.ga_sessions*`
WHERE 1=1
AND [cast(parse_date('%Y%m%d', date) as date)=daterange]
AND NOT [bot_traffic]
AND trafficsource.source NOT IN ('platform.utest.com')
UNION ALL
SELECT fullVisitorId
FROM `olympicchannel-ga.178594195.ga_sessions*`
WHERE 1=1
AND [cast(parse_date('%Y%m%d', date) as date)=daterange]
AND NOT [bot_traffic]
AND trafficsource.source NOT IN ('platform.utest.com')
)
The first is our website users and the second is for our app, two different views.
sql filter google-analytics google-bigquery ip
You're not allowed to keep IP addresses in GA regardless of the method you're using to get it into GA. Since the ToS states that PII is not allowed. I would suggest you add the filter to the view you're pulling the data from instead.
– XTOTHEL
Nov 19 at 17:25
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I realize that we are not able to filter ip addresses from Big Query, only Google Analytics but I have heard that I can create a custom dimension in GA with those IPs and use that custom dimension to filter them out in big query. Is this true or is there another way to do it without having to change the view that Big Query is pointing at?
Here is an example code for our users:
##standardSQL
WITH data AS (
SELECT fullVisitorId
FROM `olympicchannel-ga.168112989.ga_sessions*`
WHERE 1=1
AND [cast(parse_date('%Y%m%d', date) as date)=daterange]
AND NOT [bot_traffic]
AND trafficsource.source NOT IN ('platform.utest.com')
UNION ALL
SELECT fullVisitorId
FROM `olympicchannel-ga.178594195.ga_sessions*`
WHERE 1=1
AND [cast(parse_date('%Y%m%d', date) as date)=daterange]
AND NOT [bot_traffic]
AND trafficsource.source NOT IN ('platform.utest.com')
)
The first is our website users and the second is for our app, two different views.
sql filter google-analytics google-bigquery ip
I realize that we are not able to filter ip addresses from Big Query, only Google Analytics but I have heard that I can create a custom dimension in GA with those IPs and use that custom dimension to filter them out in big query. Is this true or is there another way to do it without having to change the view that Big Query is pointing at?
Here is an example code for our users:
##standardSQL
WITH data AS (
SELECT fullVisitorId
FROM `olympicchannel-ga.168112989.ga_sessions*`
WHERE 1=1
AND [cast(parse_date('%Y%m%d', date) as date)=daterange]
AND NOT [bot_traffic]
AND trafficsource.source NOT IN ('platform.utest.com')
UNION ALL
SELECT fullVisitorId
FROM `olympicchannel-ga.178594195.ga_sessions*`
WHERE 1=1
AND [cast(parse_date('%Y%m%d', date) as date)=daterange]
AND NOT [bot_traffic]
AND trafficsource.source NOT IN ('platform.utest.com')
)
The first is our website users and the second is for our app, two different views.
sql filter google-analytics google-bigquery ip
sql filter google-analytics google-bigquery ip
asked Nov 19 at 11:16
Cris Pineda
32
32
You're not allowed to keep IP addresses in GA regardless of the method you're using to get it into GA. Since the ToS states that PII is not allowed. I would suggest you add the filter to the view you're pulling the data from instead.
– XTOTHEL
Nov 19 at 17:25
add a comment |
You're not allowed to keep IP addresses in GA regardless of the method you're using to get it into GA. Since the ToS states that PII is not allowed. I would suggest you add the filter to the view you're pulling the data from instead.
– XTOTHEL
Nov 19 at 17:25
You're not allowed to keep IP addresses in GA regardless of the method you're using to get it into GA. Since the ToS states that PII is not allowed. I would suggest you add the filter to the view you're pulling the data from instead.
– XTOTHEL
Nov 19 at 17:25
You're not allowed to keep IP addresses in GA regardless of the method you're using to get it into GA. Since the ToS states that PII is not allowed. I would suggest you add the filter to the view you're pulling the data from instead.
– XTOTHEL
Nov 19 at 17:25
add a comment |
1 Answer
1
active
oldest
votes
up vote
1
down vote
You´re not allowed to save IP as GA custom Dimension
Even if you were technically able to do so I would rather use the exclude IP functionality within GA admin Section. see
If you´re in Europe you may have to send anonymised ip to GA, see IP Anonymization in Analytics
in this case you probably want to create a variable in the dataLayer with the information Internal or External IP, push that to GA as a custom dimension with scope session and then exclude that afterwards in BQ.
Another option would be to handle that directly in the Pixel container (e.g. Google Tag Manager...)
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
1
down vote
You´re not allowed to save IP as GA custom Dimension
Even if you were technically able to do so I would rather use the exclude IP functionality within GA admin Section. see
If you´re in Europe you may have to send anonymised ip to GA, see IP Anonymization in Analytics
in this case you probably want to create a variable in the dataLayer with the information Internal or External IP, push that to GA as a custom dimension with scope session and then exclude that afterwards in BQ.
Another option would be to handle that directly in the Pixel container (e.g. Google Tag Manager...)
add a comment |
up vote
1
down vote
You´re not allowed to save IP as GA custom Dimension
Even if you were technically able to do so I would rather use the exclude IP functionality within GA admin Section. see
If you´re in Europe you may have to send anonymised ip to GA, see IP Anonymization in Analytics
in this case you probably want to create a variable in the dataLayer with the information Internal or External IP, push that to GA as a custom dimension with scope session and then exclude that afterwards in BQ.
Another option would be to handle that directly in the Pixel container (e.g. Google Tag Manager...)
add a comment |
up vote
1
down vote
up vote
1
down vote
You´re not allowed to save IP as GA custom Dimension
Even if you were technically able to do so I would rather use the exclude IP functionality within GA admin Section. see
If you´re in Europe you may have to send anonymised ip to GA, see IP Anonymization in Analytics
in this case you probably want to create a variable in the dataLayer with the information Internal or External IP, push that to GA as a custom dimension with scope session and then exclude that afterwards in BQ.
Another option would be to handle that directly in the Pixel container (e.g. Google Tag Manager...)
You´re not allowed to save IP as GA custom Dimension
Even if you were technically able to do so I would rather use the exclude IP functionality within GA admin Section. see
If you´re in Europe you may have to send anonymised ip to GA, see IP Anonymization in Analytics
in this case you probably want to create a variable in the dataLayer with the information Internal or External IP, push that to GA as a custom dimension with scope session and then exclude that afterwards in BQ.
Another option would be to handle that directly in the Pixel container (e.g. Google Tag Manager...)
answered Nov 20 at 1:21
Shahin Ghannadian
627
627
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53373458%2fhow-to-filter-out-ip-addresses-from-google-analytics-into-big-query%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
You're not allowed to keep IP addresses in GA regardless of the method you're using to get it into GA. Since the ToS states that PII is not allowed. I would suggest you add the filter to the view you're pulling the data from instead.
– XTOTHEL
Nov 19 at 17:25