spark-submit: 403 error, client System:anonymous error
up vote
1
down vote
favorite
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?
apache-spark
kubernetes google-kubernetes-engine spark-submit edited Nov 19 at 19:11
Rico
24.8k94864
asked Nov 19 at 13:29
Tang Dexian
1314
add a comment |
up vote
1
down vote
favorite
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?
apache-spark
kubernetes google-kubernetes-engine spark-submit edited Nov 19 at 19:11
Rico
24.8k94864
asked Nov 19 at 13:29
Tang Dexian
1314
add a comment |
up vote
1
down vote
favorite
up vote
1
down vote
favorite
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?
apache-spark
kubernetes google-kubernetes-engine spark-submit edited Nov 19 at 19:11
Rico
24.8k94864
asked Nov 19 at 13:29
Tang Dexian
1314
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?
apache-spark
kubernetes google-kubernetes-engine spark-submit apache-spark
kubernetes google-kubernetes-engine spark-submit edited Nov 19 at 19:11
Rico
24.8k94864
asked Nov 19 at 13:29
Tang Dexian
1314
edited Nov 19 at 19:11
Rico
24.8k94864
asked Nov 19 at 13:29
Tang Dexian
1314
edited Nov 19 at 19:11
Rico
24.8k94864
edited Nov 19 at 19:11
Rico
24.8k94864
edited Nov 19 at 19:11
Rico
24.8k94864
24.8k94864
asked Nov 19 at 13:29
Tang Dexian
1314
asked Nov 19 at 13:29
Tang Dexian
1314
asked Nov 19 at 13:29
Tang Dexian
1314
1314
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
up vote
1
down vote
accepted
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized
Your credentials expire.
I do this
gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.
Sounds like a timing issue where your new credentials and getting propagated in the cluster.
answered Nov 19 at 19:13
Rico
24.8k94864
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
1
down vote
accepted
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized
Your credentials expire.
I do this
gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.
Sounds like a timing issue where your new credentials and getting propagated in the cluster.
answered Nov 19 at 19:13
Rico
24.8k94864
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
add a comment |
up vote
1
down vote
accepted
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized
Your credentials expire.
I do this
gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.
Sounds like a timing issue where your new credentials and getting propagated in the cluster.
answered Nov 19 at 19:13
Rico
24.8k94864
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
add a comment |
up vote
1
down vote
accepted
up vote
1
down vote
accepted
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized
Your credentials expire.
I do this
gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.
Sounds like a timing issue where your new credentials and getting propagated in the cluster.
answered Nov 19 at 19:13
Rico
24.8k94864
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized
Your credentials expire.
I do this
gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.
Sounds like a timing issue where your new credentials and getting propagated in the cluster.
answered Nov 19 at 19:13
Rico
24.8k94864
answered Nov 19 at 19:13
Rico
24.8k94864
answered Nov 19 at 19:13
Rico
24.8k94864
answered Nov 19 at 19:13
Rico
24.8k94864
24.8k94864
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
add a comment |
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
1
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53375690%2fspark-submit-403-error-client-systemanonymous-error%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
