Does GAM (Generalized Additive Model) have collinearity problem?
$begingroup$
There is collinearity effect in linear regression methods. For example, this question is about collinear predictors in GLM.
But GAMs are nonlinear, do we need to check the collinearity of independent variables before using GAMs?
generalized-linear-model gam
asked 5 hours ago
T XT X
353
$endgroup$
add a comment |
$begingroup$
There is collinearity effect in linear regression methods. For example, this question is about collinear predictors in GLM.
But GAMs are nonlinear, do we need to check the collinearity of independent variables before using GAMs?
generalized-linear-model gam
asked 5 hours ago
T XT X
353
$endgroup$
add a comment |
$begingroup$
There is collinearity effect in linear regression methods. For example, this question is about collinear predictors in GLM.
But GAMs are nonlinear, do we need to check the collinearity of independent variables before using GAMs?
generalized-linear-model gam
asked 5 hours ago
T XT X
353
$endgroup$
There is collinearity effect in linear regression methods. For example, this question is about collinear predictors in GLM.
But GAMs are nonlinear, do we need to check the collinearity of independent variables before using GAMs?
generalized-linear-model gam
generalized-linear-model gam
asked 5 hours ago
T XT X
353
asked 5 hours ago
T XT X
353
asked 5 hours ago
T XT X
353
asked 5 hours ago
T XT X
353
asked 5 hours ago
T XT X
353
353
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
GAM models can be afflicted by concurvity (the extension of GLM collinearity to GAM models).
According to https://stat.ethz.ch/R-manual/R-devel/library/mgcv/html/concurvity.html:
"Concurvity occurs when some smooth term in a model could be approximated by
one or more of the other smooth terms in the model. This is often the case
when a smooth of space is included in a model, along with smooths of other
covariates that also vary more or less smoothly in space. Similarly it tends
to be an issue in models including a smooth of time, along with smooths of
other time varying covariates.
Concurvity can be viewed as a generalization of co-linearity, and causes
similar problems of interpretation. It can also make estimates somewhat
unstable (so that they become sensitive to apparently innocuous modelling
details, for example)."
The above link explains how you can compute three different measures of concurvity for a GAM model fitted with the mgcv package in R, all of which are bounded between 0 and 1 (with 0 indicating no concurvity).
Thus, you do have to check for the potential presence of concurvity in your GAM models by computing appropriate measures of concurvity and making sure they are not too high (i.e., not too close to 1). See also gam smoother vs parametric term (concurvity difference), https://jroy042.github.io/nonlinear/week3.html and https://eric-pedersen.github.io/mgcv-esa-workshop/slides/02-model_checking.html#/.
answered 1 hour ago
Isabella GhementIsabella Ghement
7,618422
$endgroup$
add a comment |
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "65"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f400395%2fdoes-gam-generalized-additive-model-have-collinearity-problem%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
GAM models can be afflicted by concurvity (the extension of GLM collinearity to GAM models).
According to https://stat.ethz.ch/R-manual/R-devel/library/mgcv/html/concurvity.html:
"Concurvity occurs when some smooth term in a model could be approximated by
one or more of the other smooth terms in the model. This is often the case
when a smooth of space is included in a model, along with smooths of other
covariates that also vary more or less smoothly in space. Similarly it tends
to be an issue in models including a smooth of time, along with smooths of
other time varying covariates.
Concurvity can be viewed as a generalization of co-linearity, and causes
similar problems of interpretation. It can also make estimates somewhat
unstable (so that they become sensitive to apparently innocuous modelling
details, for example)."
The above link explains how you can compute three different measures of concurvity for a GAM model fitted with the mgcv package in R, all of which are bounded between 0 and 1 (with 0 indicating no concurvity).
Thus, you do have to check for the potential presence of concurvity in your GAM models by computing appropriate measures of concurvity and making sure they are not too high (i.e., not too close to 1). See also gam smoother vs parametric term (concurvity difference), https://jroy042.github.io/nonlinear/week3.html and https://eric-pedersen.github.io/mgcv-esa-workshop/slides/02-model_checking.html#/.
answered 1 hour ago
Isabella GhementIsabella Ghement
7,618422
$endgroup$
add a comment |
$begingroup$
GAM models can be afflicted by concurvity (the extension of GLM collinearity to GAM models).
According to https://stat.ethz.ch/R-manual/R-devel/library/mgcv/html/concurvity.html:
"Concurvity occurs when some smooth term in a model could be approximated by
one or more of the other smooth terms in the model. This is often the case
when a smooth of space is included in a model, along with smooths of other
covariates that also vary more or less smoothly in space. Similarly it tends
to be an issue in models including a smooth of time, along with smooths of
other time varying covariates.
Concurvity can be viewed as a generalization of co-linearity, and causes
similar problems of interpretation. It can also make estimates somewhat
unstable (so that they become sensitive to apparently innocuous modelling
details, for example)."
The above link explains how you can compute three different measures of concurvity for a GAM model fitted with the mgcv package in R, all of which are bounded between 0 and 1 (with 0 indicating no concurvity).
Thus, you do have to check for the potential presence of concurvity in your GAM models by computing appropriate measures of concurvity and making sure they are not too high (i.e., not too close to 1). See also gam smoother vs parametric term (concurvity difference), https://jroy042.github.io/nonlinear/week3.html and https://eric-pedersen.github.io/mgcv-esa-workshop/slides/02-model_checking.html#/.
answered 1 hour ago
Isabella GhementIsabella Ghement
7,618422
$endgroup$
add a comment |
$begingroup$
GAM models can be afflicted by concurvity (the extension of GLM collinearity to GAM models).
According to https://stat.ethz.ch/R-manual/R-devel/library/mgcv/html/concurvity.html:
"Concurvity occurs when some smooth term in a model could be approximated by
one or more of the other smooth terms in the model. This is often the case
when a smooth of space is included in a model, along with smooths of other
covariates that also vary more or less smoothly in space. Similarly it tends
to be an issue in models including a smooth of time, along with smooths of
other time varying covariates.
Concurvity can be viewed as a generalization of co-linearity, and causes
similar problems of interpretation. It can also make estimates somewhat
unstable (so that they become sensitive to apparently innocuous modelling
details, for example)."
The above link explains how you can compute three different measures of concurvity for a GAM model fitted with the mgcv package in R, all of which are bounded between 0 and 1 (with 0 indicating no concurvity).
Thus, you do have to check for the potential presence of concurvity in your GAM models by computing appropriate measures of concurvity and making sure they are not too high (i.e., not too close to 1). See also gam smoother vs parametric term (concurvity difference), https://jroy042.github.io/nonlinear/week3.html and https://eric-pedersen.github.io/mgcv-esa-workshop/slides/02-model_checking.html#/.
answered 1 hour ago
Isabella GhementIsabella Ghement
7,618422
$endgroup$
GAM models can be afflicted by concurvity (the extension of GLM collinearity to GAM models).
According to https://stat.ethz.ch/R-manual/R-devel/library/mgcv/html/concurvity.html:
"Concurvity occurs when some smooth term in a model could be approximated by
one or more of the other smooth terms in the model. This is often the case
when a smooth of space is included in a model, along with smooths of other
covariates that also vary more or less smoothly in space. Similarly it tends
to be an issue in models including a smooth of time, along with smooths of
other time varying covariates.
Concurvity can be viewed as a generalization of co-linearity, and causes
similar problems of interpretation. It can also make estimates somewhat
unstable (so that they become sensitive to apparently innocuous modelling
details, for example)."
The above link explains how you can compute three different measures of concurvity for a GAM model fitted with the mgcv package in R, all of which are bounded between 0 and 1 (with 0 indicating no concurvity).
Thus, you do have to check for the potential presence of concurvity in your GAM models by computing appropriate measures of concurvity and making sure they are not too high (i.e., not too close to 1). See also gam smoother vs parametric term (concurvity difference), https://jroy042.github.io/nonlinear/week3.html and https://eric-pedersen.github.io/mgcv-esa-workshop/slides/02-model_checking.html#/.
answered 1 hour ago
Isabella GhementIsabella Ghement
7,618422
edited 1 hour ago
answered 1 hour ago
Isabella GhementIsabella Ghement
7,618422
answered 1 hour ago
Isabella GhementIsabella Ghement
7,618422
answered 1 hour ago
Isabella GhementIsabella Ghement
7,618422
7,618422
add a comment |
add a comment |
Thanks for contributing an answer to Cross Validated!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f400395%2fdoes-gam-generalized-additive-model-have-collinearity-problem%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
