Python Selenium web scraping path
-3
How do I convert the above to selenium xpath?
I tried:
"//ul[@id = 'productsCatalog AND @class = 'b-catalogList_wrapper clearfix']"
but it gives an error
python selenium xpath css-selectors webdriverwait
edited Nov 25 '18 at 16:57
DebanjanB
43.9k114386
asked Nov 25 '18 at 8:31
C.LLC.LL
12
add a comment |
-3
How do I convert the above to selenium xpath?
I tried:
"//ul[@id = 'productsCatalog AND @class = 'b-catalogList_wrapper clearfix']"
but it gives an error
python selenium xpath css-selectors webdriverwait
edited Nov 25 '18 at 16:57
DebanjanB
43.9k114386
asked Nov 25 '18 at 8:31
C.LLC.LL
12
1
1- This is alreadyxpath2- What is the error? 3- Post html as text, not image 4- You have an ID, why do you usexpathin the first place?
– Guy
Nov 25 '18 at 8:50
1
Please do not post code, error messages, data as a picture, post the text directly here on SO.
– Mr. T
Nov 25 '18 at 11:23
add a comment |
-3
-3
-3
How do I convert the above to selenium xpath?
I tried:
"//ul[@id = 'productsCatalog AND @class = 'b-catalogList_wrapper clearfix']"
but it gives an error
python selenium xpath css-selectors webdriverwait
edited Nov 25 '18 at 16:57
DebanjanB
43.9k114386
asked Nov 25 '18 at 8:31
C.LLC.LL
12
How do I convert the above to selenium xpath?
I tried:
"//ul[@id = 'productsCatalog AND @class = 'b-catalogList_wrapper clearfix']"
but it gives an error
python selenium xpath css-selectors webdriverwait
python selenium xpath css-selectors webdriverwait
edited Nov 25 '18 at 16:57
DebanjanB
43.9k114386
asked Nov 25 '18 at 8:31
C.LLC.LL
12
edited Nov 25 '18 at 16:57
DebanjanB
43.9k114386
asked Nov 25 '18 at 8:31
C.LLC.LL
12
edited Nov 25 '18 at 16:57
DebanjanB
43.9k114386
edited Nov 25 '18 at 16:57
DebanjanB
43.9k114386
edited Nov 25 '18 at 16:57
DebanjanB
43.9k114386
43.9k114386
asked Nov 25 '18 at 8:31
C.LLC.LL
12
asked Nov 25 '18 at 8:31
C.LLC.LL
12
asked Nov 25 '18 at 8:31
C.LLC.LL
12
12
1
1- This is alreadyxpath2- What is the error? 3- Post html as text, not image 4- You have an ID, why do you usexpathin the first place?
– Guy
Nov 25 '18 at 8:50
1
Please do not post code, error messages, data as a picture, post the text directly here on SO.
– Mr. T
Nov 25 '18 at 11:23
add a comment |
1
1- This is alreadyxpath2- What is the error? 3- Post html as text, not image 4- You have an ID, why do you usexpathin the first place?
– Guy
Nov 25 '18 at 8:50
1
Please do not post code, error messages, data as a picture, post the text directly here on SO.
– Mr. T
Nov 25 '18 at 11:23
1
1
1- This is already
xpath 2- What is the error? 3- Post html as text, not image 4- You have an ID, why do you use xpath in the first place?– Guy
Nov 25 '18 at 8:50
1- This is already
xpath 2- What is the error? 3- Post html as text, not image 4- You have an ID, why do you use xpath in the first place?– Guy
Nov 25 '18 at 8:50
1
1
Please do not post code, error messages, data as a picture, post the text directly here on SO.
– Mr. T
Nov 25 '18 at 11:23
Please do not post code, error messages, data as a picture, post the text directly here on SO.
– Mr. T
Nov 25 '18 at 11:23
add a comment |
1 Answer
1
active
oldest
votes
0
As per the HTML you have shared the element is a dynamic element so you have to induce WebDriverWait for the element to be visible and you can use either of the following solutions:
CSS_SELECTOR:
element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "ul.b-catalogList_wrapper.clearfix#productsCatalog")))
XPATH:
element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//ul[@class = 'b-catalogList_wrapper clearfix' and @id ='productsCatalog']")))
Note: You have to add the following imports :
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
answered Nov 25 '18 at 16:58
DebanjanBDebanjanB
43.9k114386
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53465850%2fpython-selenium-web-scraping-path%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
0
As per the HTML you have shared the element is a dynamic element so you have to induce WebDriverWait for the element to be visible and you can use either of the following solutions:
CSS_SELECTOR:
element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "ul.b-catalogList_wrapper.clearfix#productsCatalog")))
XPATH:
element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//ul[@class = 'b-catalogList_wrapper clearfix' and @id ='productsCatalog']")))
Note: You have to add the following imports :
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
answered Nov 25 '18 at 16:58
DebanjanBDebanjanB
43.9k114386
add a comment |
0
As per the HTML you have shared the element is a dynamic element so you have to induce WebDriverWait for the element to be visible and you can use either of the following solutions:
CSS_SELECTOR:
element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "ul.b-catalogList_wrapper.clearfix#productsCatalog")))
XPATH:
element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//ul[@class = 'b-catalogList_wrapper clearfix' and @id ='productsCatalog']")))
Note: You have to add the following imports :
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
answered Nov 25 '18 at 16:58
DebanjanBDebanjanB
43.9k114386
add a comment |
0
0
0
As per the HTML you have shared the element is a dynamic element so you have to induce WebDriverWait for the element to be visible and you can use either of the following solutions:
CSS_SELECTOR:
element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "ul.b-catalogList_wrapper.clearfix#productsCatalog")))
XPATH:
element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//ul[@class = 'b-catalogList_wrapper clearfix' and @id ='productsCatalog']")))
Note: You have to add the following imports :
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
answered Nov 25 '18 at 16:58
DebanjanBDebanjanB
43.9k114386
As per the HTML you have shared the element is a dynamic element so you have to induce WebDriverWait for the element to be visible and you can use either of the following solutions:
CSS_SELECTOR:
element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "ul.b-catalogList_wrapper.clearfix#productsCatalog")))
XPATH:
element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//ul[@class = 'b-catalogList_wrapper clearfix' and @id ='productsCatalog']")))
Note: You have to add the following imports :
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
answered Nov 25 '18 at 16:58
DebanjanBDebanjanB
43.9k114386
answered Nov 25 '18 at 16:58
DebanjanBDebanjanB
43.9k114386
answered Nov 25 '18 at 16:58
DebanjanBDebanjanB
43.9k114386
answered Nov 25 '18 at 16:58
DebanjanBDebanjanB
43.9k114386
43.9k114386
add a comment |
add a comment |
draft saved
draft discarded
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53465850%2fpython-selenium-web-scraping-path%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
1- This is already
xpath2- What is the error? 3- Post html as text, not image 4- You have an ID, why do you usexpathin the first place?– Guy
Nov 25 '18 at 8:50
1
Please do not post code, error messages, data as a picture, post the text directly here on SO.
– Mr. T
Nov 25 '18 at 11:23