How to download an entire “bottomless” (AJAX) page?











up vote
0
down vote

favorite












Examples for bottomless pages:




  • YouTube comments (used to have pages, now bottomless. RePagination is powerless here.)

  • Quora.com answers.

  • Twitter feed.

  • Twitter tweet threads.

  • Twitter follow lists.

  • Instagram profiles.

  • Various other comment sections.

  • Reddit.com subreddits: List of threads.

  • (slightly different kind:) YouTube's “Show more replies” button that loads 10 comments at a time.

  • (deviation) Cascade all Quora subcomments.


One could scroll down (Windows: Press middle mouse key and move cursor down. A missing feature in Linux.) until reaching the bottom, but is there an automated way to do so?



How to download an entire bottomless page?



And if the page is literally bottomless such as Qz.com's website layout that jumps to the next article, maybe there should be a page limit of e.g. 20 pages.



What I attempt to achieve: Finding lost text on bottomless pages.










share|improve this question






















  • (personal opinion not in question text but in comments) I must say that I could never quite stand YouTube's AJAX comments. Especially now, they added “show more comment” bulk and removed the /all_comments?v= page in late 2015.
    – neverMind9
    Nov 19 at 11:08















up vote
0
down vote

favorite












Examples for bottomless pages:




  • YouTube comments (used to have pages, now bottomless. RePagination is powerless here.)

  • Quora.com answers.

  • Twitter feed.

  • Twitter tweet threads.

  • Twitter follow lists.

  • Instagram profiles.

  • Various other comment sections.

  • Reddit.com subreddits: List of threads.

  • (slightly different kind:) YouTube's “Show more replies” button that loads 10 comments at a time.

  • (deviation) Cascade all Quora subcomments.


One could scroll down (Windows: Press middle mouse key and move cursor down. A missing feature in Linux.) until reaching the bottom, but is there an automated way to do so?



How to download an entire bottomless page?



And if the page is literally bottomless such as Qz.com's website layout that jumps to the next article, maybe there should be a page limit of e.g. 20 pages.



What I attempt to achieve: Finding lost text on bottomless pages.










share|improve this question






















  • (personal opinion not in question text but in comments) I must say that I could never quite stand YouTube's AJAX comments. Especially now, they added “show more comment” bulk and removed the /all_comments?v= page in late 2015.
    – neverMind9
    Nov 19 at 11:08













up vote
0
down vote

favorite









up vote
0
down vote

favorite











Examples for bottomless pages:




  • YouTube comments (used to have pages, now bottomless. RePagination is powerless here.)

  • Quora.com answers.

  • Twitter feed.

  • Twitter tweet threads.

  • Twitter follow lists.

  • Instagram profiles.

  • Various other comment sections.

  • Reddit.com subreddits: List of threads.

  • (slightly different kind:) YouTube's “Show more replies” button that loads 10 comments at a time.

  • (deviation) Cascade all Quora subcomments.


One could scroll down (Windows: Press middle mouse key and move cursor down. A missing feature in Linux.) until reaching the bottom, but is there an automated way to do so?



How to download an entire bottomless page?



And if the page is literally bottomless such as Qz.com's website layout that jumps to the next article, maybe there should be a page limit of e.g. 20 pages.



What I attempt to achieve: Finding lost text on bottomless pages.










share|improve this question













Examples for bottomless pages:




  • YouTube comments (used to have pages, now bottomless. RePagination is powerless here.)

  • Quora.com answers.

  • Twitter feed.

  • Twitter tweet threads.

  • Twitter follow lists.

  • Instagram profiles.

  • Various other comment sections.

  • Reddit.com subreddits: List of threads.

  • (slightly different kind:) YouTube's “Show more replies” button that loads 10 comments at a time.

  • (deviation) Cascade all Quora subcomments.


One could scroll down (Windows: Press middle mouse key and move cursor down. A missing feature in Linux.) until reaching the bottom, but is there an automated way to do so?



How to download an entire bottomless page?



And if the page is literally bottomless such as Qz.com's website layout that jumps to the next article, maybe there should be a page limit of e.g. 20 pages.



What I attempt to achieve: Finding lost text on bottomless pages.







ajax web layout ajaxform






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Nov 19 at 11:06









neverMind9

1097




1097












  • (personal opinion not in question text but in comments) I must say that I could never quite stand YouTube's AJAX comments. Especially now, they added “show more comment” bulk and removed the /all_comments?v= page in late 2015.
    – neverMind9
    Nov 19 at 11:08


















  • (personal opinion not in question text but in comments) I must say that I could never quite stand YouTube's AJAX comments. Especially now, they added “show more comment” bulk and removed the /all_comments?v= page in late 2015.
    – neverMind9
    Nov 19 at 11:08
















(personal opinion not in question text but in comments) I must say that I could never quite stand YouTube's AJAX comments. Especially now, they added “show more comment” bulk and removed the /all_comments?v= page in late 2015.
– neverMind9
Nov 19 at 11:08




(personal opinion not in question text but in comments) I must say that I could never quite stand YouTube's AJAX comments. Especially now, they added “show more comment” bulk and removed the /all_comments?v= page in late 2015.
– neverMind9
Nov 19 at 11:08

















active

oldest

votes











Your Answer






StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53373310%2fhow-to-download-an-entire-bottomless-ajax-page%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown






























active

oldest

votes













active

oldest

votes









active

oldest

votes






active

oldest

votes
















draft saved

draft discarded




















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.





Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


Please pay close attention to the following guidance:


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53373310%2fhow-to-download-an-entire-bottomless-ajax-page%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Create new schema in PostgreSQL using DBeaver

Deepest pit of an array with Javascript: test on Codility

Costa Masnaga