Presto Cassandra Connector : number of connections
up vote
2
down vote
favorite
I am looking into increasing the number of connections Presto makes to ScyllaDB. I am using Presto's Cassandra connector to connect to ScyllaDB. I don't see any property in the documentation that can be used to increase the number of connections. https://prestodb.io/docs/current/connector/cassandra.html
This is my scylladb.properties file
connector.name=cassandra
cassandra.contact-points=scylla1,scylla2,scylla3,scylla4
cassandra.client.read-timeout=3600000ms
cassandra.split-size=1024
cassandra.fetch-size=5000
cassandra.load-policy.token-aware.shuffle-replicas=true
cassandra.load-policy.use-token-aware=true
What is the default number of connections that Presto makes to cassandra/scylladb and how can I set this property? Thanks
prestodb scylla
edited Nov 20 at 23:23
phact
6,5771224
asked Nov 19 at 21:10
jaspreet kaur bassan
5117
add a comment |
up vote
2
down vote
favorite
I am looking into increasing the number of connections Presto makes to ScyllaDB. I am using Presto's Cassandra connector to connect to ScyllaDB. I don't see any property in the documentation that can be used to increase the number of connections. https://prestodb.io/docs/current/connector/cassandra.html
This is my scylladb.properties file
connector.name=cassandra
cassandra.contact-points=scylla1,scylla2,scylla3,scylla4
cassandra.client.read-timeout=3600000ms
cassandra.split-size=1024
cassandra.fetch-size=5000
cassandra.load-policy.token-aware.shuffle-replicas=true
cassandra.load-policy.use-token-aware=true
What is the default number of connections that Presto makes to cassandra/scylladb and how can I set this property? Thanks
prestodb scylla
edited Nov 20 at 23:23
phact
6,5771224
asked Nov 19 at 21:10
jaspreet kaur bassan
5117
add a comment |
up vote
2
down vote
favorite
up vote
2
down vote
favorite
I am looking into increasing the number of connections Presto makes to ScyllaDB. I am using Presto's Cassandra connector to connect to ScyllaDB. I don't see any property in the documentation that can be used to increase the number of connections. https://prestodb.io/docs/current/connector/cassandra.html
This is my scylladb.properties file
connector.name=cassandra
cassandra.contact-points=scylla1,scylla2,scylla3,scylla4
cassandra.client.read-timeout=3600000ms
cassandra.split-size=1024
cassandra.fetch-size=5000
cassandra.load-policy.token-aware.shuffle-replicas=true
cassandra.load-policy.use-token-aware=true
What is the default number of connections that Presto makes to cassandra/scylladb and how can I set this property? Thanks
prestodb scylla
edited Nov 20 at 23:23
phact
6,5771224
asked Nov 19 at 21:10
jaspreet kaur bassan
5117
I am looking into increasing the number of connections Presto makes to ScyllaDB. I am using Presto's Cassandra connector to connect to ScyllaDB. I don't see any property in the documentation that can be used to increase the number of connections. https://prestodb.io/docs/current/connector/cassandra.html
This is my scylladb.properties file
connector.name=cassandra
cassandra.contact-points=scylla1,scylla2,scylla3,scylla4
cassandra.client.read-timeout=3600000ms
cassandra.split-size=1024
cassandra.fetch-size=5000
cassandra.load-policy.token-aware.shuffle-replicas=true
cassandra.load-policy.use-token-aware=true
What is the default number of connections that Presto makes to cassandra/scylladb and how can I set this property? Thanks
prestodb scylla
prestodb scylla
edited Nov 20 at 23:23
phact
6,5771224
asked Nov 19 at 21:10
jaspreet kaur bassan
5117
edited Nov 20 at 23:23
phact
6,5771224
asked Nov 19 at 21:10
jaspreet kaur bassan
5117
edited Nov 20 at 23:23
phact
6,5771224
edited Nov 20 at 23:23
phact
6,5771224
edited Nov 20 at 23:23
phact
6,5771224
6,5771224
asked Nov 19 at 21:10
jaspreet kaur bassan
5117
asked Nov 19 at 21:10
jaspreet kaur bassan
5117
asked Nov 19 at 21:10
jaspreet kaur bassan
5117
5117
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
up vote
4
down vote
Using the same logic as we do for Spark, reducing the cassandra.split-size to a lower number should make you benefit from the following:
- Coordination and data fetching is distributed among several coordinators
- Higher concurrency of requests, which translates to a higher number of connections between the Presto node/s and Scylla nodes
See how cassandra.split-size=1 behaves and if needed raise to 10, 50, 100
answered Dec 2 at 8:33
TomerSan
72519
@jaspreet kaur bassan - have you tried this?
– TomerSan
Dec 3 at 8:51
I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks
– jaspreet kaur bassan
Dec 9 at 6:29
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53382678%2fpresto-cassandra-connector-number-of-connections%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
4
down vote
Using the same logic as we do for Spark, reducing the cassandra.split-size to a lower number should make you benefit from the following:
- Coordination and data fetching is distributed among several coordinators
- Higher concurrency of requests, which translates to a higher number of connections between the Presto node/s and Scylla nodes
See how cassandra.split-size=1 behaves and if needed raise to 10, 50, 100
answered Dec 2 at 8:33
TomerSan
72519
@jaspreet kaur bassan - have you tried this?
– TomerSan
Dec 3 at 8:51
I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks
– jaspreet kaur bassan
Dec 9 at 6:29
add a comment |
up vote
4
down vote
Using the same logic as we do for Spark, reducing the cassandra.split-size to a lower number should make you benefit from the following:
- Coordination and data fetching is distributed among several coordinators
- Higher concurrency of requests, which translates to a higher number of connections between the Presto node/s and Scylla nodes
See how cassandra.split-size=1 behaves and if needed raise to 10, 50, 100
answered Dec 2 at 8:33
TomerSan
72519
@jaspreet kaur bassan - have you tried this?
– TomerSan
Dec 3 at 8:51
I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks
– jaspreet kaur bassan
Dec 9 at 6:29
add a comment |
up vote
4
down vote
up vote
4
down vote
Using the same logic as we do for Spark, reducing the cassandra.split-size to a lower number should make you benefit from the following:
- Coordination and data fetching is distributed among several coordinators
- Higher concurrency of requests, which translates to a higher number of connections between the Presto node/s and Scylla nodes
See how cassandra.split-size=1 behaves and if needed raise to 10, 50, 100
answered Dec 2 at 8:33
TomerSan
72519
Using the same logic as we do for Spark, reducing the cassandra.split-size to a lower number should make you benefit from the following:
- Coordination and data fetching is distributed among several coordinators
- Higher concurrency of requests, which translates to a higher number of connections between the Presto node/s and Scylla nodes
See how cassandra.split-size=1 behaves and if needed raise to 10, 50, 100
answered Dec 2 at 8:33
TomerSan
72519
edited Dec 2 at 10:27
answered Dec 2 at 8:33
TomerSan
72519
answered Dec 2 at 8:33
TomerSan
72519
answered Dec 2 at 8:33
TomerSan
72519
72519
@jaspreet kaur bassan - have you tried this?
– TomerSan
Dec 3 at 8:51
I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks
– jaspreet kaur bassan
Dec 9 at 6:29
add a comment |
@jaspreet kaur bassan - have you tried this?
– TomerSan
Dec 3 at 8:51
I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks
– jaspreet kaur bassan
Dec 9 at 6:29
@jaspreet kaur bassan - have you tried this?
– TomerSan
Dec 3 at 8:51
@jaspreet kaur bassan - have you tried this?
– TomerSan
Dec 3 at 8:51
I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks
– jaspreet kaur bassan
Dec 9 at 6:29
I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks
– jaspreet kaur bassan
Dec 9 at 6:29
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53382678%2fpresto-cassandra-connector-number-of-connections%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
