What optimizations are shipped in Intel Distribution for Python?
up vote
4
down vote
favorite
Intel strongly recommends using their distribution for Python, instead of manually building Python modules for yourself. An obvious advantage is that there are many optimized modules available from their distribution, a non-trivial task if you want to compile them yourself.
But I haven't find out what kind of optimizations are available. If I would manually build the packages I am certain all the instructions available to my processor (AVX, SSE) where taken into consideration while compiling the code, and making the binaries as optimized as possible, hence I wanted to know:
Does Intel ship the distribution with binaries compiled for all their processors? (e.g. a different set of binaries for each generation: Nehalem, Sandy Bridge, etc) or...
Does Intel ship some sort of generic optimization? (to all their processors) or...
something in the middle?
To be more specific, Intel says it "accelerates" Python by the way of MKL, TBB and DAAL. A manual build will at least take advantage of MKL and customization of instruction sets to the host processor.
So, from my point of view there is a trade-of between these two approaches: if using the distribution, a lot of time would be saved and would have all "accelerators" but manual compiling would take advantage of MKL and instructions sets (at least). So, what is your take?
python optimization intel intel-mkl instruction-set
asked Nov 18 at 3:35
J. Ramos
263
New contributor
J. Ramos is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
up vote
4
down vote
favorite
Intel strongly recommends using their distribution for Python, instead of manually building Python modules for yourself. An obvious advantage is that there are many optimized modules available from their distribution, a non-trivial task if you want to compile them yourself.
But I haven't find out what kind of optimizations are available. If I would manually build the packages I am certain all the instructions available to my processor (AVX, SSE) where taken into consideration while compiling the code, and making the binaries as optimized as possible, hence I wanted to know:
Does Intel ship the distribution with binaries compiled for all their processors? (e.g. a different set of binaries for each generation: Nehalem, Sandy Bridge, etc) or...
Does Intel ship some sort of generic optimization? (to all their processors) or...
something in the middle?
To be more specific, Intel says it "accelerates" Python by the way of MKL, TBB and DAAL. A manual build will at least take advantage of MKL and customization of instruction sets to the host processor.
So, from my point of view there is a trade-of between these two approaches: if using the distribution, a lot of time would be saved and would have all "accelerators" but manual compiling would take advantage of MKL and instructions sets (at least). So, what is your take?
python optimization intel intel-mkl instruction-set
asked Nov 18 at 3:35
J. Ramos
263
New contributor
J. Ramos is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
up vote
4
down vote
favorite
up vote
4
down vote
favorite
Intel strongly recommends using their distribution for Python, instead of manually building Python modules for yourself. An obvious advantage is that there are many optimized modules available from their distribution, a non-trivial task if you want to compile them yourself.
But I haven't find out what kind of optimizations are available. If I would manually build the packages I am certain all the instructions available to my processor (AVX, SSE) where taken into consideration while compiling the code, and making the binaries as optimized as possible, hence I wanted to know:
Does Intel ship the distribution with binaries compiled for all their processors? (e.g. a different set of binaries for each generation: Nehalem, Sandy Bridge, etc) or...
Does Intel ship some sort of generic optimization? (to all their processors) or...
something in the middle?
To be more specific, Intel says it "accelerates" Python by the way of MKL, TBB and DAAL. A manual build will at least take advantage of MKL and customization of instruction sets to the host processor.
So, from my point of view there is a trade-of between these two approaches: if using the distribution, a lot of time would be saved and would have all "accelerators" but manual compiling would take advantage of MKL and instructions sets (at least). So, what is your take?
python optimization intel intel-mkl instruction-set
asked Nov 18 at 3:35
J. Ramos
263
New contributor
J. Ramos is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Intel strongly recommends using their distribution for Python, instead of manually building Python modules for yourself. An obvious advantage is that there are many optimized modules available from their distribution, a non-trivial task if you want to compile them yourself.
But I haven't find out what kind of optimizations are available. If I would manually build the packages I am certain all the instructions available to my processor (AVX, SSE) where taken into consideration while compiling the code, and making the binaries as optimized as possible, hence I wanted to know:
Does Intel ship the distribution with binaries compiled for all their processors? (e.g. a different set of binaries for each generation: Nehalem, Sandy Bridge, etc) or...
Does Intel ship some sort of generic optimization? (to all their processors) or...
something in the middle?
To be more specific, Intel says it "accelerates" Python by the way of MKL, TBB and DAAL. A manual build will at least take advantage of MKL and customization of instruction sets to the host processor.
So, from my point of view there is a trade-of between these two approaches: if using the distribution, a lot of time would be saved and would have all "accelerators" but manual compiling would take advantage of MKL and instructions sets (at least). So, what is your take?
python optimization intel intel-mkl instruction-set
python optimization intel intel-mkl instruction-set
asked Nov 18 at 3:35
J. Ramos
263
New contributor
J. Ramos is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked Nov 18 at 3:35
J. Ramos
263
New contributor
J. Ramos is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
edited Nov 18 at 5:09
asked Nov 18 at 3:35
J. Ramos
263
New contributor
J. Ramos is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked Nov 18 at 3:35
J. Ramos
263
asked Nov 18 at 3:35
J. Ramos
263
263
New contributor
J. Ramos is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
J. Ramos is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
J. Ramos is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
J. Ramos is a new contributor. Be nice, and check out our Code of Conduct.
J. Ramos is a new contributor. Be nice, and check out our Code of Conduct.
J. Ramos is a new contributor. Be nice, and check out our Code of Conduct.
J. Ramos is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53357662%2fwhat-optimizations-are-shipped-in-intel-distribution-for-python%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
