Change Field index to not_analyzed through hive external table
I am indexing data to ES through hive by using the query :
CREATE EXTERNAL TABLE json2 ( time_id_1 STRING, acnt_nm)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES('es.resource' = 'es_testing/test', 'es.nodes' = 'xxx');
insert overwrite table json2 select time_id_1 , acnt_nm from table_x;
I want my string column acnt_nm to be "not analyzed".
I found out there is a way of doing this through Mapping API by setting the "index": "not_analyzed"
I know this can be done through explicit mapping. But that is very cumbersome as i will have to do that every time before indexing any new data.
But can i do the same through the hive external table creation command ?
Or maybe just edit the index to "not_analyzed" for all the indexed data. It is not possible for me to change it individually for each id as i have too many of them.
elasticsearch hive kibana
edited Nov 25 '15 at 13:29
Pistachio
1,0321334
asked Aug 25 '15 at 16:37
ChiragChirag
2301313
add a comment |
I am indexing data to ES through hive by using the query :
CREATE EXTERNAL TABLE json2 ( time_id_1 STRING, acnt_nm)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES('es.resource' = 'es_testing/test', 'es.nodes' = 'xxx');
insert overwrite table json2 select time_id_1 , acnt_nm from table_x;
I want my string column acnt_nm to be "not analyzed".
I found out there is a way of doing this through Mapping API by setting the "index": "not_analyzed"
I know this can be done through explicit mapping. But that is very cumbersome as i will have to do that every time before indexing any new data.
But can i do the same through the hive external table creation command ?
Or maybe just edit the index to "not_analyzed" for all the indexed data. It is not possible for me to change it individually for each id as i have too many of them.
elasticsearch hive kibana
edited Nov 25 '15 at 13:29
Pistachio
1,0321334
asked Aug 25 '15 at 16:37
ChiragChirag
2301313
add a comment |
I am indexing data to ES through hive by using the query :
CREATE EXTERNAL TABLE json2 ( time_id_1 STRING, acnt_nm)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES('es.resource' = 'es_testing/test', 'es.nodes' = 'xxx');
insert overwrite table json2 select time_id_1 , acnt_nm from table_x;
I want my string column acnt_nm to be "not analyzed".
I found out there is a way of doing this through Mapping API by setting the "index": "not_analyzed"
I know this can be done through explicit mapping. But that is very cumbersome as i will have to do that every time before indexing any new data.
But can i do the same through the hive external table creation command ?
Or maybe just edit the index to "not_analyzed" for all the indexed data. It is not possible for me to change it individually for each id as i have too many of them.
elasticsearch hive kibana
edited Nov 25 '15 at 13:29
Pistachio
1,0321334
asked Aug 25 '15 at 16:37
ChiragChirag
2301313
I am indexing data to ES through hive by using the query :
CREATE EXTERNAL TABLE json2 ( time_id_1 STRING, acnt_nm)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES('es.resource' = 'es_testing/test', 'es.nodes' = 'xxx');
insert overwrite table json2 select time_id_1 , acnt_nm from table_x;
I want my string column acnt_nm to be "not analyzed".
I found out there is a way of doing this through Mapping API by setting the "index": "not_analyzed"
I know this can be done through explicit mapping. But that is very cumbersome as i will have to do that every time before indexing any new data.
But can i do the same through the hive external table creation command ?
Or maybe just edit the index to "not_analyzed" for all the indexed data. It is not possible for me to change it individually for each id as i have too many of them.
elasticsearch hive kibana
elasticsearch hive kibana
edited Nov 25 '15 at 13:29
Pistachio
1,0321334
asked Aug 25 '15 at 16:37
ChiragChirag
2301313
edited Nov 25 '15 at 13:29
Pistachio
1,0321334
asked Aug 25 '15 at 16:37
ChiragChirag
2301313
edited Nov 25 '15 at 13:29
Pistachio
1,0321334
edited Nov 25 '15 at 13:29
Pistachio
1,0321334
edited Nov 25 '15 at 13:29
Pistachio
1,0321334
1,0321334
asked Aug 25 '15 at 16:37
ChiragChirag
2301313
asked Aug 25 '15 at 16:37
ChiragChirag
2301313
asked Aug 25 '15 at 16:37
ChiragChirag
2301313
2301313
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Why do you need not-analyzed at hive side? Actually creation script does not work without any type. You can set string at least.
I think you can change the mapping of es_testing index and this performs the mapping on each individual document in that index.
answered Nov 25 '15 at 13:05
HakkiBuyukcengizHakkiBuyukcengiz
304315
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f32209470%2fchange-field-index-to-not-analyzed-through-hive-external-table%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Why do you need not-analyzed at hive side? Actually creation script does not work without any type. You can set string at least.
I think you can change the mapping of es_testing index and this performs the mapping on each individual document in that index.
answered Nov 25 '15 at 13:05
HakkiBuyukcengizHakkiBuyukcengiz
304315
add a comment |
Why do you need not-analyzed at hive side? Actually creation script does not work without any type. You can set string at least.
I think you can change the mapping of es_testing index and this performs the mapping on each individual document in that index.
answered Nov 25 '15 at 13:05
HakkiBuyukcengizHakkiBuyukcengiz
304315
add a comment |
Why do you need not-analyzed at hive side? Actually creation script does not work without any type. You can set string at least.
I think you can change the mapping of es_testing index and this performs the mapping on each individual document in that index.
answered Nov 25 '15 at 13:05
HakkiBuyukcengizHakkiBuyukcengiz
304315
Why do you need not-analyzed at hive side? Actually creation script does not work without any type. You can set string at least.
I think you can change the mapping of es_testing index and this performs the mapping on each individual document in that index.
answered Nov 25 '15 at 13:05
HakkiBuyukcengizHakkiBuyukcengiz
304315
answered Nov 25 '15 at 13:05
HakkiBuyukcengizHakkiBuyukcengiz
304315
answered Nov 25 '15 at 13:05
HakkiBuyukcengizHakkiBuyukcengiz
304315
answered Nov 25 '15 at 13:05
HakkiBuyukcengizHakkiBuyukcengiz
304315
304315
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f32209470%2fchange-field-index-to-not-analyzed-through-hive-external-table%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
