Spark-shell Git Bash











up vote
1
down vote

favorite
1












I cannot get the spark-shell command to work on Git bash. I am fairly sure my environment is set up correctly as if I run spark-shell in any directory in command prompt, it works just fine for me.



However, when I run spark-shell in bash, it outputs this value instead of running the actual shell:



"C:Program FilesJavajdk1.8.0_191binjava" -cp "C:sparkspark-2.4.0-bin- 

hadoop2.7/conf;C:sparkspark-2.4.0-bin-hadoop2.7jars*" "- 

Dscala.usejavacp=true"-Xmx1g org.apache.spark.deploy.SparkSubmit --class 

org.apache.spark.repl.Main --name "Spark shell" spark-shell





java bash scala apache-spark git-bash







share|improve this question






















  • Do you mean you are running spark from within a shell script file? If so, can you show us that script? If not, how are you running it?
    – dave
    2 days ago










  • No, I'm just calling spark-shell without a script. I just call spark-shell in any directory and it runs in command prompt, however, for git bash, it displays the above output.
    – Foxlooo
    yesterday















up vote
1
down vote

favorite
1












I cannot get the spark-shell command to work on Git bash. I am fairly sure my environment is set up correctly as if I run spark-shell in any directory in command prompt, it works just fine for me.



However, when I run spark-shell in bash, it outputs this value instead of running the actual shell:



"C:Program FilesJavajdk1.8.0_191binjava" -cp "C:sparkspark-2.4.0-bin- 

hadoop2.7/conf;C:sparkspark-2.4.0-bin-hadoop2.7jars*" "- 

Dscala.usejavacp=true"-Xmx1g org.apache.spark.deploy.SparkSubmit --class 

org.apache.spark.repl.Main --name "Spark shell" spark-shell





java bash scala apache-spark git-bash







share|improve this question






















  • Do you mean you are running spark from within a shell script file? If so, can you show us that script? If not, how are you running it?
    – dave
    2 days ago










  • No, I'm just calling spark-shell without a script. I just call spark-shell in any directory and it runs in command prompt, however, for git bash, it displays the above output.
    – Foxlooo
    yesterday













up vote
1
down vote

favorite
1









up vote
1
down vote

favorite
1






1





I cannot get the spark-shell command to work on Git bash. I am fairly sure my environment is set up correctly as if I run spark-shell in any directory in command prompt, it works just fine for me.



However, when I run spark-shell in bash, it outputs this value instead of running the actual shell:



"C:Program FilesJavajdk1.8.0_191binjava" -cp "C:sparkspark-2.4.0-bin- 

hadoop2.7/conf;C:sparkspark-2.4.0-bin-hadoop2.7jars*" "- 

Dscala.usejavacp=true"-Xmx1g org.apache.spark.deploy.SparkSubmit --class 

org.apache.spark.repl.Main --name "Spark shell" spark-shell





java bash scala apache-spark git-bash







share|improve this question













I cannot get the spark-shell command to work on Git bash. I am fairly sure my environment is set up correctly as if I run spark-shell in any directory in command prompt, it works just fine for me.



However, when I run spark-shell in bash, it outputs this value instead of running the actual shell:



"C:Program FilesJavajdk1.8.0_191binjava" -cp "C:sparkspark-2.4.0-bin- 

hadoop2.7/conf;C:sparkspark-2.4.0-bin-hadoop2.7jars*" "- 

Dscala.usejavacp=true"-Xmx1g org.apache.spark.deploy.SparkSubmit --class 

org.apache.spark.repl.Main --name "Spark shell" spark-shell





java bash scala apache-spark git-bash




java bash scala apache-spark git-bash






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked 2 days ago









Foxlooo

145




145












  • Do you mean you are running spark from within a shell script file? If so, can you show us that script? If not, how are you running it?
    – dave
    2 days ago










  • No, I'm just calling spark-shell without a script. I just call spark-shell in any directory and it runs in command prompt, however, for git bash, it displays the above output.
    – Foxlooo
    yesterday


















  • Do you mean you are running spark from within a shell script file? If so, can you show us that script? If not, how are you running it?
    – dave
    2 days ago










  • No, I'm just calling spark-shell without a script. I just call spark-shell in any directory and it runs in command prompt, however, for git bash, it displays the above output.
    – Foxlooo
    yesterday
















Do you mean you are running spark from within a shell script file? If so, can you show us that script? If not, how are you running it?
– dave
2 days ago




Do you mean you are running spark from within a shell script file? If so, can you show us that script? If not, how are you running it?
– dave
2 days ago












No, I'm just calling spark-shell without a script. I just call spark-shell in any directory and it runs in command prompt, however, for git bash, it displays the above output.
– Foxlooo
yesterday




No, I'm just calling spark-shell without a script. I just call spark-shell in any directory and it runs in command prompt, however, for git bash, it displays the above output.
– Foxlooo
yesterday












1 Answer
1






active

oldest

votes

















up vote
0
down vote













In a git bash, try and use:




  • simple quotes ' (instead of double-quotes ")


  • / instead of : C:/.../... or /c/.../...


That would be more compatible with the shell used by Git bash.






share|improve this answer





















  • To clarify, the above is the output that I am returned, I am just calling spark-shell
    – Foxlooo
    7 hours ago












  • @Foxlooo Any chance to modify the spark-shell script in order to test the syntax I propose?
    – VonC
    7 hours ago










  • I'm not sure what script it's running, I'm running it from the default built-in command from the installation of spark and scala. Also, keep in mind it works in command prompt
    – Foxlooo
    6 hours ago










  • @Foxlooo OK. I am not surprised it does work in a CMD command prompt, and not in a bash (where quotes are interpreted differently)
    – VonC
    6 hours ago











Your Answer






StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














 

draft saved


draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53346696%2fspark-shell-git-bash%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes








up vote
0
down vote













In a git bash, try and use:




  • simple quotes ' (instead of double-quotes ")


  • / instead of : C:/.../... or /c/.../...


That would be more compatible with the shell used by Git bash.






share|improve this answer





















  • To clarify, the above is the output that I am returned, I am just calling spark-shell
    – Foxlooo
    7 hours ago












  • @Foxlooo Any chance to modify the spark-shell script in order to test the syntax I propose?
    – VonC
    7 hours ago










  • I'm not sure what script it's running, I'm running it from the default built-in command from the installation of spark and scala. Also, keep in mind it works in command prompt
    – Foxlooo
    6 hours ago










  • @Foxlooo OK. I am not surprised it does work in a CMD command prompt, and not in a bash (where quotes are interpreted differently)
    – VonC
    6 hours ago















up vote
0
down vote













In a git bash, try and use:




  • simple quotes ' (instead of double-quotes ")


  • / instead of : C:/.../... or /c/.../...


That would be more compatible with the shell used by Git bash.






share|improve this answer





















  • To clarify, the above is the output that I am returned, I am just calling spark-shell
    – Foxlooo
    7 hours ago












  • @Foxlooo Any chance to modify the spark-shell script in order to test the syntax I propose?
    – VonC
    7 hours ago










  • I'm not sure what script it's running, I'm running it from the default built-in command from the installation of spark and scala. Also, keep in mind it works in command prompt
    – Foxlooo
    6 hours ago










  • @Foxlooo OK. I am not surprised it does work in a CMD command prompt, and not in a bash (where quotes are interpreted differently)
    – VonC
    6 hours ago













up vote
0
down vote










up vote
0
down vote









In a git bash, try and use:




  • simple quotes ' (instead of double-quotes ")


  • / instead of : C:/.../... or /c/.../...


That would be more compatible with the shell used by Git bash.






share|improve this answer












In a git bash, try and use:




  • simple quotes ' (instead of double-quotes ")


  • / instead of : C:/.../... or /c/.../...


That would be more compatible with the shell used by Git bash.







share|improve this answer












share|improve this answer



share|improve this answer










answered yesterday









VonC

820k28325763090




820k28325763090












  • To clarify, the above is the output that I am returned, I am just calling spark-shell
    – Foxlooo
    7 hours ago












  • @Foxlooo Any chance to modify the spark-shell script in order to test the syntax I propose?
    – VonC
    7 hours ago










  • I'm not sure what script it's running, I'm running it from the default built-in command from the installation of spark and scala. Also, keep in mind it works in command prompt
    – Foxlooo
    6 hours ago










  • @Foxlooo OK. I am not surprised it does work in a CMD command prompt, and not in a bash (where quotes are interpreted differently)
    – VonC
    6 hours ago


















  • To clarify, the above is the output that I am returned, I am just calling spark-shell
    – Foxlooo
    7 hours ago












  • @Foxlooo Any chance to modify the spark-shell script in order to test the syntax I propose?
    – VonC
    7 hours ago










  • I'm not sure what script it's running, I'm running it from the default built-in command from the installation of spark and scala. Also, keep in mind it works in command prompt
    – Foxlooo
    6 hours ago










  • @Foxlooo OK. I am not surprised it does work in a CMD command prompt, and not in a bash (where quotes are interpreted differently)
    – VonC
    6 hours ago
















To clarify, the above is the output that I am returned, I am just calling spark-shell
– Foxlooo
7 hours ago






To clarify, the above is the output that I am returned, I am just calling spark-shell
– Foxlooo
7 hours ago














@Foxlooo Any chance to modify the spark-shell script in order to test the syntax I propose?
– VonC
7 hours ago




@Foxlooo Any chance to modify the spark-shell script in order to test the syntax I propose?
– VonC
7 hours ago












I'm not sure what script it's running, I'm running it from the default built-in command from the installation of spark and scala. Also, keep in mind it works in command prompt
– Foxlooo
6 hours ago




I'm not sure what script it's running, I'm running it from the default built-in command from the installation of spark and scala. Also, keep in mind it works in command prompt
– Foxlooo
6 hours ago












@Foxlooo OK. I am not surprised it does work in a CMD command prompt, and not in a bash (where quotes are interpreted differently)
– VonC
6 hours ago




@Foxlooo OK. I am not surprised it does work in a CMD command prompt, and not in a bash (where quotes are interpreted differently)
– VonC
6 hours ago


















 

draft saved


draft discarded



















































 


draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53346696%2fspark-shell-git-bash%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-

Popular posts from this blog

Costa Masnaga

Image
.mw-parser-output .avviso .mbox-text-div>div,.mw-parser-output .avviso .mbox-text-full-div>div{font-size:90%}.mw-parser-output .avviso .mbox-image div{width:52px}.mw-parser-output .avviso .mbox-text-full-div .hide-when-compact{display:block} Questa voce o sezione sull'argomento Lombardia non cita le fonti necessarie o quelle presenti sono insufficienti . Puoi migliorare questa voce aggiungendo citazioni da fonti attendibili secondo le linee guida sull'uso delle fonti. Segui i suggerimenti del progetto di riferimento. Costa Masnaga comune Localizzazione Stato   Italia Regione Lombardia Provincia Lecco Amministrazione Sindaco Sabina Panzeri (Al centro il cittadino) dall'08/06/2009 Territorio Coordinate 45°46′N 9°17′E  /  45.766667°N 9.283333°E 45.766667; 9.283333  ( Costa Masnaga ) Coordinate: 45°46′N 9°17′E  /  45.766667°N 9.283333°E 45.766667; 9.283333  ( Costa Masnaga ) Altitudine 318 m s.l.m...
Read more

Fotorealismo

Image
Guerrino Boatto, Venice's St. Barnaba Church and canal Il fotorealismo è un genere di pittura basato sull'uso di una o più fotografie dalle quali l'artista prende le informazioni necessarie da utilizzare poi nel processo della creazione dell'opera, in genere ad olio o ad acrilico, al fine di avere un aspetto finale il più simile possibile alla fotografia. Indice 1 Storia 2 Lista dei fotorealisti 3 Note 4 Voci correlate 5 Altri progetti Storia | Il fotorealismo è un movimento che nasce negli Stati Uniti d'America alla fine degli anni sessanta [1] sulla scia della Pop Art [2] [3] [4] , e insieme condividono il carattere reazionario verso la travolgente ascesa dei media, che alla metà del ventesimo secolo si trasforma in un fenomeno di massa talmente imponente da minacciare il valore dell'immagine nell'arte. [5] [6] Ne consegue così che, colto il gesto d'inizio che fu della Pop Art, i fotorealisti aprono ad un ...
Read more

Sidney Franklin

Image
Questa voce sull'argomento registi statunitensi è solo un abbozzo . Contribuisci a migliorarla secondo le convenzioni di Wikipedia. Sidney Franklin, foto di Carl Van Vechten Oscar alla memoria Irving G. Thalberg 1943 Sidney Franklin , all'anagrafe Sidney Arnold Franklin , (San Francisco, 21 marzo 1893 – Santa Monica, 18 maggio 1972), è stato un regista, produttore cinematografico e attore statunitense. Il 20 giugno 1963, si sposò con l'attrice australiana Enid Bennett. Il matrimonio durò fino alla morte dell'attrice, il 14 maggio 1969 [1] Indice 1 Filmografia 1.1 Regista 1.2 Aiuto regia (parziale) 1.3 Produttore 1.4 Attore (parziale) 2 Note 3 Altri progetti 4 Collegamenti esterni Filmografia | Regista | The Baby , co-regia Chester M. Franklin (1915) The Rivals , co-regia Chester M. Franklin (1915) Little Dick's First Case , co-regia Chester M. Franklin (1915) Her Filmland Hero , co-...
Read more