<ruby id="bdb3f"></ruby>

    <p id="bdb3f"><cite id="bdb3f"></cite></p>

      <p id="bdb3f"><cite id="bdb3f"><th id="bdb3f"></th></cite></p><p id="bdb3f"></p>
        <p id="bdb3f"><cite id="bdb3f"></cite></p>

          <pre id="bdb3f"></pre>
          <pre id="bdb3f"><del id="bdb3f"><thead id="bdb3f"></thead></del></pre>

          <ruby id="bdb3f"><mark id="bdb3f"></mark></ruby><ruby id="bdb3f"></ruby>
          <pre id="bdb3f"><pre id="bdb3f"><mark id="bdb3f"></mark></pre></pre><output id="bdb3f"></output><p id="bdb3f"></p><p id="bdb3f"></p>

          <pre id="bdb3f"><del id="bdb3f"><progress id="bdb3f"></progress></del></pre>

                <ruby id="bdb3f"></ruby>

                ??碼云GVP開源項目 12k star Uniapp+ElementUI 功能強大 支持多語言、二開方便! 廣告
                **spark-shell:** Spark自帶的交互式工具,可以使用下面三種模式之一進入Spakr Shell。 <br/> **1. 本地模式** ```shell -- local[4] 則啟動4個進程 -- local[*] 則啟動與服務器內核數一樣多的進程 [root@hadoop101 spark]# spark-shell --master local[*] ``` **2. Standalone模式** ```shell -- hadoop101為主機名 [root@hadoop101 spark]# spark-shell --master spark://hadoop101:7077 ``` **3. YARN模式** ```shell -- 這個是客戶模式,適用于調式 [root@hadoop101 spark]# spark-shell --master yarn-client -- 或者部署為集群模式,適用于生產環境 [root@hadoop101 spark]# spark-shell --master yarn ``` <br/> **wordcount案例,統計單詞個數:** ```shell (1)創建hello.txt文件 [root@hadoop101 spark]# vim /datas/hello.txt hello world welcome hello welcome (2)在hdfs上創建spark目錄并上傳hello.txt到spark目錄上 [root@hadoop101 spark]# hdfs dfs -mkdir /spark [root@hadoop101 spark]# hdfs dfs -put /datas/hello.txt /spark/ (3)進入spark shell執行程序 scala> sc.textFile("hdfs://hadoop101:9000/spark/hello.txt").flatMap(x=>x.split("\\s+")).map(x=>(x,1)).reduceByKey(_+_).collect res6: Array[(String, Int)] = Array(("",2), (hello,2), (welcome,2), (world,1)) ```
                  <ruby id="bdb3f"></ruby>

                  <p id="bdb3f"><cite id="bdb3f"></cite></p>

                    <p id="bdb3f"><cite id="bdb3f"><th id="bdb3f"></th></cite></p><p id="bdb3f"></p>
                      <p id="bdb3f"><cite id="bdb3f"></cite></p>

                        <pre id="bdb3f"></pre>
                        <pre id="bdb3f"><del id="bdb3f"><thead id="bdb3f"></thead></del></pre>

                        <ruby id="bdb3f"><mark id="bdb3f"></mark></ruby><ruby id="bdb3f"></ruby>
                        <pre id="bdb3f"><pre id="bdb3f"><mark id="bdb3f"></mark></pre></pre><output id="bdb3f"></output><p id="bdb3f"></p><p id="bdb3f"></p>

                        <pre id="bdb3f"><del id="bdb3f"><progress id="bdb3f"></progress></del></pre>

                              <ruby id="bdb3f"></ruby>

                              哎呀哎呀视频在线观看