<ruby id="bdb3f"></ruby>

    <p id="bdb3f"><cite id="bdb3f"></cite></p>

      <p id="bdb3f"><cite id="bdb3f"><th id="bdb3f"></th></cite></p><p id="bdb3f"></p>
        <p id="bdb3f"><cite id="bdb3f"></cite></p>

          <pre id="bdb3f"></pre>
          <pre id="bdb3f"><del id="bdb3f"><thead id="bdb3f"></thead></del></pre>

          <ruby id="bdb3f"><mark id="bdb3f"></mark></ruby><ruby id="bdb3f"></ruby>
          <pre id="bdb3f"><pre id="bdb3f"><mark id="bdb3f"></mark></pre></pre><output id="bdb3f"></output><p id="bdb3f"></p><p id="bdb3f"></p>

          <pre id="bdb3f"><del id="bdb3f"><progress id="bdb3f"></progress></del></pre>

                <ruby id="bdb3f"></ruby>

                ThinkChat2.0新版上線,更智能更精彩,支持會話、畫圖、視頻、閱讀、搜索等,送10W Token,即刻開啟你的AI之旅 廣告
                :-: ![](https://img.kancloud.cn/b3/f1/b3f195aac9b63c112c0d4194f5478e5c_596x286.png) Spark運行架構 * 在驅動程序中,通過SparkContext主導應用的執行; * SparkContext可以連接不同類型的Cluster Manager(Standalone、YARN、Mesos),連接后,獲得集群節點上的Executor; * 一個Worker節點默認一個Executor,可通過SPARK_WORKER_INSTANCES調整; * 每個應用獲取自己的Executor,相當于JVM; * 每個Task處理一個RDD分區; :-: Spark架構核心組件 | 術語 | 說明 | | --- | --- | | Application | 建立在Spark上的用戶程序,包括Driver代碼和運行在集群各節點Executor中的代碼 | | Driver program | 驅動程序。Application中的main函數并創建SparkContext | | Cluster Manager | 在集群(Standalone、Mesos、YARN)上獲取資源的外部服務 | | Worker Node | 集群中任何可以運行Application代碼的節點 | | Executor | 某個Application運行在worker節點上的一個進程 | | Task | 被送到某個Executor上的工作單元 | | Job | 包含多個Task組成的并行計算,往往由Spark Action觸發生成,一個Application中往往會產生多個Job | | Stage | 每個Job會被拆分成多組Task,作為一個TaskSet,其名稱為Stage |
                  <ruby id="bdb3f"></ruby>

                  <p id="bdb3f"><cite id="bdb3f"></cite></p>

                    <p id="bdb3f"><cite id="bdb3f"><th id="bdb3f"></th></cite></p><p id="bdb3f"></p>
                      <p id="bdb3f"><cite id="bdb3f"></cite></p>

                        <pre id="bdb3f"></pre>
                        <pre id="bdb3f"><del id="bdb3f"><thead id="bdb3f"></thead></del></pre>

                        <ruby id="bdb3f"><mark id="bdb3f"></mark></ruby><ruby id="bdb3f"></ruby>
                        <pre id="bdb3f"><pre id="bdb3f"><mark id="bdb3f"></mark></pre></pre><output id="bdb3f"></output><p id="bdb3f"></p><p id="bdb3f"></p>

                        <pre id="bdb3f"><del id="bdb3f"><progress id="bdb3f"></progress></del></pre>

                              <ruby id="bdb3f"></ruby>

                              哎呀哎呀视频在线观看