<ruby id="bdb3f"></ruby>

    <p id="bdb3f"><cite id="bdb3f"></cite></p>

      <p id="bdb3f"><cite id="bdb3f"><th id="bdb3f"></th></cite></p><p id="bdb3f"></p>
        <p id="bdb3f"><cite id="bdb3f"></cite></p>

          <pre id="bdb3f"></pre>
          <pre id="bdb3f"><del id="bdb3f"><thead id="bdb3f"></thead></del></pre>

          <ruby id="bdb3f"><mark id="bdb3f"></mark></ruby><ruby id="bdb3f"></ruby>
          <pre id="bdb3f"><pre id="bdb3f"><mark id="bdb3f"></mark></pre></pre><output id="bdb3f"></output><p id="bdb3f"></p><p id="bdb3f"></p>

          <pre id="bdb3f"><del id="bdb3f"><progress id="bdb3f"></progress></del></pre>

                <ruby id="bdb3f"></ruby>

                ??碼云GVP開源項目 12k star Uniapp+ElementUI 功能強大 支持多語言、二開方便! 廣告
                # 設置 > 譯者:[OSGeo 中國](https://www.osgeo.cn/) Scrapy設置允許您自定義所有Scrapy組件的行為,包括核心、擴展、管道和spider本身。 設置的基礎結構提供了鍵值映射的全局命名空間,代碼可以使用該命名空間從中提取配置值。可以通過下面描述的不同機制填充設置。 這些設置也是選擇當前活動的Scrapy項目(如果您有許多項目)的機制。 有關可用內置設置的列表,請參閱: [內置設置參考](#topics-settings-ref) . ## 指定設置 當你使用Scrapy時,你必須告訴它你使用的設置。您可以通過使用環境變量, `SCRAPY_SETTINGS_MODULE` . 價值 `SCRAPY_SETTINGS_MODULE` 應該使用python路徑語法,例如 `myproject.settings` . 注意,設置模塊應該在python上 [import search path](https://docs.python.org/2/tutorial/modules.html#the-module-search-path) . ## 填充設置 可以使用不同的機制填充設置,每個機制具有不同的優先級。以下是按優先級降序排列的列表: > 1. 命令行選項(最優先) > 2. 每個 Spider 的設置 > 3. 項目設置模塊 > 4. 每個命令的默認設置 > 5. 默認全局設置(優先級較低) 這些設置源的填充是在內部處理的,但是可以使用API調用進行手動處理。見 [設置API](api.html#topics-api-settings) 供參考的主題。 下面將更詳細地描述這些機制。 ### 1。命令行選項 命令行提供的參數是最優先的參數,覆蓋了任何其他選項。您可以使用 `-s` (或) `--set` )命令行選項。 例子:: ```py scrapy crawl myspider -s LOG_FILE=scrapy.log ``` ### 2。每個 Spider 的設置 Spider (見 [Spider](spiders.html#topics-spiders) 章節供參考)可以定義它們自己的設置,這些設置將優先并覆蓋項目設置。他們可以通過設置 [`custom_settings`](spiders.html#scrapy.spiders.Spider.custom_settings "scrapy.spiders.Spider.custom_settings") 屬性: ```py class MySpider(scrapy.Spider): name = 'myspider' custom_settings = { 'SOME_SETTING': 'some value', } ``` ### 三。項目設置模塊 項目設置模塊是 Scrapy 項目的標準配置文件,它將填充大部分自定義設置。對于標準的Scrapy項目,這意味著您將在 `settings.py` 為項目創建的文件。 ### 4。每個命令的默認設置 各 [Scrapy tool](commands.html) 命令可以有自己的默認設置,這將覆蓋全局默認設置。這些自定義命令設置在 `default_settings` 命令類的屬性。 ### 5。默認全局設置 全局默認值位于 `scrapy.settings.default_settings` 并記錄在 [內置設置參考](#topics-settings-ref) 部分。 ## 如何訪問設置 在Spider中,可以通過 `self.settings` :: ```py class MySpider(scrapy.Spider): name = 'myspider' start_urls = ['http://example.com'] def parse(self, response): print("Existing settings: %s" % self.settings.attributes.keys()) ``` 注解 這個 `settings` 屬性在Spider初始化后在基本Spider類中設置。如果要在初始化之前使用這些設置(例如,在Spider的 `__init__()` 方法),您需要重寫 [`from_crawler()`](spiders.html#scrapy.spiders.Spider.from_crawler "scrapy.spiders.Spider.from_crawler") 方法。 可以通過訪問 [`scrapy.crawler.Crawler.settings`](api.html#scrapy.crawler.Crawler.settings "scrapy.crawler.Crawler.settings") 傳遞給的爬網程序的屬性 `from_crawler` 擴展、中間商和項目管道中的方法: ```py class MyExtension(object): def __init__(self, log_is_enabled=False): if log_is_enabled: print("log is enabled!") @classmethod def from_crawler(cls, crawler): settings = crawler.settings return cls(settings.getbool('LOG_ENABLED')) ``` 設置對象可以像dict一樣使用(例如, `settings['LOG_ENABLED']` ,但通常最好使用 [`Settings`](api.html#scrapy.settings.Settings "scrapy.settings.Settings") 應用程序編程接口。 ## 設置名稱的理由 設置名稱通常以它們配置的組件作為前綴。例如,虛擬robots.txt擴展名的正確設置名稱為 `ROBOTSTXT_ENABLED` , `ROBOTSTXT_OBEY` , `ROBOTSTXT_CACHEDIR` 等。 ## 內置設置參考 以下是所有可用的零碎設置的列表,按字母順序排列,以及它們的默認值和應用范圍。 如果設置綁定到任何特定組件,那么范圍(如果可用)將顯示使用該設置的位置。在這種情況下,將顯示該組件的模塊,通常是擴展、中間件或管道。它還意味著必須啟用組件才能使設置生效。 ### AWS_ACCESS_KEY_ID 違約: `None` 需要訪問的代碼使用的AWS訪問密鑰 [Amazon Web services](https://aws.amazon.com/) ,比如 [S3 feed storage backend](feed-exports.html#topics-feed-storage-s3) . ### AWS_SECRET_ACCESS_KEY 違約: `None` 需要訪問的代碼使用的AWS密鑰 [Amazon Web services](https://aws.amazon.com/) ,比如 [S3 feed storage backend](feed-exports.html#topics-feed-storage-s3) . ### AWS_ENDPOINT_URL 違約: `None` 端點URL用于類似S3的存儲,例如minio或s3.scality。僅支持 `botocore` 類庫。 ### AWS_USE_SSL 違約: `None` 如果要禁用與S3或S3(如存儲)通信的SSL連接,請使用此選項。默認情況下,將使用SSL。僅支持 `botocore` 類庫。 ### AWS_VERIFY 違約: `None` 驗證Scrapy和S3或S3(如存儲)之間的SSL連接。默認情況下,將進行SSL驗證。僅支持 `botocore` 類庫。 ### AWS_REGION_NAME 違約: `None` 與AWS客戶端關聯的區域的名稱。僅支持 `botocore` 類庫。 ### BOT_NAME 違約: `'scrapybot'` 此殘缺項目實現的bot的名稱(也稱為項目名稱)。這將在默認情況下用于構造用戶代理,也用于日志記錄。 當您使用 [`startproject`](commands.html#std:command-startproject) 命令。 ### CONCURRENT_ITEMS 違約: `100` 在項目處理器(也稱為 [Item Pipeline](item-pipeline.html#topics-item-pipeline) ) ### CONCURRENT_REQUESTS 違約: `16` Scrapy下載程序將執行的最大并發(即同時)請求數。 ### CONCURRENT_REQUESTS_PER_DOMAIN 違約: `8` 將對任何單個域執行的最大并發(即同時)請求數。 參見: [AutoThrottle 擴展](autothrottle.html#topics-autothrottle) 及其 [`AUTOTHROTTLE_TARGET_CONCURRENCY`](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) 選擇權。 ### CONCURRENT_REQUESTS_PER_IP 違約: `0` 將對任何單個IP執行的最大并發(即同時)請求數。如果非零, [`CONCURRENT_REQUESTS_PER_DOMAIN`](#std:setting-CONCURRENT_REQUESTS_PER_DOMAIN) 設置被忽略,而是使用此設置。換句話說,并發限制將應用于每個IP,而不是每個域。 此設置還影響 [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 和 [AutoThrottle 擴展](autothrottle.html#topics-autothrottle) 如果 [`CONCURRENT_REQUESTS_PER_IP`](#std:setting-CONCURRENT_REQUESTS_PER_IP) 是非零的,下載延遲是每個IP強制執行的,而不是每個域。 ### DEFAULT_ITEM_CLASS 違約: `'scrapy.item.Item'` 將用于實例化中的項的默認類 [the Scrapy shell](shell.html#topics-shell) . ### DEFAULT_REQUEST_HEADERS 違約:: ```py { 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8', 'Accept-Language': 'en', } ``` 用于 Scrapy HTTP請求的默認頭。他們住在 [`DefaultHeadersMiddleware`](downloader-middleware.html#scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware "scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware") . ### DEPTH_LIMIT 違約: `0` 經營范圍: `scrapy.spidermiddlewares.depth.DepthMiddleware` 允許對任何網站進行爬網的最大深度。如果為零,則不施加限制。 ### DEPTH_PRIORITY 違約: `0` 經營范圍: `scrapy.spidermiddlewares.depth.DepthMiddleware` 用于調整 `priority` A的 [`Request`](request-response.html#scrapy.http.Request "scrapy.http.Request") 根據它的深度。 請求的優先級調整如下: ```py request.priority = request.priority - ( depth * DEPTH_PRIORITY ) ``` 隨著深度的增加,正值為 `DEPTH_PRIORITY` 降低請求優先級(BFO),而負值則提高請求優先級(DFO)。也見 [是寬度優先還是深度優先?](../faq.html#faq-bfo-dfo) . 注解 此設置調整優先級 **in the opposite way** 與其他優先級設置相比 [`REDIRECT_PRIORITY_ADJUST`](#std:setting-REDIRECT_PRIORITY_ADJUST) 和 [`RETRY_PRIORITY_ADJUST`](#std:setting-RETRY_PRIORITY_ADJUST) . ### DEPTH_STATS_VERBOSE 違約: `False` 經營范圍: `scrapy.spidermiddlewares.depth.DepthMiddleware` 是否收集詳細深度統計信息。如果啟用此選項,則在統計信息中收集每個深度的請求數。 ### DNSCACHE_ENABLED 違約: `True` 是否啟用DNS內存緩存。 ### DNSCACHE_SIZE 違約: `10000` DNS內存緩存大小。 ### DNS_TIMEOUT 違約: `60` 處理DNS查詢的超時(秒)。支持浮動。 ### DOWNLOADER 違約: `'scrapy.core.downloader.Downloader'` 用于爬行的下載程序。 ### DOWNLOADER_HTTPCLIENTFACTORY 違約: `'scrapy.core.downloader.webclient.ScrapyHTTPClientFactory'` 定義扭曲 `protocol.ClientFactory` 用于HTTP/1.0連接的類(用于 `HTTP10DownloadHandler` ) 注解 現在很少使用HTTP/1.0,因此您可以安全地忽略此設置,除非您使用twisted&lt;11.1,或者如果您確實想使用HTTP/1.0并重寫 [`DOWNLOAD_HANDLERS_BASE`](#std:setting-DOWNLOAD_HANDLERS_BASE) 對于 `http(s)` 相應的計劃,即 `'scrapy.core.downloader.handlers.http.HTTP10DownloadHandler'` . ### DOWNLOADER_CLIENTCONTEXTFACTORY 違約: `'scrapy.core.downloader.contextfactory.ScrapyClientContextFactory'` 表示要使用的ContextFactory的類路徑。 這里,“ContextFactory”是一個用于SSL/TLS上下文的扭曲術語,它定義了要使用的TLS/SSL協議版本,無論是進行證書驗證,還是甚至啟用客戶端身份驗證(以及其他各種事情)。 注解 剪貼默認上下文工廠 不執行遠程服務器證書驗證. 這對于刮網來說通常是很好的。 如果您確實需要啟用遠程服務器證書驗證,scrapy還可以設置另一個上下文工廠類, `'scrapy.core.downloader.contextfactory.BrowserLikeContextFactory'` ,它使用平臺的證書來驗證遠程端點。[**](#id1)僅當您使用Twisted&gt;14.0.*時才可用。* 如果確實使用自定義ContextFactory,請確保它接受 `method` 參數在init(這是 `OpenSSL.SSL` 方法映射 [`DOWNLOADER_CLIENT_TLS_METHOD`](#std:setting-DOWNLOADER_CLIENT_TLS_METHOD) ) ### DOWNLOADER_CLIENT_TLS_METHOD 違約: `'TLS'` 使用此設置自定義默認HTTP/1.1下載程序使用的TLS/SSL方法。 此設置必須是以下字符串值之一: * `'TLS'` :映射到OpenSSL `TLS_method()` (A.K.A) `SSLv23_method()` ,允許協議協商,從平臺支持的最高點開始;**默認,推薦** * `'TLSv1.0'` :此值強制HTTPS連接使用TLS版本1.0;如果希望scrapy的行為小于1.1,請設置此值。 * `'TLSv1.1'` :強制TLS版本1.1 * `'TLSv1.2'` :強制TLS版本1.2 * `'SSLv3'` :強制SSL版本3(**不推薦**) 注解 我們建議您使用pyopenssl&gt;=0.13和twisted&gt;=0.13或更高版本(如果可以,twisted&gt;=14.0)。 ### DOWNLOADER_MIDDLEWARES 違約:: `{{}}` 包含項目中啟用的下載器中間軟件及其訂單的dict。有關詳細信息,請參閱 [激活下載器中間件](downloader-middleware.html#topics-downloader-middleware-setting) . ### DOWNLOADER_MIDDLEWARES_BASE 違約:: ```py { 'scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware': 100, 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware': 300, 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware': 350, 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware': 400, 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware': 500, 'scrapy.downloadermiddlewares.retry.RetryMiddleware': 550, 'scrapy.downloadermiddlewares.ajaxcrawl.AjaxCrawlMiddleware': 560, 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware': 580, 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware': 590, 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware': 600, 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware': 700, 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware': 750, 'scrapy.downloadermiddlewares.stats.DownloaderStats': 850, 'scrapy.downloadermiddlewares.httpcache.HttpCacheMiddleware': 900, } ``` 包含默認在scrappy中啟用的下載器中間軟件的dict。低階更接近引擎,高階更接近下載器。您不應該在項目中修改此設置,請修改 [`DOWNLOADER_MIDDLEWARES`](#std:setting-DOWNLOADER_MIDDLEWARES) 相反。有關詳細信息,請參閱 [激活下載器中間件](downloader-middleware.html#topics-downloader-middleware-setting) . ### DOWNLOADER_STATS 違約: `True` 是否啟用下載器統計信息收集。 ### DOWNLOAD_DELAY 違約: `0` 下載者從同一網站下載連續頁面之前應等待的時間(以秒計)。這可以用來限制爬行速度,以避免對服務器造成太大的沖擊。支持十進制數。例子:: ```py DOWNLOAD_DELAY = 0.25 # 250 ms of delay ``` 此設置也受 [`RANDOMIZE_DOWNLOAD_DELAY`](#std:setting-RANDOMIZE_DOWNLOAD_DELAY) 設置(默認啟用)。默認情況下,scrappy不會在請求之間等待固定的時間,而是使用0.5之間的隨機間隔* [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 和1.5 * [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) . 什么時候? [`CONCURRENT_REQUESTS_PER_IP`](#std:setting-CONCURRENT_REQUESTS_PER_IP) 為非零,每個IP地址而不是每個域強制延遲。 您還可以通過設置每個 Spider 更改此設置 `download_delay` Spider 屬性。 ### DOWNLOAD_HANDLERS 違約: `{{}}` 包含項目中啟用的請求下載器處理程序的dict。見 [`DOWNLOAD_HANDLERS_BASE`](#std:setting-DOWNLOAD_HANDLERS_BASE) 例如格式。 ### DOWNLOAD_HANDLERS_BASE 違約:: ```py { 'file': 'scrapy.core.downloader.handlers.file.FileDownloadHandler', 'http': 'scrapy.core.downloader.handlers.http.HTTPDownloadHandler', 'https': 'scrapy.core.downloader.handlers.http.HTTPDownloadHandler', 's3': 'scrapy.core.downloader.handlers.s3.S3DownloadHandler', 'ftp': 'scrapy.core.downloader.handlers.ftp.FTPDownloadHandler', } ``` 包含在scrappy中默認啟用的請求下載處理程序的dict。您不應該在項目中修改此設置,請修改 [`DOWNLOAD_HANDLERS`](#std:setting-DOWNLOAD_HANDLERS) 相反。 您可以通過分配 `None` 到他們的URI方案 [`DOWNLOAD_HANDLERS`](#std:setting-DOWNLOAD_HANDLERS) . 例如,要禁用內置的ftp處理程序(不替換),請將其放入 `settings.py` :: ```py DOWNLOAD_HANDLERS = { 'ftp': None, } ``` ### DOWNLOAD_TIMEOUT 違約: `180` 下載程序在超時前等待的時間(以秒計)。 注解 可以使用以下方法設置每個 Spider 的超時 `download_timeout` Spider 屬性和每個請求使用 [`download_timeout`](request-response.html#std:reqmeta-download_timeout) request.meta鍵。 ### DOWNLOAD_MAXSIZE 違約: `1073741824` (1024MB) 下載程序將下載的最大響應大小(字節)。 如果要禁用它,請將其設置為0。 注解 此尺寸可通過使用 `download_maxsize` Spider 屬性和每個請求使用 [`download_maxsize`](#std:reqmeta-download_maxsize) request.meta鍵。 此功能需要扭曲&gt;=11.1。 ### DOWNLOAD_WARNSIZE 違約: `33554432` (32 MB) 下載程序將開始警告的響應大小(字節)。 如果要禁用它,請將其設置為0。 注解 此尺寸可通過使用 `download_warnsize` Spider 屬性和每個請求使用 `download_warnsize` request.meta鍵。 此功能需要扭曲&gt;=11.1。 ### DOWNLOAD_FAIL_ON_DATALOSS 違約: `True` 是否在錯誤的響應上失敗,也就是說,聲明 `Content-Length` 與服務器發送的內容不匹配,或者分塊響應未正確完成。如果 `True` ,這些反應引發了 `ResponseFailed([_DataLoss])` 錯誤。如果 `False` ,這些響應將傳遞給 `dataloss` 添加到響應中,即: `'dataloss' in response.flags` 是 `True` . 或者,可以通過使用 [`download_fail_on_dataloss`](request-response.html#std:reqmeta-download_fail_on_dataloss) 請求.meta鍵 `False` . 注解 從服務器配置錯誤到網絡錯誤,再到數據損壞,在多種情況下可能會發生中斷響應或數據丟失錯誤。由用戶決定處理中斷的響應是否有意義,因為它們可能包含部分或不完整的內容。如果 [`RETRY_ENABLED`](downloader-middleware.html#std:setting-RETRY_ENABLED) 是 `True` 此設置設置為 `True` , the `ResponseFailed([_DataLoss])` 失敗將像往常一樣重試。 ### DUPEFILTER_CLASS 違約: `'scrapy.dupefilters.RFPDupeFilter'` 用于檢測和篩選重復請求的類。 缺省值(默認值) `RFPDupeFilter` )根據請求指紋使用 `scrapy.utils.request.request_fingerprint` 功能。為了更改檢查重復項的方式,可以將 `RFPDupeFilter` 并覆蓋其 `request_fingerprint` 方法。這個方法應該接受slapy [`Request`](request-response.html#scrapy.http.Request "scrapy.http.Request") 對象并返回其指紋(字符串)。 您可以通過設置禁用重復請求的篩選 [`DUPEFILTER_CLASS`](#std:setting-DUPEFILTER_CLASS) 到 `'scrapy.dupefilters.BaseDupeFilter'` . 但是要非常小心,因為您可以進入爬行循環。通常設置 `dont_filter` 參數到 `True` 論具體 [`Request`](request-response.html#scrapy.http.Request "scrapy.http.Request") 這不應該被過濾。 ### DUPEFILTER_DEBUG 違約: `False` 默認情況下, `RFPDupeFilter` 只記錄第一個重復請求。設置 [`DUPEFILTER_DEBUG`](#std:setting-DUPEFILTER_DEBUG) 到 `True` 將使其記錄所有重復的請求。 ### EDITOR 違約: `vi` (在UNIX系統上)或空閑編輯器(在Windows上) 用于編輯 Spider 的編輯器 [`edit`](commands.html#std:command-edit) 命令。此外,如果 `EDITOR` 設置了環境變量, [`edit`](commands.html#std:command-edit) 命令將優先于默認設置。 ### EXTENSIONS 違約:: `{{}}` 包含項目中啟用的擴展及其順序的dict。 ### EXTENSIONS_BASE 違約:: ```py { 'scrapy.extensions.corestats.CoreStats': 0, 'scrapy.extensions.telnet.TelnetConsole': 0, 'scrapy.extensions.memusage.MemoryUsage': 0, 'scrapy.extensions.memdebug.MemoryDebugger': 0, 'scrapy.extensions.closespider.CloseSpider': 0, 'scrapy.extensions.feedexport.FeedExporter': 0, 'scrapy.extensions.logstats.LogStats': 0, 'scrapy.extensions.spiderstate.SpiderState': 0, 'scrapy.extensions.throttle.AutoThrottle': 0, } ``` 包含默認情況下在scrappy中可用的擴展名及其順序的dict。此設置包含所有穩定的內置擴展。請記住,其中一些需要通過設置啟用。 有關更多信息,請參閱 [extensions user guide](extensions.html#topics-extensions) 以及 [list of available extensions](extensions.html#topics-extensions-ref) . ### FEED_TEMPDIR feed temp目錄允許您設置自定義文件夾,以便在上載之前保存crawler臨時文件 [FTP feed storage](feed-exports.html#topics-feed-storage-ftp) 和 [Amazon S3](feed-exports.html#topics-feed-storage-s3) . ### FTP_PASSIVE_MODE 違約: `True` 啟動FTP傳輸時是否使用被動模式。 ### FTP_PASSWORD 違約: `"guest"` 當沒有ftp連接時用于ftp連接的密碼 `"ftp_password"` 在里面 `Request` 元。 注解 釋義 [RFC 1635](https://tools.ietf.org/html/rfc1635) 盡管匿名ftp通常使用密碼“guest”或電子郵件地址,但有些ftp服務器明確要求用戶的電子郵件地址,不允許使用“guest”密碼登錄。 ### FTP_USER 違約: `"anonymous"` 當沒有ftp連接時用于ftp連接的用戶名 `"ftp_user"` 在里面 `Request` 元。 ### ITEM_PIPELINES 違約: `{{}}` 包含要使用的項目管道及其訂單的dict。順序值是任意的,但通常在0-1000范圍內定義它們。低訂單處理優先于高訂單。 例子:: ```py ITEM_PIPELINES = { 'mybot.pipelines.validate.ValidateMyItem': 300, 'mybot.pipelines.validate.StoreMyItem': 800, } ``` ### ITEM_PIPELINES_BASE 違約: `{{}}` 包含默認情況下在Scrapy中啟用的管道的dict。您不應該在項目中修改此設置,請修改 [`ITEM_PIPELINES`](#std:setting-ITEM_PIPELINES) 相反。 ### LOG_ENABLED 違約: `True` 是否啟用日志記錄。 ### LOG_ENCODING 違約: `'utf-8'` 用于日志記錄的編碼。 ### LOG_FILE 違約: `None` 用于日志記錄輸出的文件名。如果 `None` ,將使用標準錯誤。 ### LOG_FORMAT 違約: `'%(asctime)s [%(name)s] %(levelname)s: %(message)s'` 用于格式化日志消息的字符串。參考 [Python logging documentation](https://docs.python.org/2/library/logging.html#logrecord-attributes) 對于可用占位符的整個列表。 ### LOG_DATEFORMAT 違約: `'%Y-%m-%d %H:%M:%S'` 用于格式化日期/時間的字符串,擴展 `%(asctime)s` 占位符 [`LOG_FORMAT`](#std:setting-LOG_FORMAT) . 參考 [Python datetime documentation](https://docs.python.org/2/library/datetime.html#strftime-and-strptime-behavior) 對于可用指令的整個列表。 ### LOG_LEVEL 違約: `'DEBUG'` 要記錄的最低級別。可用級別包括:嚴重、錯誤、警告、信息、調試。有關詳細信息,請參閱 [Logging](logging.html#topics-logging) . ### LOG_STDOUT 違約: `False` 如果 `True` ,進程的所有標準輸出(和錯誤)都將重定向到日志。例如,如果你 `print('hello')` 它會出現在殘缺的木頭上。 ### LOG_SHORT_NAMES 違約: `False` 如果 `True` 日志只包含根路徑。如果設置為 `False` 然后顯示負責日志輸出的組件 ### MEMDEBUG_ENABLED 違約: `False` 是否啟用內存調試。 ### MEMDEBUG_NOTIFY 違約: `[]` 當啟用內存調試時,如果此設置不為空,則會將內存報告發送到指定的地址,否則報告將寫入日志。 例子:: ```py MEMDEBUG_NOTIFY = ['user@example.com'] ``` ### MEMUSAGE_ENABLED 違約: `True` 經營范圍: `scrapy.extensions.memusage` 是否啟用內存使用擴展。此擴展跟蹤進程使用的峰值內存(它將其寫入統計信息)。它還可以選擇在超過內存限制時關閉碎片進程(請參見 [`MEMUSAGE_LIMIT_MB`](#std:setting-MEMUSAGE_LIMIT_MB) ,并在發生這種情況時通過電子郵件通知(請參見 [`MEMUSAGE_NOTIFY_MAIL`](#std:setting-MEMUSAGE_NOTIFY_MAIL) ) 見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) . ### MEMUSAGE_LIMIT_MB 違約: `0` 經營范圍: `scrapy.extensions.memusage` 關閉scrappy前允許的最大內存量(以兆字節為單位)(如果memusage_enabled為true)。如果為零,則不執行任何檢查。 見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) . ### MEMUSAGE_CHECK_INTERVAL_SECONDS 1.1 新版功能. 違約: `60.0` 經營范圍: `scrapy.extensions.memusage` 這個 [Memory usage extension](extensions.html#topics-extensions-ref-memusage) 檢查當前內存使用情況,與 [`MEMUSAGE_LIMIT_MB`](#std:setting-MEMUSAGE_LIMIT_MB) 和 [`MEMUSAGE_WARNING_MB`](#std:setting-MEMUSAGE_WARNING_MB) ,以固定的時間間隔。 這將以秒為單位設置這些間隔的長度。 見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) . ### MEMUSAGE_NOTIFY_MAIL 違約: `False` 經營范圍: `scrapy.extensions.memusage` 通知是否達到內存限制的電子郵件列表。 例子:: ```py MEMUSAGE_NOTIFY_MAIL = ['user@example.com'] ``` 見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) . ### MEMUSAGE_WARNING_MB 違約: `0` 經營范圍: `scrapy.extensions.memusage` 發送警告電子郵件通知前允許的最大內存量(以兆字節為單位)。如果為零,則不會產生警告。 ### NEWSPIDER_MODULE 違約: `''` 模塊在何處使用 [`genspider`](commands.html#std:command-genspider) 命令。 例子:: ```py NEWSPIDER_MODULE = 'mybot.spiders_dev' ``` ### RANDOMIZE_DOWNLOAD_DELAY 違約: `True` 如果啟用,Scrapy將隨機等待一段時間(0.5之間* [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 和1.5 * [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) )同時從同一網站獲取請求。 這種隨機化減少了爬蟲被站點檢測(并隨后被阻止)的機會,這些站點分析請求,尋找它們請求之間的時間有統計學意義的相似性。 隨機化策略與 [wget](https://www.gnu.org/software/wget/manual/wget.html) `--random-wait` 選擇權。 如果 [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 為零(默認值)此選項無效。 ### REACTOR_THREADPOOL_MAXSIZE 違約: `10` 扭曲反應器線程池大小的最大限制。這是各種 Scrapy 組件使用的通用多用途線程池。線程DNS解析器,blockingfeedstorage,s3filestore等等。如果遇到阻塞IO不足的問題,請增加此值。 ### REDIRECT_MAX_TIMES 違約: `20` 定義可以重定向請求的最大次數。在此最大值之后,請求的響應將按原樣返回。我們對同一個任務使用了firefox默認值。 ### REDIRECT_PRIORITY_ADJUST 違約: `+2` 經營范圍: `scrapy.downloadermiddlewares.redirect.RedirectMiddleware` 相對于原始請求調整重定向請求優先級: * **正優先級調整(默認)意味著更高的優先級。** * 負優先級調整意味著低優先級。 ### RETRY_PRIORITY_ADJUST 違約: `-1` 經營范圍: `scrapy.downloadermiddlewares.retry.RetryMiddleware` 相對于原始請求調整重試請求優先級: * 積極的優先級調整意味著更高的優先級。 * **負優先級調整(默認)意味著低優先級。** ### ROBOTSTXT_OBEY 違約: `False` 經營范圍: `scrapy.downloadermiddlewares.robotstxt` 如果啟用,scrapy將遵守robots.txt策略。有關詳細信息,請參閱 [RobotsTxtMiddleware](downloader-middleware.html#topics-dlmw-robots) . 注解 當默認值為 `False` 出于歷史原因,默認情況下,此選項在由生成的settings.py文件中啟用。 `scrapy startproject` 命令。 ### SCHEDULER 違約: `'scrapy.core.scheduler.Scheduler'` 用于爬網的計劃程序。 ### SCHEDULER_DEBUG 違約: `False` 設置為 `True` 將記錄有關請求計劃程序的調試信息。如果無法將請求序列化到磁盤,則當前只記錄一次。統計計數器 `scheduler/unserializable` )跟蹤發生這種情況的次數。 日志中的示例條目: ```py 1956-01-31 00:00:00+0800 [scrapy.core.scheduler] ERROR: Unable to serialize request: <GET http://example.com> - reason: cannot serialize <Request at 0x9a7c7ec> (type Request)> - no more unserializable requests will be logged (see 'scheduler/unserializable' stats counter) ``` ### SCHEDULER_DISK_QUEUE 違約: `'scrapy.squeues.PickleLifoDiskQueue'` 計劃程序將使用的磁盤隊列類型。其他可用類型包括 `scrapy.squeues.PickleFifoDiskQueue` , `scrapy.squeues.MarshalFifoDiskQueue` , `scrapy.squeues.MarshalLifoDiskQueue` . ### SCHEDULER_MEMORY_QUEUE 違約: `'scrapy.squeues.LifoMemoryQueue'` 調度程序使用的內存中隊列的類型。其他可用類型為: `scrapy.squeues.FifoMemoryQueue` . ### SCHEDULER_PRIORITY_QUEUE 違約: `'queuelib.PriorityQueue'` 計劃程序使用的優先級隊列的類型。 ### SPIDER_CONTRACTS 違約:: `{{}}` 包含項目中啟用的 Spider 合約的dict,用于測試 Spider 。有關詳細信息,請參閱 [Spider 合約](contracts.html#topics-contracts) . ### SPIDER_CONTRACTS_BASE 違約:: ```py { 'scrapy.contracts.default.UrlContract' : 1, 'scrapy.contracts.default.ReturnsContract': 2, 'scrapy.contracts.default.ScrapesContract': 3, } ``` 包含默認情況下在Scrapy中啟用的Scrapy合同的dict。您不應該在項目中修改此設置,請修改 [`SPIDER_CONTRACTS`](#std:setting-SPIDER_CONTRACTS) 相反。有關詳細信息,請參閱 [Spider 合約](contracts.html#topics-contracts) . 您可以通過分配 `None` 去他們的類 [`SPIDER_CONTRACTS`](#std:setting-SPIDER_CONTRACTS) . 例如,禁用內置 `ScrapesContract` 把這個放在你的 `settings.py` :: ```py SPIDER_CONTRACTS = { 'scrapy.contracts.default.ScrapesContract': None, } ``` ### SPIDER_LOADER_CLASS 違約: `'scrapy.spiderloader.SpiderLoader'` 將用于加載spider的類,該類必須實現 [SpiderLoader API](api.html#topics-api-spiderloader) . ### SPIDER_LOADER_WARN_ONLY 1.3.3 新版功能. 違約: `False` 默認情況下,當Scrapy嘗試從 [`SPIDER_MODULES`](#std:setting-SPIDER_MODULES) 如果有的話,它會很響地失效。 `ImportError` 例外。但是您可以選擇沉默這個異常,并通過設置將它變成一個簡單的警告 `SPIDER_LOADER_WARN_ONLY = True` . 注解 一些 [scrapy commands](commands.html#topics-commands) 使用此設置運行到 `True` 已經(即,它們只會發出警告,不會失敗),因為它們實際上不需要加載 Spider 類來工作: [`scrapy runspider`](commands.html#std:command-runspider) , [`scrapy settings`](commands.html#std:command-settings) , [`scrapy startproject`](commands.html#std:command-startproject) , [`scrapy version`](commands.html#std:command-version) . ### SPIDER_MIDDLEWARES 違約:: `{{}}` 包含項目中啟用的 Spider 中間件及其訂單的dict。有關詳細信息,請參閱 [激活 Spider 中間件](spider-middleware.html#topics-spider-middleware-setting) . ### SPIDER_MIDDLEWARES_BASE 違約:: ```py { 'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware': 50, 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware': 500, 'scrapy.spidermiddlewares.referer.RefererMiddleware': 700, 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware': 800, 'scrapy.spidermiddlewares.depth.DepthMiddleware': 900, } ``` 包含spider中間件的dict,默認情況下在scrappy中啟用,以及它們的順序。低階更接近發動機,高階更接近 Spider 。有關詳細信息,請參閱 [激活 Spider 中間件](spider-middleware.html#topics-spider-middleware-setting) . ### SPIDER_MODULES 違約: `[]` Scrapy將在其中查找 Spider 的模塊列表。 例子:: ```py SPIDER_MODULES = ['mybot.spiders_prod', 'mybot.spiders_dev'] ``` ### STATS_CLASS 違約: `'scrapy.statscollectors.MemoryStatsCollector'` 用于收集統計信息的類,必須實現 [統計收集器API](api.html#topics-api-stats) . ### STATS_DUMP 違約: `True` 轉儲 [Scrapy stats](stats.html#topics-stats) (對著殘破的木頭)一旦 Spider 完成。 有關詳細信息,請參閱: [統計數據集合](stats.html#topics-stats) . ### STATSMAILER_RCPTS 違約: `[]` (空表) Spider 完成抓取后發送殘缺數據。見 `StatsMailer` 更多信息。 ### TELNETCONSOLE_ENABLED 違約: `True` 一個布爾值,指定 [telnet console](telnetconsole.html#topics-telnetconsole) 將被啟用(前提是它的擴展也被啟用)。 ### TELNETCONSOLE_PORT 違約: `[6023, 6073]` 用于telnet控制臺的端口范圍。如果設置為 `None` 或 `0` ,使用動態分配的端口。有關詳細信息,請參閱 [遠程登錄控制臺](telnetconsole.html#topics-telnetconsole) . ### TEMPLATES_DIR 違約: `templates` 廢料模塊內部目錄 創建新項目時要在其中查找模板的目錄 [`startproject`](commands.html#std:command-startproject) 命令和新 Spider [`genspider`](commands.html#std:command-genspider) 命令。 項目名稱不得與中自定義文件或目錄的名稱沖突。 `project` 子目錄。 ### URLLENGTH_LIMIT 違約: `2083` 經營范圍: `spidermiddlewares.urllength` 允許已爬網URL的最大URL長度。有關此設置的默認值的詳細信息,請參閱:[https://boutell.com/newfaq/misc/urllength.html](https://boutell.com/newfaq/misc/urllength.html) ### USER_AGENT 違約: `"Scrapy/VERSION (+https://scrapy.org)"` 在爬網時使用的默認用戶代理,除非被重寫。 ### 其他地方記錄的設置: 以下設置記錄在其他地方,請檢查每個特定案例以了解如何啟用和使用它們。 * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGE_S3_ACL](feed-exports.html#std:setting-FEED_STORAGE_S3_ACL) * [FEED_STORAGE_S3_ACL](feed-exports.html#std:setting-FEED_STORAGE_S3_ACL) * [FEED_STORAGE_S3_ACL](feed-exports.html#std:setting-FEED_STORAGE_S3_ACL) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME)
                  <ruby id="bdb3f"></ruby>

                  <p id="bdb3f"><cite id="bdb3f"></cite></p>

                    <p id="bdb3f"><cite id="bdb3f"><th id="bdb3f"></th></cite></p><p id="bdb3f"></p>
                      <p id="bdb3f"><cite id="bdb3f"></cite></p>

                        <pre id="bdb3f"></pre>
                        <pre id="bdb3f"><del id="bdb3f"><thead id="bdb3f"></thead></del></pre>

                        <ruby id="bdb3f"><mark id="bdb3f"></mark></ruby><ruby id="bdb3f"></ruby>
                        <pre id="bdb3f"><pre id="bdb3f"><mark id="bdb3f"></mark></pre></pre><output id="bdb3f"></output><p id="bdb3f"></p><p id="bdb3f"></p>

                        <pre id="bdb3f"><del id="bdb3f"><progress id="bdb3f"></progress></del></pre>

                              <ruby id="bdb3f"></ruby>

                              哎呀哎呀视频在线观看