設置 · Scrapy 1.6 中文文檔

# 設置 > 譯者：[OSGeo 中國](https://www.osgeo.cn/) Scrapy設置允許您自定義所有Scrapy組件的行為，包括核心、擴展、管道和spider本身。設置的基礎結構提供了鍵值映射的全局命名空間，代碼可以使用該命名空間從中提取配置值。可以通過下面描述的不同機制填充設置。這些設置也是選擇當前活動的Scrapy項目（如果您有許多項目）的機制。有關可用內置設置的列表，請參閱： [內置設置參考](#topics-settings-ref) . ## 指定設置當你使用Scrapy時，你必須告訴它你使用的設置。您可以通過使用環境變量， `SCRAPY_SETTINGS_MODULE` . 價值 `SCRAPY_SETTINGS_MODULE` 應該使用python路徑語法，例如 `myproject.settings` . 注意，設置模塊應該在python上 [import search path](https://docs.python.org/2/tutorial/modules.html#the-module-search-path) . ## 填充設置可以使用不同的機制填充設置，每個機制具有不同的優先級。以下是按優先級降序排列的列表： > 1. 命令行選項（最優先） > 2. 每個 Spider 的設置 > 3. 項目設置模塊 > 4. 每個命令的默認設置 > 5. 默認全局設置（優先級較低）這些設置源的填充是在內部處理的，但是可以使用API調用進行手動處理。見 [設置API](api.html#topics-api-settings) 供參考的主題。下面將更詳細地描述這些機制。 ### 1。命令行選項命令行提供的參數是最優先的參數，覆蓋了任何其他選項。您可以使用 `-s` （或） `--set` ）命令行選項。例子：： ```py scrapy crawl myspider -s LOG_FILE=scrapy.log ``` ### 2。每個 Spider 的設置 Spider （見 [Spider](spiders.html#topics-spiders) 章節供參考）可以定義它們自己的設置，這些設置將優先并覆蓋項目設置。他們可以通過設置 [`custom_settings`](spiders.html#scrapy.spiders.Spider.custom_settings "scrapy.spiders.Spider.custom_settings") 屬性： ```py class MySpider(scrapy.Spider): name = 'myspider' custom_settings = { 'SOME_SETTING': 'some value', } ``` ### 三。項目設置模塊項目設置模塊是 Scrapy 項目的標準配置文件，它將填充大部分自定義設置。對于標準的Scrapy項目，這意味著您將在 `settings.py` 為項目創建的文件。 ### 4。每個命令的默認設置各 [Scrapy tool](commands.html) 命令可以有自己的默認設置，這將覆蓋全局默認設置。這些自定義命令設置在 `default_settings` 命令類的屬性。 ### 5。默認全局設置全局默認值位于 `scrapy.settings.default_settings` 并記錄在 [內置設置參考](#topics-settings-ref) 部分。 ## 如何訪問設置在Spider中，可以通過 `self.settings` ：： ```py class MySpider(scrapy.Spider): name = 'myspider' start_urls = ['http://example.com'] def parse(self, response): print("Existing settings: %s" % self.settings.attributes.keys()) ``` 注解這個 `settings` 屬性在Spider初始化后在基本Spider類中設置。如果要在初始化之前使用這些設置（例如，在Spider的 `__init__()` 方法），您需要重寫 [`from_crawler()`](spiders.html#scrapy.spiders.Spider.from_crawler "scrapy.spiders.Spider.from_crawler") 方法。可以通過訪問 [`scrapy.crawler.Crawler.settings`](api.html#scrapy.crawler.Crawler.settings "scrapy.crawler.Crawler.settings") 傳遞給的爬網程序的屬性 `from_crawler` 擴展、中間商和項目管道中的方法： ```py class MyExtension(object): def __init__(self, log_is_enabled=False): if log_is_enabled: print("log is enabled!") @classmethod def from_crawler(cls, crawler): settings = crawler.settings return cls(settings.getbool('LOG_ENABLED')) ``` 設置對象可以像dict一樣使用（例如， `settings['LOG_ENABLED']` ，但通常最好使用 [`Settings`](api.html#scrapy.settings.Settings "scrapy.settings.Settings") 應用程序編程接口。 ## 設置名稱的理由設置名稱通常以它們配置的組件作為前綴。例如，虛擬robots.txt擴展名的正確設置名稱為 `ROBOTSTXT_ENABLED` ， `ROBOTSTXT_OBEY` ， `ROBOTSTXT_CACHEDIR` 等。 ## 內置設置參考以下是所有可用的零碎設置的列表，按字母順序排列，以及它們的默認值和應用范圍。如果設置綁定到任何特定組件，那么范圍（如果可用）將顯示使用該設置的位置。在這種情況下，將顯示該組件的模塊，通常是擴展、中間件或管道。它還意味著必須啟用組件才能使設置生效。 ### AWS_ACCESS_KEY_ID 違約： `None` 需要訪問的代碼使用的AWS訪問密鑰 [Amazon Web services](https://aws.amazon.com/) ，比如 [S3 feed storage backend](feed-exports.html#topics-feed-storage-s3) . ### AWS_SECRET_ACCESS_KEY 違約： `None` 需要訪問的代碼使用的AWS密鑰 [Amazon Web services](https://aws.amazon.com/) ，比如 [S3 feed storage backend](feed-exports.html#topics-feed-storage-s3) . ### AWS_ENDPOINT_URL 違約： `None` 端點URL用于類似S3的存儲，例如minio或s3.scality。僅支持 `botocore` 類庫。 ### AWS_USE_SSL 違約： `None` 如果要禁用與S3或S3（如存儲）通信的SSL連接，請使用此選項。默認情況下，將使用SSL。僅支持 `botocore` 類庫。 ### AWS_VERIFY 違約： `None` 驗證Scrapy和S3或S3（如存儲）之間的SSL連接。默認情況下，將進行SSL驗證。僅支持 `botocore` 類庫。 ### AWS_REGION_NAME 違約： `None` 與AWS客戶端關聯的區域的名稱。僅支持 `botocore` 類庫。 ### BOT_NAME 違約： `'scrapybot'` 此殘缺項目實現的bot的名稱（也稱為項目名稱）。這將在默認情況下用于構造用戶代理，也用于日志記錄。當您使用 [`startproject`](commands.html#std:command-startproject) 命令。 ### CONCURRENT_ITEMS 違約： `100` 在項目處理器（也稱為 [Item Pipeline](item-pipeline.html#topics-item-pipeline) ） ### CONCURRENT_REQUESTS 違約： `16` Scrapy下載程序將執行的最大并發（即同時）請求數。 ### CONCURRENT_REQUESTS_PER_DOMAIN 違約： `8` 將對任何單個域執行的最大并發（即同時）請求數。參見： [AutoThrottle 擴展](autothrottle.html#topics-autothrottle) 及其 [`AUTOTHROTTLE_TARGET_CONCURRENCY`](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) 選擇權。 ### CONCURRENT_REQUESTS_PER_IP 違約： `0` 將對任何單個IP執行的最大并發（即同時）請求數。如果非零， [`CONCURRENT_REQUESTS_PER_DOMAIN`](#std:setting-CONCURRENT_REQUESTS_PER_DOMAIN) 設置被忽略，而是使用此設置。換句話說，并發限制將應用于每個IP，而不是每個域。此設置還影響 [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 和 [AutoThrottle 擴展](autothrottle.html#topics-autothrottle) 如果 [`CONCURRENT_REQUESTS_PER_IP`](#std:setting-CONCURRENT_REQUESTS_PER_IP) 是非零的，下載延遲是每個IP強制執行的，而不是每個域。 ### DEFAULT_ITEM_CLASS 違約： `'scrapy.item.Item'` 將用于實例化中的項的默認類 [the Scrapy shell](shell.html#topics-shell) . ### DEFAULT_REQUEST_HEADERS 違約：： ```py { 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8', 'Accept-Language': 'en', } ``` 用于 Scrapy HTTP請求的默認頭。他們住在 [`DefaultHeadersMiddleware`](downloader-middleware.html#scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware "scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware") . ### DEPTH_LIMIT 違約： `0` 經營范圍： `scrapy.spidermiddlewares.depth.DepthMiddleware` 允許對任何網站進行爬網的最大深度。如果為零，則不施加限制。 ### DEPTH_PRIORITY 違約： `0` 經營范圍： `scrapy.spidermiddlewares.depth.DepthMiddleware` 用于調整 `priority` A的 [`Request`](request-response.html#scrapy.http.Request "scrapy.http.Request") 根據它的深度。請求的優先級調整如下： ```py request.priority = request.priority - ( depth * DEPTH_PRIORITY ) ``` 隨著深度的增加，正值為 `DEPTH_PRIORITY` 降低請求優先級（BFO），而負值則提高請求優先級（DFO）。也見 [是寬度優先還是深度優先？](../faq.html#faq-bfo-dfo) . 注解此設置調整優先級 **in the opposite way** 與其他優先級設置相比 [`REDIRECT_PRIORITY_ADJUST`](#std:setting-REDIRECT_PRIORITY_ADJUST) 和 [`RETRY_PRIORITY_ADJUST`](#std:setting-RETRY_PRIORITY_ADJUST) . ### DEPTH_STATS_VERBOSE 違約： `False` 經營范圍： `scrapy.spidermiddlewares.depth.DepthMiddleware` 是否收集詳細深度統計信息。如果啟用此選項，則在統計信息中收集每個深度的請求數。 ### DNSCACHE_ENABLED 違約： `True` 是否啟用DNS內存緩存。 ### DNSCACHE_SIZE 違約： `10000` DNS內存緩存大小。 ### DNS_TIMEOUT 違約： `60` 處理DNS查詢的超時（秒）。支持浮動。 ### DOWNLOADER 違約： `'scrapy.core.downloader.Downloader'` 用于爬行的下載程序。 ### DOWNLOADER_HTTPCLIENTFACTORY 違約： `'scrapy.core.downloader.webclient.ScrapyHTTPClientFactory'` 定義扭曲 `protocol.ClientFactory` 用于HTTP/1.0連接的類（用于 `HTTP10DownloadHandler` ）注解現在很少使用HTTP/1.0，因此您可以安全地忽略此設置，除非您使用twisted<11.1，或者如果您確實想使用HTTP/1.0并重寫 [`DOWNLOAD_HANDLERS_BASE`](#std:setting-DOWNLOAD_HANDLERS_BASE) 對于 `http(s)` 相應的計劃，即 `'scrapy.core.downloader.handlers.http.HTTP10DownloadHandler'` . ### DOWNLOADER_CLIENTCONTEXTFACTORY 違約： `'scrapy.core.downloader.contextfactory.ScrapyClientContextFactory'` 表示要使用的ContextFactory的類路徑。這里，“ContextFactory”是一個用于SSL/TLS上下文的扭曲術語，它定義了要使用的TLS/SSL協議版本，無論是進行證書驗證，還是甚至啟用客戶端身份驗證（以及其他各種事情）。注解剪貼默認上下文工廠不執行遠程服務器證書驗證. 這對于刮網來說通常是很好的。如果您確實需要啟用遠程服務器證書驗證，scrapy還可以設置另一個上下文工廠類， `'scrapy.core.downloader.contextfactory.BrowserLikeContextFactory'` ，它使用平臺的證書來驗證遠程端點。[**](#id1)僅當您使用Twisted>14.0.*時才可用。* 如果確實使用自定義ContextFactory，請確保它接受 `method` 參數在init（這是 `OpenSSL.SSL` 方法映射 [`DOWNLOADER_CLIENT_TLS_METHOD`](#std:setting-DOWNLOADER_CLIENT_TLS_METHOD) ） ### DOWNLOADER_CLIENT_TLS_METHOD 違約： `'TLS'` 使用此設置自定義默認HTTP/1.1下載程序使用的TLS/SSL方法。此設置必須是以下字符串值之一： * `'TLS'` ：映射到OpenSSL `TLS_method()` （A.K.A） `SSLv23_method()` ，允許協議協商，從平臺支持的最高點開始；**默認，推薦** * `'TLSv1.0'` ：此值強制HTTPS連接使用TLS版本1.0；如果希望scrapy的行為小于1.1，請設置此值。 * `'TLSv1.1'` ：強制TLS版本1.1 * `'TLSv1.2'` ：強制TLS版本1.2 * `'SSLv3'` ：強制SSL版本3（**不推薦**）注解我們建議您使用pyopenssl>=0.13和twisted>=0.13或更高版本（如果可以，twisted>=14.0）。 ### DOWNLOADER_MIDDLEWARES 違約：： `{{}}` 包含項目中啟用的下載器中間軟件及其訂單的dict。有關詳細信息，請參閱 [激活下載器中間件](downloader-middleware.html#topics-downloader-middleware-setting) . ### DOWNLOADER_MIDDLEWARES_BASE 違約：： ```py { 'scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware': 100, 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware': 300, 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware': 350, 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware': 400, 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware': 500, 'scrapy.downloadermiddlewares.retry.RetryMiddleware': 550, 'scrapy.downloadermiddlewares.ajaxcrawl.AjaxCrawlMiddleware': 560, 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware': 580, 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware': 590, 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware': 600, 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware': 700, 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware': 750, 'scrapy.downloadermiddlewares.stats.DownloaderStats': 850, 'scrapy.downloadermiddlewares.httpcache.HttpCacheMiddleware': 900, } ``` 包含默認在scrappy中啟用的下載器中間軟件的dict。低階更接近引擎，高階更接近下載器。您不應該在項目中修改此設置，請修改 [`DOWNLOADER_MIDDLEWARES`](#std:setting-DOWNLOADER_MIDDLEWARES) 相反。有關詳細信息，請參閱 [激活下載器中間件](downloader-middleware.html#topics-downloader-middleware-setting) . ### DOWNLOADER_STATS 違約： `True` 是否啟用下載器統計信息收集。 ### DOWNLOAD_DELAY 違約： `0` 下載者從同一網站下載連續頁面之前應等待的時間（以秒計）。這可以用來限制爬行速度，以避免對服務器造成太大的沖擊。支持十進制數。例子：： ```py DOWNLOAD_DELAY = 0.25 # 250 ms of delay ``` 此設置也受 [`RANDOMIZE_DOWNLOAD_DELAY`](#std:setting-RANDOMIZE_DOWNLOAD_DELAY) 設置（默認啟用）。默認情況下，scrappy不會在請求之間等待固定的時間，而是使用0.5之間的隨機間隔* [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 和1.5 * [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) . 什么時候？ [`CONCURRENT_REQUESTS_PER_IP`](#std:setting-CONCURRENT_REQUESTS_PER_IP) 為非零，每個IP地址而不是每個域強制延遲。您還可以通過設置每個 Spider 更改此設置 `download_delay` Spider 屬性。 ### DOWNLOAD_HANDLERS 違約： `{{}}` 包含項目中啟用的請求下載器處理程序的dict。見 [`DOWNLOAD_HANDLERS_BASE`](#std:setting-DOWNLOAD_HANDLERS_BASE) 例如格式。 ### DOWNLOAD_HANDLERS_BASE 違約：： ```py { 'file': 'scrapy.core.downloader.handlers.file.FileDownloadHandler', 'http': 'scrapy.core.downloader.handlers.http.HTTPDownloadHandler', 'https': 'scrapy.core.downloader.handlers.http.HTTPDownloadHandler', 's3': 'scrapy.core.downloader.handlers.s3.S3DownloadHandler', 'ftp': 'scrapy.core.downloader.handlers.ftp.FTPDownloadHandler', } ``` 包含在scrappy中默認啟用的請求下載處理程序的dict。您不應該在項目中修改此設置，請修改 [`DOWNLOAD_HANDLERS`](#std:setting-DOWNLOAD_HANDLERS) 相反。您可以通過分配 `None` 到他們的URI方案 [`DOWNLOAD_HANDLERS`](#std:setting-DOWNLOAD_HANDLERS) . 例如，要禁用內置的ftp處理程序（不替換），請將其放入 `settings.py` ：： ```py DOWNLOAD_HANDLERS = { 'ftp': None, } ``` ### DOWNLOAD_TIMEOUT 違約： `180` 下載程序在超時前等待的時間（以秒計）。注解可以使用以下方法設置每個 Spider 的超時 `download_timeout` Spider 屬性和每個請求使用 [`download_timeout`](request-response.html#std:reqmeta-download_timeout) request.meta鍵。 ### DOWNLOAD_MAXSIZE 違約： `1073741824` （1024MB）下載程序將下載的最大響應大小（字節）。如果要禁用它，請將其設置為0。注解此尺寸可通過使用 `download_maxsize` Spider 屬性和每個請求使用 [`download_maxsize`](#std:reqmeta-download_maxsize) request.meta鍵。此功能需要扭曲>=11.1。 ### DOWNLOAD_WARNSIZE 違約： `33554432` （32 MB）下載程序將開始警告的響應大小（字節）。如果要禁用它，請將其設置為0。注解此尺寸可通過使用 `download_warnsize` Spider 屬性和每個請求使用 `download_warnsize` request.meta鍵。此功能需要扭曲>=11.1。 ### DOWNLOAD_FAIL_ON_DATALOSS 違約： `True` 是否在錯誤的響應上失敗，也就是說，聲明 `Content-Length` 與服務器發送的內容不匹配，或者分塊響應未正確完成。如果 `True` ，這些反應引發了 `ResponseFailed([_DataLoss])` 錯誤。如果 `False` ，這些響應將傳遞給 `dataloss` 添加到響應中，即： `'dataloss' in response.flags` 是 `True` . 或者，可以通過使用 [`download_fail_on_dataloss`](request-response.html#std:reqmeta-download_fail_on_dataloss) 請求.meta鍵 `False` . 注解從服務器配置錯誤到網絡錯誤，再到數據損壞，在多種情況下可能會發生中斷響應或數據丟失錯誤。由用戶決定處理中斷的響應是否有意義，因為它們可能包含部分或不完整的內容。如果 [`RETRY_ENABLED`](downloader-middleware.html#std:setting-RETRY_ENABLED) 是 `True` 此設置設置為 `True` , the `ResponseFailed([_DataLoss])` 失敗將像往常一樣重試。 ### DUPEFILTER_CLASS 違約： `'scrapy.dupefilters.RFPDupeFilter'` 用于檢測和篩選重復請求的類。缺省值（默認值） `RFPDupeFilter` ）根據請求指紋使用 `scrapy.utils.request.request_fingerprint` 功能。為了更改檢查重復項的方式，可以將 `RFPDupeFilter` 并覆蓋其 `request_fingerprint` 方法。這個方法應該接受slapy [`Request`](request-response.html#scrapy.http.Request "scrapy.http.Request") 對象并返回其指紋（字符串）。您可以通過設置禁用重復請求的篩選 [`DUPEFILTER_CLASS`](#std:setting-DUPEFILTER_CLASS) 到 `'scrapy.dupefilters.BaseDupeFilter'` . 但是要非常小心，因為您可以進入爬行循環。通常設置 `dont_filter` 參數到 `True` 論具體 [`Request`](request-response.html#scrapy.http.Request "scrapy.http.Request") 這不應該被過濾。 ### DUPEFILTER_DEBUG 違約： `False` 默認情況下， `RFPDupeFilter` 只記錄第一個重復請求。設置 [`DUPEFILTER_DEBUG`](#std:setting-DUPEFILTER_DEBUG) 到 `True` 將使其記錄所有重復的請求。 ### EDITOR 違約： `vi` （在UNIX系統上）或空閑編輯器（在Windows上）用于編輯 Spider 的編輯器 [`edit`](commands.html#std:command-edit) 命令。此外，如果 `EDITOR` 設置了環境變量， [`edit`](commands.html#std:command-edit) 命令將優先于默認設置。 ### EXTENSIONS 違約：： `{{}}` 包含項目中啟用的擴展及其順序的dict。 ### EXTENSIONS_BASE 違約：： ```py { 'scrapy.extensions.corestats.CoreStats': 0, 'scrapy.extensions.telnet.TelnetConsole': 0, 'scrapy.extensions.memusage.MemoryUsage': 0, 'scrapy.extensions.memdebug.MemoryDebugger': 0, 'scrapy.extensions.closespider.CloseSpider': 0, 'scrapy.extensions.feedexport.FeedExporter': 0, 'scrapy.extensions.logstats.LogStats': 0, 'scrapy.extensions.spiderstate.SpiderState': 0, 'scrapy.extensions.throttle.AutoThrottle': 0, } ``` 包含默認情況下在scrappy中可用的擴展名及其順序的dict。此設置包含所有穩定的內置擴展。請記住，其中一些需要通過設置啟用。有關更多信息，請參閱 [extensions user guide](extensions.html#topics-extensions) 以及 [list of available extensions](extensions.html#topics-extensions-ref) . ### FEED_TEMPDIR feed temp目錄允許您設置自定義文件夾，以便在上載之前保存crawler臨時文件 [FTP feed storage](feed-exports.html#topics-feed-storage-ftp) 和 [Amazon S3](feed-exports.html#topics-feed-storage-s3) . ### FTP_PASSIVE_MODE 違約： `True` 啟動FTP傳輸時是否使用被動模式。 ### FTP_PASSWORD 違約： `"guest"` 當沒有ftp連接時用于ftp連接的密碼 `"ftp_password"` 在里面 `Request` 元。注解釋義 [RFC 1635](https://tools.ietf.org/html/rfc1635) 盡管匿名ftp通常使用密碼“guest”或電子郵件地址，但有些ftp服務器明確要求用戶的電子郵件地址，不允許使用“guest”密碼登錄。 ### FTP_USER 違約： `"anonymous"` 當沒有ftp連接時用于ftp連接的用戶名 `"ftp_user"` 在里面 `Request` 元。 ### ITEM_PIPELINES 違約： `{{}}` 包含要使用的項目管道及其訂單的dict。順序值是任意的，但通常在0-1000范圍內定義它們。低訂單處理優先于高訂單。例子：： ```py ITEM_PIPELINES = { 'mybot.pipelines.validate.ValidateMyItem': 300, 'mybot.pipelines.validate.StoreMyItem': 800, } ``` ### ITEM_PIPELINES_BASE 違約： `{{}}` 包含默認情況下在Scrapy中啟用的管道的dict。您不應該在項目中修改此設置，請修改 [`ITEM_PIPELINES`](#std:setting-ITEM_PIPELINES) 相反。 ### LOG_ENABLED 違約： `True` 是否啟用日志記錄。 ### LOG_ENCODING 違約： `'utf-8'` 用于日志記錄的編碼。 ### LOG_FILE 違約： `None` 用于日志記錄輸出的文件名。如果 `None` ，將使用標準錯誤。 ### LOG_FORMAT 違約： `'%(asctime)s [%(name)s] %(levelname)s: %(message)s'` 用于格式化日志消息的字符串。參考 [Python logging documentation](https://docs.python.org/2/library/logging.html#logrecord-attributes) 對于可用占位符的整個列表。 ### LOG_DATEFORMAT 違約： `'%Y-%m-%d %H:%M:%S'` 用于格式化日期/時間的字符串，擴展 `%(asctime)s` 占位符 [`LOG_FORMAT`](#std:setting-LOG_FORMAT) . 參考 [Python datetime documentation](https://docs.python.org/2/library/datetime.html#strftime-and-strptime-behavior) 對于可用指令的整個列表。 ### LOG_LEVEL 違約： `'DEBUG'` 要記錄的最低級別。可用級別包括：嚴重、錯誤、警告、信息、調試。有關詳細信息，請參閱 [Logging](logging.html#topics-logging) . ### LOG_STDOUT 違約： `False` 如果 `True` ，進程的所有標準輸出（和錯誤）都將重定向到日志。例如，如果你 `print('hello')` 它會出現在殘缺的木頭上。 ### LOG_SHORT_NAMES 違約： `False` 如果 `True` 日志只包含根路徑。如果設置為 `False` 然后顯示負責日志輸出的組件 ### MEMDEBUG_ENABLED 違約： `False` 是否啟用內存調試。 ### MEMDEBUG_NOTIFY 違約： `[]` 當啟用內存調試時，如果此設置不為空，則會將內存報告發送到指定的地址，否則報告將寫入日志。例子：： ```py MEMDEBUG_NOTIFY = ['user@example.com'] ``` ### MEMUSAGE_ENABLED 違約： `True` 經營范圍： `scrapy.extensions.memusage` 是否啟用內存使用擴展。此擴展跟蹤進程使用的峰值內存（它將其寫入統計信息）。它還可以選擇在超過內存限制時關閉碎片進程（請參見 [`MEMUSAGE_LIMIT_MB`](#std:setting-MEMUSAGE_LIMIT_MB) ，并在發生這種情況時通過電子郵件通知（請參見 [`MEMUSAGE_NOTIFY_MAIL`](#std:setting-MEMUSAGE_NOTIFY_MAIL) ）見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) . ### MEMUSAGE_LIMIT_MB 違約： `0` 經營范圍： `scrapy.extensions.memusage` 關閉scrappy前允許的最大內存量（以兆字節為單位）（如果memusage_enabled為true）。如果為零，則不執行任何檢查。見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) . ### MEMUSAGE_CHECK_INTERVAL_SECONDS 1.1 新版功能. 違約： `60.0` 經營范圍： `scrapy.extensions.memusage` 這個 [Memory usage extension](extensions.html#topics-extensions-ref-memusage) 檢查當前內存使用情況，與 [`MEMUSAGE_LIMIT_MB`](#std:setting-MEMUSAGE_LIMIT_MB) 和 [`MEMUSAGE_WARNING_MB`](#std:setting-MEMUSAGE_WARNING_MB) ，以固定的時間間隔。這將以秒為單位設置這些間隔的長度。見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) . ### MEMUSAGE_NOTIFY_MAIL 違約： `False` 經營范圍： `scrapy.extensions.memusage` 通知是否達到內存限制的電子郵件列表。例子：： ```py MEMUSAGE_NOTIFY_MAIL = ['user@example.com'] ``` 見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) . ### MEMUSAGE_WARNING_MB 違約： `0` 經營范圍： `scrapy.extensions.memusage` 發送警告電子郵件通知前允許的最大內存量（以兆字節為單位）。如果為零，則不會產生警告。 ### NEWSPIDER_MODULE 違約： `''` 模塊在何處使用 [`genspider`](commands.html#std:command-genspider) 命令。例子：： ```py NEWSPIDER_MODULE = 'mybot.spiders_dev' ``` ### RANDOMIZE_DOWNLOAD_DELAY 違約： `True` 如果啟用，Scrapy將隨機等待一段時間（0.5之間* [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 和1.5 * [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) ）同時從同一網站獲取請求。這種隨機化減少了爬蟲被站點檢測（并隨后被阻止）的機會，這些站點分析請求，尋找它們請求之間的時間有統計學意義的相似性。隨機化策略與 [wget](https://www.gnu.org/software/wget/manual/wget.html) `--random-wait` 選擇權。如果 [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 為零（默認值）此選項無效。 ### REACTOR_THREADPOOL_MAXSIZE 違約： `10` 扭曲反應器線程池大小的最大限制。這是各種 Scrapy 組件使用的通用多用途線程池。線程DNS解析器，blockingfeedstorage，s3filestore等等。如果遇到阻塞IO不足的問題，請增加此值。 ### REDIRECT_MAX_TIMES 違約： `20` 定義可以重定向請求的最大次數。在此最大值之后，請求的響應將按原樣返回。我們對同一個任務使用了firefox默認值。 ### REDIRECT_PRIORITY_ADJUST 違約： `+2` 經營范圍： `scrapy.downloadermiddlewares.redirect.RedirectMiddleware` 相對于原始請求調整重定向請求優先級： * **正優先級調整（默認）意味著更高的優先級。** * 負優先級調整意味著低優先級。 ### RETRY_PRIORITY_ADJUST 違約： `-1` 經營范圍： `scrapy.downloadermiddlewares.retry.RetryMiddleware` 相對于原始請求調整重試請求優先級： * 積極的優先級調整意味著更高的優先級。 * **負優先級調整（默認）意味著低優先級。** ### ROBOTSTXT_OBEY 違約： `False` 經營范圍： `scrapy.downloadermiddlewares.robotstxt` 如果啟用，scrapy將遵守robots.txt策略。有關詳細信息，請參閱 [RobotsTxtMiddleware](downloader-middleware.html#topics-dlmw-robots) . 注解當默認值為 `False` 出于歷史原因，默認情況下，此選項在由生成的settings.py文件中啟用。 `scrapy startproject` 命令。 ### SCHEDULER 違約： `'scrapy.core.scheduler.Scheduler'` 用于爬網的計劃程序。 ### SCHEDULER_DEBUG 違約： `False` 設置為 `True` 將記錄有關請求計劃程序的調試信息。如果無法將請求序列化到磁盤，則當前只記錄一次。統計計數器 `scheduler/unserializable` ）跟蹤發生這種情況的次數。日志中的示例條目： ```py 1956-01-31 00:00:00+0800 [scrapy.core.scheduler] ERROR: Unable to serialize request: <GET http://example.com> - reason: cannot serialize <Request at 0x9a7c7ec> (type Request)> - no more unserializable requests will be logged (see 'scheduler/unserializable' stats counter) ``` ### SCHEDULER_DISK_QUEUE 違約： `'scrapy.squeues.PickleLifoDiskQueue'` 計劃程序將使用的磁盤隊列類型。其他可用類型包括 `scrapy.squeues.PickleFifoDiskQueue` ， `scrapy.squeues.MarshalFifoDiskQueue` ， `scrapy.squeues.MarshalLifoDiskQueue` . ### SCHEDULER_MEMORY_QUEUE 違約： `'scrapy.squeues.LifoMemoryQueue'` 調度程序使用的內存中隊列的類型。其他可用類型為： `scrapy.squeues.FifoMemoryQueue` . ### SCHEDULER_PRIORITY_QUEUE 違約： `'queuelib.PriorityQueue'` 計劃程序使用的優先級隊列的類型。 ### SPIDER_CONTRACTS 違約：： `{{}}` 包含項目中啟用的 Spider 合約的dict，用于測試 Spider 。有關詳細信息，請參閱 [Spider 合約](contracts.html#topics-contracts) . ### SPIDER_CONTRACTS_BASE 違約：： ```py { 'scrapy.contracts.default.UrlContract' : 1, 'scrapy.contracts.default.ReturnsContract': 2, 'scrapy.contracts.default.ScrapesContract': 3, } ``` 包含默認情況下在Scrapy中啟用的Scrapy合同的dict。您不應該在項目中修改此設置，請修改 [`SPIDER_CONTRACTS`](#std:setting-SPIDER_CONTRACTS) 相反。有關詳細信息，請參閱 [Spider 合約](contracts.html#topics-contracts) . 您可以通過分配 `None` 去他們的類 [`SPIDER_CONTRACTS`](#std:setting-SPIDER_CONTRACTS) . 例如，禁用內置 `ScrapesContract` 把這個放在你的 `settings.py` ：： ```py SPIDER_CONTRACTS = { 'scrapy.contracts.default.ScrapesContract': None, } ``` ### SPIDER_LOADER_CLASS 違約： `'scrapy.spiderloader.SpiderLoader'` 將用于加載spider的類，該類必須實現 [SpiderLoader API](api.html#topics-api-spiderloader) . ### SPIDER_LOADER_WARN_ONLY 1.3.3 新版功能. 違約： `False` 默認情況下，當Scrapy嘗試從 [`SPIDER_MODULES`](#std:setting-SPIDER_MODULES) 如果有的話，它會很響地失效。 `ImportError` 例外。但是您可以選擇沉默這個異常，并通過設置將它變成一個簡單的警告 `SPIDER_LOADER_WARN_ONLY = True` . 注解一些 [scrapy commands](commands.html#topics-commands) 使用此設置運行到 `True` 已經（即，它們只會發出警告，不會失敗），因為它們實際上不需要加載 Spider 類來工作： [`scrapy runspider`](commands.html#std:command-runspider) ， [`scrapy settings`](commands.html#std:command-settings) ， [`scrapy startproject`](commands.html#std:command-startproject) ， [`scrapy version`](commands.html#std:command-version) . ### SPIDER_MIDDLEWARES 違約：： `{{}}` 包含項目中啟用的 Spider 中間件及其訂單的dict。有關詳細信息，請參閱 [激活 Spider 中間件](spider-middleware.html#topics-spider-middleware-setting) . ### SPIDER_MIDDLEWARES_BASE 違約：： ```py { 'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware': 50, 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware': 500, 'scrapy.spidermiddlewares.referer.RefererMiddleware': 700, 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware': 800, 'scrapy.spidermiddlewares.depth.DepthMiddleware': 900, } ``` 包含spider中間件的dict，默認情況下在scrappy中啟用，以及它們的順序。低階更接近發動機，高階更接近 Spider 。有關詳細信息，請參閱 [激活 Spider 中間件](spider-middleware.html#topics-spider-middleware-setting) . ### SPIDER_MODULES 違約： `[]` Scrapy將在其中查找 Spider 的模塊列表。例子：： ```py SPIDER_MODULES = ['mybot.spiders_prod', 'mybot.spiders_dev'] ``` ### STATS_CLASS 違約： `'scrapy.statscollectors.MemoryStatsCollector'` 用于收集統計信息的類，必須實現 [統計收集器API](api.html#topics-api-stats) . ### STATS_DUMP 違約： `True` 轉儲 [Scrapy stats](stats.html#topics-stats) （對著殘破的木頭）一旦 Spider 完成。有關詳細信息，請參閱： [統計數據集合](stats.html#topics-stats) . ### STATSMAILER_RCPTS 違約： `[]` （空表） Spider 完成抓取后發送殘缺數據。見 `StatsMailer` 更多信息。 ### TELNETCONSOLE_ENABLED 違約： `True` 一個布爾值，指定 [telnet console](telnetconsole.html#topics-telnetconsole) 將被啟用（前提是它的擴展也被啟用）。 ### TELNETCONSOLE_PORT 違約： `[6023, 6073]` 用于telnet控制臺的端口范圍。如果設置為 `None` 或 `0` ，使用動態分配的端口。有關詳細信息，請參閱 [遠程登錄控制臺](telnetconsole.html#topics-telnetconsole) . ### TEMPLATES_DIR 違約： `templates` 廢料模塊內部目錄創建新項目時要在其中查找模板的目錄 [`startproject`](commands.html#std:command-startproject) 命令和新 Spider [`genspider`](commands.html#std:command-genspider) 命令。項目名稱不得與中自定義文件或目錄的名稱沖突。 `project` 子目錄。 ### URLLENGTH_LIMIT 違約： `2083` 經營范圍： `spidermiddlewares.urllength` 允許已爬網URL的最大URL長度。有關此設置的默認值的詳細信息，請參閱：[https://boutell.com/newfaq/misc/urllength.html](https://boutell.com/newfaq/misc/urllength.html) ### USER_AGENT 違約： `"Scrapy/VERSION (+https://scrapy.org)"` 在爬網時使用的默認用戶代理，除非被重寫。 ### 其他地方記錄的設置：以下設置記錄在其他地方，請檢查每個特定案例以了解如何啟用和使用它們。 * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE) * [FEED_STORAGE_S3_ACL](feed-exports.html#std:setting-FEED_STORAGE_S3_ACL) * [FEED_STORAGE_S3_ACL](feed-exports.html#std:setting-FEED_STORAGE_S3_ACL) * [FEED_STORAGE_S3_ACL](feed-exports.html#std:setting-FEED_STORAGE_S3_ACL) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FEED_URI](feed-exports.html#std:setting-FEED_URI) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_FROM](email.html#std:setting-MAIL_FROM) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_HOST](email.html#std:setting-MAIL_HOST) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PASS](email.html#std:setting-MAIL_PASS) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_PORT](email.html#std:setting-MAIL_PORT) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_SSL](email.html#std:setting-MAIL_SSL) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_TLS](email.html#std:setting-MAIL_TLS) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MAIL_USER](email.html#std:setting-MAIL_USER) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME) * [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME)