# 設置
> 譯者:[OSGeo 中國](https://www.osgeo.cn/)
Scrapy設置允許您自定義所有Scrapy組件的行為,包括核心、擴展、管道和spider本身。
設置的基礎結構提供了鍵值映射的全局命名空間,代碼可以使用該命名空間從中提取配置值。可以通過下面描述的不同機制填充設置。
這些設置也是選擇當前活動的Scrapy項目(如果您有許多項目)的機制。
有關可用內置設置的列表,請參閱: [內置設置參考](#topics-settings-ref) .
## 指定設置
當你使用Scrapy時,你必須告訴它你使用的設置。您可以通過使用環境變量, `SCRAPY_SETTINGS_MODULE` .
價值 `SCRAPY_SETTINGS_MODULE` 應該使用python路徑語法,例如 `myproject.settings` . 注意,設置模塊應該在python上 [import search path](https://docs.python.org/2/tutorial/modules.html#the-module-search-path) .
## 填充設置
可以使用不同的機制填充設置,每個機制具有不同的優先級。以下是按優先級降序排列的列表:
> 1. 命令行選項(最優先)
> 2. 每個 Spider 的設置
> 3. 項目設置模塊
> 4. 每個命令的默認設置
> 5. 默認全局設置(優先級較低)
這些設置源的填充是在內部處理的,但是可以使用API調用進行手動處理。見 [設置API](api.html#topics-api-settings) 供參考的主題。
下面將更詳細地描述這些機制。
### 1。命令行選項
命令行提供的參數是最優先的參數,覆蓋了任何其他選項。您可以使用 `-s` (或) `--set` )命令行選項。
例子::
```py
scrapy crawl myspider -s LOG_FILE=scrapy.log
```
### 2。每個 Spider 的設置
Spider (見 [Spider](spiders.html#topics-spiders) 章節供參考)可以定義它們自己的設置,這些設置將優先并覆蓋項目設置。他們可以通過設置 [`custom_settings`](spiders.html#scrapy.spiders.Spider.custom_settings "scrapy.spiders.Spider.custom_settings") 屬性:
```py
class MySpider(scrapy.Spider):
name = 'myspider'
custom_settings = {
'SOME_SETTING': 'some value',
}
```
### 三。項目設置模塊
項目設置模塊是 Scrapy 項目的標準配置文件,它將填充大部分自定義設置。對于標準的Scrapy項目,這意味著您將在 `settings.py` 為項目創建的文件。
### 4。每個命令的默認設置
各 [Scrapy tool](commands.html) 命令可以有自己的默認設置,這將覆蓋全局默認設置。這些自定義命令設置在 `default_settings` 命令類的屬性。
### 5。默認全局設置
全局默認值位于 `scrapy.settings.default_settings` 并記錄在 [內置設置參考](#topics-settings-ref) 部分。
## 如何訪問設置
在Spider中,可以通過 `self.settings` ::
```py
class MySpider(scrapy.Spider):
name = 'myspider'
start_urls = ['http://example.com']
def parse(self, response):
print("Existing settings: %s" % self.settings.attributes.keys())
```
注解
這個 `settings` 屬性在Spider初始化后在基本Spider類中設置。如果要在初始化之前使用這些設置(例如,在Spider的 `__init__()` 方法),您需要重寫 [`from_crawler()`](spiders.html#scrapy.spiders.Spider.from_crawler "scrapy.spiders.Spider.from_crawler") 方法。
可以通過訪問 [`scrapy.crawler.Crawler.settings`](api.html#scrapy.crawler.Crawler.settings "scrapy.crawler.Crawler.settings") 傳遞給的爬網程序的屬性 `from_crawler` 擴展、中間商和項目管道中的方法:
```py
class MyExtension(object):
def __init__(self, log_is_enabled=False):
if log_is_enabled:
print("log is enabled!")
@classmethod
def from_crawler(cls, crawler):
settings = crawler.settings
return cls(settings.getbool('LOG_ENABLED'))
```
設置對象可以像dict一樣使用(例如, `settings['LOG_ENABLED']` ,但通常最好使用 [`Settings`](api.html#scrapy.settings.Settings "scrapy.settings.Settings") 應用程序編程接口。
## 設置名稱的理由
設置名稱通常以它們配置的組件作為前綴。例如,虛擬robots.txt擴展名的正確設置名稱為 `ROBOTSTXT_ENABLED` , `ROBOTSTXT_OBEY` , `ROBOTSTXT_CACHEDIR` 等。
## 內置設置參考
以下是所有可用的零碎設置的列表,按字母順序排列,以及它們的默認值和應用范圍。
如果設置綁定到任何特定組件,那么范圍(如果可用)將顯示使用該設置的位置。在這種情況下,將顯示該組件的模塊,通常是擴展、中間件或管道。它還意味著必須啟用組件才能使設置生效。
### AWS_ACCESS_KEY_ID
違約: `None`
需要訪問的代碼使用的AWS訪問密鑰 [Amazon Web services](https://aws.amazon.com/) ,比如 [S3 feed storage backend](feed-exports.html#topics-feed-storage-s3) .
### AWS_SECRET_ACCESS_KEY
違約: `None`
需要訪問的代碼使用的AWS密鑰 [Amazon Web services](https://aws.amazon.com/) ,比如 [S3 feed storage backend](feed-exports.html#topics-feed-storage-s3) .
### AWS_ENDPOINT_URL
違約: `None`
端點URL用于類似S3的存儲,例如minio或s3.scality。僅支持 `botocore` 類庫。
### AWS_USE_SSL
違約: `None`
如果要禁用與S3或S3(如存儲)通信的SSL連接,請使用此選項。默認情況下,將使用SSL。僅支持 `botocore` 類庫。
### AWS_VERIFY
違約: `None`
驗證Scrapy和S3或S3(如存儲)之間的SSL連接。默認情況下,將進行SSL驗證。僅支持 `botocore` 類庫。
### AWS_REGION_NAME
違約: `None`
與AWS客戶端關聯的區域的名稱。僅支持 `botocore` 類庫。
### BOT_NAME
違約: `'scrapybot'`
此殘缺項目實現的bot的名稱(也稱為項目名稱)。這將在默認情況下用于構造用戶代理,也用于日志記錄。
當您使用 [`startproject`](commands.html#std:command-startproject) 命令。
### CONCURRENT_ITEMS
違約: `100`
在項目處理器(也稱為 [Item Pipeline](item-pipeline.html#topics-item-pipeline) )
### CONCURRENT_REQUESTS
違約: `16`
Scrapy下載程序將執行的最大并發(即同時)請求數。
### CONCURRENT_REQUESTS_PER_DOMAIN
違約: `8`
將對任何單個域執行的最大并發(即同時)請求數。
參見: [AutoThrottle 擴展](autothrottle.html#topics-autothrottle) 及其 [`AUTOTHROTTLE_TARGET_CONCURRENCY`](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY) 選擇權。
### CONCURRENT_REQUESTS_PER_IP
違約: `0`
將對任何單個IP執行的最大并發(即同時)請求數。如果非零, [`CONCURRENT_REQUESTS_PER_DOMAIN`](#std:setting-CONCURRENT_REQUESTS_PER_DOMAIN) 設置被忽略,而是使用此設置。換句話說,并發限制將應用于每個IP,而不是每個域。
此設置還影響 [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 和 [AutoThrottle 擴展](autothrottle.html#topics-autothrottle) 如果 [`CONCURRENT_REQUESTS_PER_IP`](#std:setting-CONCURRENT_REQUESTS_PER_IP) 是非零的,下載延遲是每個IP強制執行的,而不是每個域。
### DEFAULT_ITEM_CLASS
違約: `'scrapy.item.Item'`
將用于實例化中的項的默認類 [the Scrapy shell](shell.html#topics-shell) .
### DEFAULT_REQUEST_HEADERS
違約::
```py
{
'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8',
'Accept-Language': 'en',
}
```
用于 Scrapy HTTP請求的默認頭。他們住在 [`DefaultHeadersMiddleware`](downloader-middleware.html#scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware "scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware") .
### DEPTH_LIMIT
違約: `0`
經營范圍: `scrapy.spidermiddlewares.depth.DepthMiddleware`
允許對任何網站進行爬網的最大深度。如果為零,則不施加限制。
### DEPTH_PRIORITY
違約: `0`
經營范圍: `scrapy.spidermiddlewares.depth.DepthMiddleware`
用于調整 `priority` A的 [`Request`](request-response.html#scrapy.http.Request "scrapy.http.Request") 根據它的深度。
請求的優先級調整如下:
```py
request.priority = request.priority - ( depth * DEPTH_PRIORITY )
```
隨著深度的增加,正值為 `DEPTH_PRIORITY` 降低請求優先級(BFO),而負值則提高請求優先級(DFO)。也見 [是寬度優先還是深度優先?](../faq.html#faq-bfo-dfo) .
注解
此設置調整優先級 **in the opposite way** 與其他優先級設置相比 [`REDIRECT_PRIORITY_ADJUST`](#std:setting-REDIRECT_PRIORITY_ADJUST) 和 [`RETRY_PRIORITY_ADJUST`](#std:setting-RETRY_PRIORITY_ADJUST) .
### DEPTH_STATS_VERBOSE
違約: `False`
經營范圍: `scrapy.spidermiddlewares.depth.DepthMiddleware`
是否收集詳細深度統計信息。如果啟用此選項,則在統計信息中收集每個深度的請求數。
### DNSCACHE_ENABLED
違約: `True`
是否啟用DNS內存緩存。
### DNSCACHE_SIZE
違約: `10000`
DNS內存緩存大小。
### DNS_TIMEOUT
違約: `60`
處理DNS查詢的超時(秒)。支持浮動。
### DOWNLOADER
違約: `'scrapy.core.downloader.Downloader'`
用于爬行的下載程序。
### DOWNLOADER_HTTPCLIENTFACTORY
違約: `'scrapy.core.downloader.webclient.ScrapyHTTPClientFactory'`
定義扭曲 `protocol.ClientFactory` 用于HTTP/1.0連接的類(用于 `HTTP10DownloadHandler` )
注解
現在很少使用HTTP/1.0,因此您可以安全地忽略此設置,除非您使用twisted<11.1,或者如果您確實想使用HTTP/1.0并重寫 [`DOWNLOAD_HANDLERS_BASE`](#std:setting-DOWNLOAD_HANDLERS_BASE) 對于 `http(s)` 相應的計劃,即 `'scrapy.core.downloader.handlers.http.HTTP10DownloadHandler'` .
### DOWNLOADER_CLIENTCONTEXTFACTORY
違約: `'scrapy.core.downloader.contextfactory.ScrapyClientContextFactory'`
表示要使用的ContextFactory的類路徑。
這里,“ContextFactory”是一個用于SSL/TLS上下文的扭曲術語,它定義了要使用的TLS/SSL協議版本,無論是進行證書驗證,還是甚至啟用客戶端身份驗證(以及其他各種事情)。
注解
剪貼默認上下文工廠 不執行遠程服務器證書驗證. 這對于刮網來說通常是很好的。
如果您確實需要啟用遠程服務器證書驗證,scrapy還可以設置另一個上下文工廠類, `'scrapy.core.downloader.contextfactory.BrowserLikeContextFactory'` ,它使用平臺的證書來驗證遠程端點。[**](#id1)僅當您使用Twisted>14.0.*時才可用。*
如果確實使用自定義ContextFactory,請確保它接受 `method` 參數在init(這是 `OpenSSL.SSL` 方法映射 [`DOWNLOADER_CLIENT_TLS_METHOD`](#std:setting-DOWNLOADER_CLIENT_TLS_METHOD) )
### DOWNLOADER_CLIENT_TLS_METHOD
違約: `'TLS'`
使用此設置自定義默認HTTP/1.1下載程序使用的TLS/SSL方法。
此設置必須是以下字符串值之一:
* `'TLS'` :映射到OpenSSL `TLS_method()` (A.K.A) `SSLv23_method()` ,允許協議協商,從平臺支持的最高點開始;**默認,推薦**
* `'TLSv1.0'` :此值強制HTTPS連接使用TLS版本1.0;如果希望scrapy的行為小于1.1,請設置此值。
* `'TLSv1.1'` :強制TLS版本1.1
* `'TLSv1.2'` :強制TLS版本1.2
* `'SSLv3'` :強制SSL版本3(**不推薦**)
注解
我們建議您使用pyopenssl>=0.13和twisted>=0.13或更高版本(如果可以,twisted>=14.0)。
### DOWNLOADER_MIDDLEWARES
違約:: `{{}}`
包含項目中啟用的下載器中間軟件及其訂單的dict。有關詳細信息,請參閱 [激活下載器中間件](downloader-middleware.html#topics-downloader-middleware-setting) .
### DOWNLOADER_MIDDLEWARES_BASE
違約::
```py
{
'scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware': 100,
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware': 300,
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware': 350,
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware': 400,
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware': 500,
'scrapy.downloadermiddlewares.retry.RetryMiddleware': 550,
'scrapy.downloadermiddlewares.ajaxcrawl.AjaxCrawlMiddleware': 560,
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware': 580,
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware': 590,
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware': 600,
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware': 700,
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware': 750,
'scrapy.downloadermiddlewares.stats.DownloaderStats': 850,
'scrapy.downloadermiddlewares.httpcache.HttpCacheMiddleware': 900,
}
```
包含默認在scrappy中啟用的下載器中間軟件的dict。低階更接近引擎,高階更接近下載器。您不應該在項目中修改此設置,請修改 [`DOWNLOADER_MIDDLEWARES`](#std:setting-DOWNLOADER_MIDDLEWARES) 相反。有關詳細信息,請參閱 [激活下載器中間件](downloader-middleware.html#topics-downloader-middleware-setting) .
### DOWNLOADER_STATS
違約: `True`
是否啟用下載器統計信息收集。
### DOWNLOAD_DELAY
違約: `0`
下載者從同一網站下載連續頁面之前應等待的時間(以秒計)。這可以用來限制爬行速度,以避免對服務器造成太大的沖擊。支持十進制數。例子::
```py
DOWNLOAD_DELAY = 0.25 # 250 ms of delay
```
此設置也受 [`RANDOMIZE_DOWNLOAD_DELAY`](#std:setting-RANDOMIZE_DOWNLOAD_DELAY) 設置(默認啟用)。默認情況下,scrappy不會在請求之間等待固定的時間,而是使用0.5之間的隨機間隔* [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 和1.5 * [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) .
什么時候? [`CONCURRENT_REQUESTS_PER_IP`](#std:setting-CONCURRENT_REQUESTS_PER_IP) 為非零,每個IP地址而不是每個域強制延遲。
您還可以通過設置每個 Spider 更改此設置 `download_delay` Spider 屬性。
### DOWNLOAD_HANDLERS
違約: `{{}}`
包含項目中啟用的請求下載器處理程序的dict。見 [`DOWNLOAD_HANDLERS_BASE`](#std:setting-DOWNLOAD_HANDLERS_BASE) 例如格式。
### DOWNLOAD_HANDLERS_BASE
違約::
```py
{
'file': 'scrapy.core.downloader.handlers.file.FileDownloadHandler',
'http': 'scrapy.core.downloader.handlers.http.HTTPDownloadHandler',
'https': 'scrapy.core.downloader.handlers.http.HTTPDownloadHandler',
's3': 'scrapy.core.downloader.handlers.s3.S3DownloadHandler',
'ftp': 'scrapy.core.downloader.handlers.ftp.FTPDownloadHandler',
}
```
包含在scrappy中默認啟用的請求下載處理程序的dict。您不應該在項目中修改此設置,請修改 [`DOWNLOAD_HANDLERS`](#std:setting-DOWNLOAD_HANDLERS) 相反。
您可以通過分配 `None` 到他們的URI方案 [`DOWNLOAD_HANDLERS`](#std:setting-DOWNLOAD_HANDLERS) . 例如,要禁用內置的ftp處理程序(不替換),請將其放入 `settings.py` ::
```py
DOWNLOAD_HANDLERS = {
'ftp': None,
}
```
### DOWNLOAD_TIMEOUT
違約: `180`
下載程序在超時前等待的時間(以秒計)。
注解
可以使用以下方法設置每個 Spider 的超時 `download_timeout` Spider 屬性和每個請求使用 [`download_timeout`](request-response.html#std:reqmeta-download_timeout) request.meta鍵。
### DOWNLOAD_MAXSIZE
違約: `1073741824` (1024MB)
下載程序將下載的最大響應大小(字節)。
如果要禁用它,請將其設置為0。
注解
此尺寸可通過使用 `download_maxsize` Spider 屬性和每個請求使用 [`download_maxsize`](#std:reqmeta-download_maxsize) request.meta鍵。
此功能需要扭曲>=11.1。
### DOWNLOAD_WARNSIZE
違約: `33554432` (32 MB)
下載程序將開始警告的響應大小(字節)。
如果要禁用它,請將其設置為0。
注解
此尺寸可通過使用 `download_warnsize` Spider 屬性和每個請求使用 `download_warnsize` request.meta鍵。
此功能需要扭曲>=11.1。
### DOWNLOAD_FAIL_ON_DATALOSS
違約: `True`
是否在錯誤的響應上失敗,也就是說,聲明 `Content-Length` 與服務器發送的內容不匹配,或者分塊響應未正確完成。如果 `True` ,這些反應引發了 `ResponseFailed([_DataLoss])` 錯誤。如果 `False` ,這些響應將傳遞給 `dataloss` 添加到響應中,即: `'dataloss' in response.flags` 是 `True` .
或者,可以通過使用 [`download_fail_on_dataloss`](request-response.html#std:reqmeta-download_fail_on_dataloss) 請求.meta鍵 `False` .
注解
從服務器配置錯誤到網絡錯誤,再到數據損壞,在多種情況下可能會發生中斷響應或數據丟失錯誤。由用戶決定處理中斷的響應是否有意義,因為它們可能包含部分或不完整的內容。如果 [`RETRY_ENABLED`](downloader-middleware.html#std:setting-RETRY_ENABLED) 是 `True` 此設置設置為 `True` , the `ResponseFailed([_DataLoss])` 失敗將像往常一樣重試。
### DUPEFILTER_CLASS
違約: `'scrapy.dupefilters.RFPDupeFilter'`
用于檢測和篩選重復請求的類。
缺省值(默認值) `RFPDupeFilter` )根據請求指紋使用 `scrapy.utils.request.request_fingerprint` 功能。為了更改檢查重復項的方式,可以將 `RFPDupeFilter` 并覆蓋其 `request_fingerprint` 方法。這個方法應該接受slapy [`Request`](request-response.html#scrapy.http.Request "scrapy.http.Request") 對象并返回其指紋(字符串)。
您可以通過設置禁用重復請求的篩選 [`DUPEFILTER_CLASS`](#std:setting-DUPEFILTER_CLASS) 到 `'scrapy.dupefilters.BaseDupeFilter'` . 但是要非常小心,因為您可以進入爬行循環。通常設置 `dont_filter` 參數到 `True` 論具體 [`Request`](request-response.html#scrapy.http.Request "scrapy.http.Request") 這不應該被過濾。
### DUPEFILTER_DEBUG
違約: `False`
默認情況下, `RFPDupeFilter` 只記錄第一個重復請求。設置 [`DUPEFILTER_DEBUG`](#std:setting-DUPEFILTER_DEBUG) 到 `True` 將使其記錄所有重復的請求。
### EDITOR
違約: `vi` (在UNIX系統上)或空閑編輯器(在Windows上)
用于編輯 Spider 的編輯器 [`edit`](commands.html#std:command-edit) 命令。此外,如果 `EDITOR` 設置了環境變量, [`edit`](commands.html#std:command-edit) 命令將優先于默認設置。
### EXTENSIONS
違約:: `{{}}`
包含項目中啟用的擴展及其順序的dict。
### EXTENSIONS_BASE
違約::
```py
{
'scrapy.extensions.corestats.CoreStats': 0,
'scrapy.extensions.telnet.TelnetConsole': 0,
'scrapy.extensions.memusage.MemoryUsage': 0,
'scrapy.extensions.memdebug.MemoryDebugger': 0,
'scrapy.extensions.closespider.CloseSpider': 0,
'scrapy.extensions.feedexport.FeedExporter': 0,
'scrapy.extensions.logstats.LogStats': 0,
'scrapy.extensions.spiderstate.SpiderState': 0,
'scrapy.extensions.throttle.AutoThrottle': 0,
}
```
包含默認情況下在scrappy中可用的擴展名及其順序的dict。此設置包含所有穩定的內置擴展。請記住,其中一些需要通過設置啟用。
有關更多信息,請參閱 [extensions user guide](extensions.html#topics-extensions) 以及 [list of available extensions](extensions.html#topics-extensions-ref) .
### FEED_TEMPDIR
feed temp目錄允許您設置自定義文件夾,以便在上載之前保存crawler臨時文件 [FTP feed storage](feed-exports.html#topics-feed-storage-ftp) 和 [Amazon S3](feed-exports.html#topics-feed-storage-s3) .
### FTP_PASSIVE_MODE
違約: `True`
啟動FTP傳輸時是否使用被動模式。
### FTP_PASSWORD
違約: `"guest"`
當沒有ftp連接時用于ftp連接的密碼 `"ftp_password"` 在里面 `Request` 元。
注解
釋義 [RFC 1635](https://tools.ietf.org/html/rfc1635) 盡管匿名ftp通常使用密碼“guest”或電子郵件地址,但有些ftp服務器明確要求用戶的電子郵件地址,不允許使用“guest”密碼登錄。
### FTP_USER
違約: `"anonymous"`
當沒有ftp連接時用于ftp連接的用戶名 `"ftp_user"` 在里面 `Request` 元。
### ITEM_PIPELINES
違約: `{{}}`
包含要使用的項目管道及其訂單的dict。順序值是任意的,但通常在0-1000范圍內定義它們。低訂單處理優先于高訂單。
例子::
```py
ITEM_PIPELINES = {
'mybot.pipelines.validate.ValidateMyItem': 300,
'mybot.pipelines.validate.StoreMyItem': 800,
}
```
### ITEM_PIPELINES_BASE
違約: `{{}}`
包含默認情況下在Scrapy中啟用的管道的dict。您不應該在項目中修改此設置,請修改 [`ITEM_PIPELINES`](#std:setting-ITEM_PIPELINES) 相反。
### LOG_ENABLED
違約: `True`
是否啟用日志記錄。
### LOG_ENCODING
違約: `'utf-8'`
用于日志記錄的編碼。
### LOG_FILE
違約: `None`
用于日志記錄輸出的文件名。如果 `None` ,將使用標準錯誤。
### LOG_FORMAT
違約: `'%(asctime)s [%(name)s] %(levelname)s: %(message)s'`
用于格式化日志消息的字符串。參考 [Python logging documentation](https://docs.python.org/2/library/logging.html#logrecord-attributes) 對于可用占位符的整個列表。
### LOG_DATEFORMAT
違約: `'%Y-%m-%d %H:%M:%S'`
用于格式化日期/時間的字符串,擴展 `%(asctime)s` 占位符 [`LOG_FORMAT`](#std:setting-LOG_FORMAT) . 參考 [Python datetime documentation](https://docs.python.org/2/library/datetime.html#strftime-and-strptime-behavior) 對于可用指令的整個列表。
### LOG_LEVEL
違約: `'DEBUG'`
要記錄的最低級別。可用級別包括:嚴重、錯誤、警告、信息、調試。有關詳細信息,請參閱 [Logging](logging.html#topics-logging) .
### LOG_STDOUT
違約: `False`
如果 `True` ,進程的所有標準輸出(和錯誤)都將重定向到日志。例如,如果你 `print('hello')` 它會出現在殘缺的木頭上。
### LOG_SHORT_NAMES
違約: `False`
如果 `True` 日志只包含根路徑。如果設置為 `False` 然后顯示負責日志輸出的組件
### MEMDEBUG_ENABLED
違約: `False`
是否啟用內存調試。
### MEMDEBUG_NOTIFY
違約: `[]`
當啟用內存調試時,如果此設置不為空,則會將內存報告發送到指定的地址,否則報告將寫入日志。
例子::
```py
MEMDEBUG_NOTIFY = ['user@example.com']
```
### MEMUSAGE_ENABLED
違約: `True`
經營范圍: `scrapy.extensions.memusage`
是否啟用內存使用擴展。此擴展跟蹤進程使用的峰值內存(它將其寫入統計信息)。它還可以選擇在超過內存限制時關閉碎片進程(請參見 [`MEMUSAGE_LIMIT_MB`](#std:setting-MEMUSAGE_LIMIT_MB) ,并在發生這種情況時通過電子郵件通知(請參見 [`MEMUSAGE_NOTIFY_MAIL`](#std:setting-MEMUSAGE_NOTIFY_MAIL) )
見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) .
### MEMUSAGE_LIMIT_MB
違約: `0`
經營范圍: `scrapy.extensions.memusage`
關閉scrappy前允許的最大內存量(以兆字節為單位)(如果memusage_enabled為true)。如果為零,則不執行任何檢查。
見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) .
### MEMUSAGE_CHECK_INTERVAL_SECONDS
1.1 新版功能.
違約: `60.0`
經營范圍: `scrapy.extensions.memusage`
這個 [Memory usage extension](extensions.html#topics-extensions-ref-memusage) 檢查當前內存使用情況,與 [`MEMUSAGE_LIMIT_MB`](#std:setting-MEMUSAGE_LIMIT_MB) 和 [`MEMUSAGE_WARNING_MB`](#std:setting-MEMUSAGE_WARNING_MB) ,以固定的時間間隔。
這將以秒為單位設置這些間隔的長度。
見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) .
### MEMUSAGE_NOTIFY_MAIL
違約: `False`
經營范圍: `scrapy.extensions.memusage`
通知是否達到內存限制的電子郵件列表。
例子::
```py
MEMUSAGE_NOTIFY_MAIL = ['user@example.com']
```
見 [內存使用擴展](extensions.html#topics-extensions-ref-memusage) .
### MEMUSAGE_WARNING_MB
違約: `0`
經營范圍: `scrapy.extensions.memusage`
發送警告電子郵件通知前允許的最大內存量(以兆字節為單位)。如果為零,則不會產生警告。
### NEWSPIDER_MODULE
違約: `''`
模塊在何處使用 [`genspider`](commands.html#std:command-genspider) 命令。
例子::
```py
NEWSPIDER_MODULE = 'mybot.spiders_dev'
```
### RANDOMIZE_DOWNLOAD_DELAY
違約: `True`
如果啟用,Scrapy將隨機等待一段時間(0.5之間* [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 和1.5 * [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) )同時從同一網站獲取請求。
這種隨機化減少了爬蟲被站點檢測(并隨后被阻止)的機會,這些站點分析請求,尋找它們請求之間的時間有統計學意義的相似性。
隨機化策略與 [wget](https://www.gnu.org/software/wget/manual/wget.html) `--random-wait` 選擇權。
如果 [`DOWNLOAD_DELAY`](#std:setting-DOWNLOAD_DELAY) 為零(默認值)此選項無效。
### REACTOR_THREADPOOL_MAXSIZE
違約: `10`
扭曲反應器線程池大小的最大限制。這是各種 Scrapy 組件使用的通用多用途線程池。線程DNS解析器,blockingfeedstorage,s3filestore等等。如果遇到阻塞IO不足的問題,請增加此值。
### REDIRECT_MAX_TIMES
違約: `20`
定義可以重定向請求的最大次數。在此最大值之后,請求的響應將按原樣返回。我們對同一個任務使用了firefox默認值。
### REDIRECT_PRIORITY_ADJUST
違約: `+2`
經營范圍: `scrapy.downloadermiddlewares.redirect.RedirectMiddleware`
相對于原始請求調整重定向請求優先級:
* **正優先級調整(默認)意味著更高的優先級。**
* 負優先級調整意味著低優先級。
### RETRY_PRIORITY_ADJUST
違約: `-1`
經營范圍: `scrapy.downloadermiddlewares.retry.RetryMiddleware`
相對于原始請求調整重試請求優先級:
* 積極的優先級調整意味著更高的優先級。
* **負優先級調整(默認)意味著低優先級。**
### ROBOTSTXT_OBEY
違約: `False`
經營范圍: `scrapy.downloadermiddlewares.robotstxt`
如果啟用,scrapy將遵守robots.txt策略。有關詳細信息,請參閱 [RobotsTxtMiddleware](downloader-middleware.html#topics-dlmw-robots) .
注解
當默認值為 `False` 出于歷史原因,默認情況下,此選項在由生成的settings.py文件中啟用。 `scrapy startproject` 命令。
### SCHEDULER
違約: `'scrapy.core.scheduler.Scheduler'`
用于爬網的計劃程序。
### SCHEDULER_DEBUG
違約: `False`
設置為 `True` 將記錄有關請求計劃程序的調試信息。如果無法將請求序列化到磁盤,則當前只記錄一次。統計計數器 `scheduler/unserializable` )跟蹤發生這種情況的次數。
日志中的示例條目:
```py
1956-01-31 00:00:00+0800 [scrapy.core.scheduler] ERROR: Unable to serialize request:
<GET http://example.com> - reason: cannot serialize <Request at 0x9a7c7ec>
(type Request)> - no more unserializable requests will be logged
(see 'scheduler/unserializable' stats counter)
```
### SCHEDULER_DISK_QUEUE
違約: `'scrapy.squeues.PickleLifoDiskQueue'`
計劃程序將使用的磁盤隊列類型。其他可用類型包括 `scrapy.squeues.PickleFifoDiskQueue` , `scrapy.squeues.MarshalFifoDiskQueue` , `scrapy.squeues.MarshalLifoDiskQueue` .
### SCHEDULER_MEMORY_QUEUE
違約: `'scrapy.squeues.LifoMemoryQueue'`
調度程序使用的內存中隊列的類型。其他可用類型為: `scrapy.squeues.FifoMemoryQueue` .
### SCHEDULER_PRIORITY_QUEUE
違約: `'queuelib.PriorityQueue'`
計劃程序使用的優先級隊列的類型。
### SPIDER_CONTRACTS
違約:: `{{}}`
包含項目中啟用的 Spider 合約的dict,用于測試 Spider 。有關詳細信息,請參閱 [Spider 合約](contracts.html#topics-contracts) .
### SPIDER_CONTRACTS_BASE
違約::
```py
{
'scrapy.contracts.default.UrlContract' : 1,
'scrapy.contracts.default.ReturnsContract': 2,
'scrapy.contracts.default.ScrapesContract': 3,
}
```
包含默認情況下在Scrapy中啟用的Scrapy合同的dict。您不應該在項目中修改此設置,請修改 [`SPIDER_CONTRACTS`](#std:setting-SPIDER_CONTRACTS) 相反。有關詳細信息,請參閱 [Spider 合約](contracts.html#topics-contracts) .
您可以通過分配 `None` 去他們的類 [`SPIDER_CONTRACTS`](#std:setting-SPIDER_CONTRACTS) . 例如,禁用內置 `ScrapesContract` 把這個放在你的 `settings.py` ::
```py
SPIDER_CONTRACTS = {
'scrapy.contracts.default.ScrapesContract': None,
}
```
### SPIDER_LOADER_CLASS
違約: `'scrapy.spiderloader.SpiderLoader'`
將用于加載spider的類,該類必須實現 [SpiderLoader API](api.html#topics-api-spiderloader) .
### SPIDER_LOADER_WARN_ONLY
1.3.3 新版功能.
違約: `False`
默認情況下,當Scrapy嘗試從 [`SPIDER_MODULES`](#std:setting-SPIDER_MODULES) 如果有的話,它會很響地失效。 `ImportError` 例外。但是您可以選擇沉默這個異常,并通過設置將它變成一個簡單的警告 `SPIDER_LOADER_WARN_ONLY = True` .
注解
一些 [scrapy commands](commands.html#topics-commands) 使用此設置運行到 `True` 已經(即,它們只會發出警告,不會失敗),因為它們實際上不需要加載 Spider 類來工作: [`scrapy runspider`](commands.html#std:command-runspider) , [`scrapy settings`](commands.html#std:command-settings) , [`scrapy startproject`](commands.html#std:command-startproject) , [`scrapy version`](commands.html#std:command-version) .
### SPIDER_MIDDLEWARES
違約:: `{{}}`
包含項目中啟用的 Spider 中間件及其訂單的dict。有關詳細信息,請參閱 [激活 Spider 中間件](spider-middleware.html#topics-spider-middleware-setting) .
### SPIDER_MIDDLEWARES_BASE
違約::
```py
{
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware': 50,
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware': 500,
'scrapy.spidermiddlewares.referer.RefererMiddleware': 700,
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware': 800,
'scrapy.spidermiddlewares.depth.DepthMiddleware': 900,
}
```
包含spider中間件的dict,默認情況下在scrappy中啟用,以及它們的順序。低階更接近發動機,高階更接近 Spider 。有關詳細信息,請參閱 [激活 Spider 中間件](spider-middleware.html#topics-spider-middleware-setting) .
### SPIDER_MODULES
違約: `[]`
Scrapy將在其中查找 Spider 的模塊列表。
例子::
```py
SPIDER_MODULES = ['mybot.spiders_prod', 'mybot.spiders_dev']
```
### STATS_CLASS
違約: `'scrapy.statscollectors.MemoryStatsCollector'`
用于收集統計信息的類,必須實現 [統計收集器API](api.html#topics-api-stats) .
### STATS_DUMP
違約: `True`
轉儲 [Scrapy stats](stats.html#topics-stats) (對著殘破的木頭)一旦 Spider 完成。
有關詳細信息,請參閱: [統計數據集合](stats.html#topics-stats) .
### STATSMAILER_RCPTS
違約: `[]` (空表)
Spider 完成抓取后發送殘缺數據。見 `StatsMailer` 更多信息。
### TELNETCONSOLE_ENABLED
違約: `True`
一個布爾值,指定 [telnet console](telnetconsole.html#topics-telnetconsole) 將被啟用(前提是它的擴展也被啟用)。
### TELNETCONSOLE_PORT
違約: `[6023, 6073]`
用于telnet控制臺的端口范圍。如果設置為 `None` 或 `0` ,使用動態分配的端口。有關詳細信息,請參閱 [遠程登錄控制臺](telnetconsole.html#topics-telnetconsole) .
### TEMPLATES_DIR
違約: `templates` 廢料模塊內部目錄
創建新項目時要在其中查找模板的目錄 [`startproject`](commands.html#std:command-startproject) 命令和新 Spider [`genspider`](commands.html#std:command-genspider) 命令。
項目名稱不得與中自定義文件或目錄的名稱沖突。 `project` 子目錄。
### URLLENGTH_LIMIT
違約: `2083`
經營范圍: `spidermiddlewares.urllength`
允許已爬網URL的最大URL長度。有關此設置的默認值的詳細信息,請參閱:[https://boutell.com/newfaq/misc/urllength.html](https://boutell.com/newfaq/misc/urllength.html)
### USER_AGENT
違約: `"Scrapy/VERSION (+https://scrapy.org)"`
在爬網時使用的默認用戶代理,除非被重寫。
### 其他地方記錄的設置:
以下設置記錄在其他地方,請檢查每個特定案例以了解如何啟用和使用它們。
* [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED)
* [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED)
* [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED)
* [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED)
* [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED)
* [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED)
* [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED)
* [AJAXCRAWL_ENABLED](downloader-middleware.html#std:setting-AJAXCRAWL_ENABLED)
* [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG)
* [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG)
* [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG)
* [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG)
* [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG)
* [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG)
* [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG)
* [AUTOTHROTTLE_DEBUG](autothrottle.html#std:setting-AUTOTHROTTLE_DEBUG)
* [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED)
* [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED)
* [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED)
* [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED)
* [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED)
* [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED)
* [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED)
* [AUTOTHROTTLE_ENABLED](autothrottle.html#std:setting-AUTOTHROTTLE_ENABLED)
* [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY)
* [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY)
* [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY)
* [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY)
* [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY)
* [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY)
* [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY)
* [AUTOTHROTTLE_MAX_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_MAX_DELAY)
* [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY)
* [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY)
* [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY)
* [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY)
* [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY)
* [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY)
* [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY)
* [AUTOTHROTTLE_START_DELAY](autothrottle.html#std:setting-AUTOTHROTTLE_START_DELAY)
* [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY)
* [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY)
* [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY)
* [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY)
* [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY)
* [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY)
* [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY)
* [AUTOTHROTTLE_TARGET_CONCURRENCY](autothrottle.html#std:setting-AUTOTHROTTLE_TARGET_CONCURRENCY)
* [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT)
* [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT)
* [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT)
* [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT)
* [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT)
* [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT)
* [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT)
* [CLOSESPIDER_ERRORCOUNT](extensions.html#std:setting-CLOSESPIDER_ERRORCOUNT)
* [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT)
* [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT)
* [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT)
* [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT)
* [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT)
* [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT)
* [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT)
* [CLOSESPIDER_ITEMCOUNT](extensions.html#std:setting-CLOSESPIDER_ITEMCOUNT)
* [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT)
* [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT)
* [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT)
* [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT)
* [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT)
* [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT)
* [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT)
* [CLOSESPIDER_PAGECOUNT](extensions.html#std:setting-CLOSESPIDER_PAGECOUNT)
* [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT)
* [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT)
* [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT)
* [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT)
* [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT)
* [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT)
* [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT)
* [CLOSESPIDER_TIMEOUT](extensions.html#std:setting-CLOSESPIDER_TIMEOUT)
* [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE)
* [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE)
* [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE)
* [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE)
* [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE)
* [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE)
* [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE)
* [COMMANDS_MODULE](commands.html#std:setting-COMMANDS_MODULE)
* [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED)
* [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED)
* [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED)
* [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED)
* [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED)
* [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED)
* [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED)
* [COMPRESSION_ENABLED](downloader-middleware.html#std:setting-COMPRESSION_ENABLED)
* [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG)
* [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG)
* [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG)
* [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG)
* [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG)
* [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG)
* [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG)
* [COOKIES_DEBUG](downloader-middleware.html#std:setting-COOKIES_DEBUG)
* [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED)
* [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED)
* [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED)
* [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED)
* [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED)
* [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED)
* [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED)
* [COOKIES_ENABLED](downloader-middleware.html#std:setting-COOKIES_ENABLED)
* [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS)
* [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS)
* [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS)
* [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS)
* [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS)
* [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS)
* [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS)
* [FEED_EXPORTERS](feed-exports.html#std:setting-FEED_EXPORTERS)
* [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE)
* [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE)
* [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE)
* [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE)
* [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE)
* [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE)
* [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE)
* [FEED_EXPORTERS_BASE](feed-exports.html#std:setting-FEED_EXPORTERS_BASE)
* [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING)
* [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING)
* [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING)
* [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING)
* [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING)
* [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING)
* [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING)
* [FEED_EXPORT_ENCODING](feed-exports.html#std:setting-FEED_EXPORT_ENCODING)
* [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS)
* [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS)
* [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS)
* [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS)
* [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS)
* [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS)
* [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS)
* [FEED_EXPORT_FIELDS](feed-exports.html#std:setting-FEED_EXPORT_FIELDS)
* [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT)
* [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT)
* [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT)
* [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT)
* [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT)
* [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT)
* [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT)
* [FEED_EXPORT_INDENT](feed-exports.html#std:setting-FEED_EXPORT_INDENT)
* [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT)
* [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT)
* [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT)
* [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT)
* [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT)
* [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT)
* [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT)
* [FEED_FORMAT](feed-exports.html#std:setting-FEED_FORMAT)
* [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES)
* [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES)
* [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES)
* [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES)
* [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES)
* [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES)
* [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES)
* [FEED_STORAGES](feed-exports.html#std:setting-FEED_STORAGES)
* [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE)
* [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE)
* [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE)
* [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE)
* [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE)
* [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE)
* [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE)
* [FEED_STORAGES_BASE](feed-exports.html#std:setting-FEED_STORAGES_BASE)
* [FEED_STORAGE_S3_ACL](feed-exports.html#std:setting-FEED_STORAGE_S3_ACL)
* [FEED_STORAGE_S3_ACL](feed-exports.html#std:setting-FEED_STORAGE_S3_ACL)
* [FEED_STORAGE_S3_ACL](feed-exports.html#std:setting-FEED_STORAGE_S3_ACL)
* [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY)
* [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY)
* [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY)
* [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY)
* [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY)
* [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY)
* [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY)
* [FEED_STORE_EMPTY](feed-exports.html#std:setting-FEED_STORE_EMPTY)
* [FEED_URI](feed-exports.html#std:setting-FEED_URI)
* [FEED_URI](feed-exports.html#std:setting-FEED_URI)
* [FEED_URI](feed-exports.html#std:setting-FEED_URI)
* [FEED_URI](feed-exports.html#std:setting-FEED_URI)
* [FEED_URI](feed-exports.html#std:setting-FEED_URI)
* [FEED_URI](feed-exports.html#std:setting-FEED_URI)
* [FEED_URI](feed-exports.html#std:setting-FEED_URI)
* [FEED_URI](feed-exports.html#std:setting-FEED_URI)
* [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES)
* [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES)
* [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES)
* [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES)
* [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES)
* [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES)
* [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES)
* [FILES_EXPIRES](media-pipeline.html#std:setting-FILES_EXPIRES)
* [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD)
* [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD)
* [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD)
* [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD)
* [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD)
* [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD)
* [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD)
* [FILES_RESULT_FIELD](media-pipeline.html#std:setting-FILES_RESULT_FIELD)
* [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE)
* [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE)
* [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE)
* [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE)
* [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE)
* [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE)
* [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE)
* [FILES_STORE](media-pipeline.html#std:setting-FILES_STORE)
* [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL)
* [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL)
* [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL)
* [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL)
* [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL)
* [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL)
* [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL)
* [FILES_STORE_GCS_ACL](media-pipeline.html#std:setting-FILES_STORE_GCS_ACL)
* [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL)
* [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL)
* [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL)
* [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL)
* [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL)
* [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL)
* [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL)
* [FILES_STORE_S3_ACL](media-pipeline.html#std:setting-FILES_STORE_S3_ACL)
* [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD)
* [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD)
* [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD)
* [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD)
* [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD)
* [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD)
* [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD)
* [FILES_URLS_FIELD](media-pipeline.html#std:setting-FILES_URLS_FIELD)
* [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID)
* [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID)
* [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID)
* [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID)
* [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID)
* [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID)
* [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID)
* [GCS_PROJECT_ID](media-pipeline.html#std:setting-GCS_PROJECT_ID)
* [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE)
* [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE)
* [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE)
* [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE)
* [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE)
* [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE)
* [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE)
* [HTTPCACHE_ALWAYS_STORE](downloader-middleware.html#std:setting-HTTPCACHE_ALWAYS_STORE)
* [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE)
* [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE)
* [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE)
* [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE)
* [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE)
* [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE)
* [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE)
* [HTTPCACHE_DBM_MODULE](downloader-middleware.html#std:setting-HTTPCACHE_DBM_MODULE)
* [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR)
* [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR)
* [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR)
* [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR)
* [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR)
* [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR)
* [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR)
* [HTTPCACHE_DIR](downloader-middleware.html#std:setting-HTTPCACHE_DIR)
* [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED)
* [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED)
* [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED)
* [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED)
* [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED)
* [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED)
* [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED)
* [HTTPCACHE_ENABLED](downloader-middleware.html#std:setting-HTTPCACHE_ENABLED)
* [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS)
* [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS)
* [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS)
* [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS)
* [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS)
* [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS)
* [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS)
* [HTTPCACHE_EXPIRATION_SECS](downloader-middleware.html#std:setting-HTTPCACHE_EXPIRATION_SECS)
* [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP)
* [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP)
* [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP)
* [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP)
* [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP)
* [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP)
* [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP)
* [HTTPCACHE_GZIP](downloader-middleware.html#std:setting-HTTPCACHE_GZIP)
* [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES)
* [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES)
* [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES)
* [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES)
* [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES)
* [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES)
* [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES)
* [HTTPCACHE_IGNORE_HTTP_CODES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_HTTP_CODES)
* [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING)
* [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING)
* [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING)
* [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING)
* [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING)
* [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING)
* [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING)
* [HTTPCACHE_IGNORE_MISSING](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_MISSING)
* [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS)
* [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS)
* [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS)
* [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS)
* [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS)
* [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS)
* [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS)
* [HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS)
* [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES)
* [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES)
* [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES)
* [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES)
* [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES)
* [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES)
* [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES)
* [HTTPCACHE_IGNORE_SCHEMES](downloader-middleware.html#std:setting-HTTPCACHE_IGNORE_SCHEMES)
* [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY)
* [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY)
* [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY)
* [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY)
* [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY)
* [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY)
* [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY)
* [HTTPCACHE_POLICY](downloader-middleware.html#std:setting-HTTPCACHE_POLICY)
* [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE)
* [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE)
* [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE)
* [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE)
* [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE)
* [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE)
* [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE)
* [HTTPCACHE_STORAGE](downloader-middleware.html#std:setting-HTTPCACHE_STORAGE)
* [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES)
* [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES)
* [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES)
* [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES)
* [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES)
* [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES)
* [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES)
* [HTTPERROR_ALLOWED_CODES](spider-middleware.html#std:setting-HTTPERROR_ALLOWED_CODES)
* [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL)
* [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL)
* [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL)
* [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL)
* [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL)
* [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL)
* [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL)
* [HTTPERROR_ALLOW_ALL](spider-middleware.html#std:setting-HTTPERROR_ALLOW_ALL)
* [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING)
* [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING)
* [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING)
* [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING)
* [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING)
* [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING)
* [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING)
* [HTTPPROXY_AUTH_ENCODING](downloader-middleware.html#std:setting-HTTPPROXY_AUTH_ENCODING)
* [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED)
* [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED)
* [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED)
* [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED)
* [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED)
* [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED)
* [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED)
* [HTTPPROXY_ENABLED](downloader-middleware.html#std:setting-HTTPPROXY_ENABLED)
* [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES)
* [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES)
* [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES)
* [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES)
* [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES)
* [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES)
* [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES)
* [IMAGES_EXPIRES](media-pipeline.html#std:setting-IMAGES_EXPIRES)
* [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT)
* [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT)
* [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT)
* [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT)
* [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT)
* [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT)
* [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT)
* [IMAGES_MIN_HEIGHT](media-pipeline.html#std:setting-IMAGES_MIN_HEIGHT)
* [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH)
* [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH)
* [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH)
* [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH)
* [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH)
* [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH)
* [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH)
* [IMAGES_MIN_WIDTH](media-pipeline.html#std:setting-IMAGES_MIN_WIDTH)
* [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD)
* [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD)
* [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD)
* [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD)
* [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD)
* [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD)
* [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD)
* [IMAGES_RESULT_FIELD](media-pipeline.html#std:setting-IMAGES_RESULT_FIELD)
* [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE)
* [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE)
* [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE)
* [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE)
* [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE)
* [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE)
* [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE)
* [IMAGES_STORE](media-pipeline.html#std:setting-IMAGES_STORE)
* [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL)
* [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL)
* [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL)
* [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL)
* [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL)
* [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL)
* [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL)
* [IMAGES_STORE_GCS_ACL](media-pipeline.html#std:setting-IMAGES_STORE_GCS_ACL)
* [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL)
* [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL)
* [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL)
* [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL)
* [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL)
* [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL)
* [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL)
* [IMAGES_STORE_S3_ACL](media-pipeline.html#std:setting-IMAGES_STORE_S3_ACL)
* [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS)
* [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS)
* [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS)
* [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS)
* [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS)
* [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS)
* [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS)
* [IMAGES_THUMBS](media-pipeline.html#std:setting-IMAGES_THUMBS)
* [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD)
* [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD)
* [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD)
* [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD)
* [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD)
* [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD)
* [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD)
* [IMAGES_URLS_FIELD](media-pipeline.html#std:setting-IMAGES_URLS_FIELD)
* [MAIL_FROM](email.html#std:setting-MAIL_FROM)
* [MAIL_FROM](email.html#std:setting-MAIL_FROM)
* [MAIL_FROM](email.html#std:setting-MAIL_FROM)
* [MAIL_FROM](email.html#std:setting-MAIL_FROM)
* [MAIL_FROM](email.html#std:setting-MAIL_FROM)
* [MAIL_FROM](email.html#std:setting-MAIL_FROM)
* [MAIL_FROM](email.html#std:setting-MAIL_FROM)
* [MAIL_FROM](email.html#std:setting-MAIL_FROM)
* [MAIL_HOST](email.html#std:setting-MAIL_HOST)
* [MAIL_HOST](email.html#std:setting-MAIL_HOST)
* [MAIL_HOST](email.html#std:setting-MAIL_HOST)
* [MAIL_HOST](email.html#std:setting-MAIL_HOST)
* [MAIL_HOST](email.html#std:setting-MAIL_HOST)
* [MAIL_HOST](email.html#std:setting-MAIL_HOST)
* [MAIL_HOST](email.html#std:setting-MAIL_HOST)
* [MAIL_HOST](email.html#std:setting-MAIL_HOST)
* [MAIL_PASS](email.html#std:setting-MAIL_PASS)
* [MAIL_PASS](email.html#std:setting-MAIL_PASS)
* [MAIL_PASS](email.html#std:setting-MAIL_PASS)
* [MAIL_PASS](email.html#std:setting-MAIL_PASS)
* [MAIL_PASS](email.html#std:setting-MAIL_PASS)
* [MAIL_PASS](email.html#std:setting-MAIL_PASS)
* [MAIL_PASS](email.html#std:setting-MAIL_PASS)
* [MAIL_PASS](email.html#std:setting-MAIL_PASS)
* [MAIL_PORT](email.html#std:setting-MAIL_PORT)
* [MAIL_PORT](email.html#std:setting-MAIL_PORT)
* [MAIL_PORT](email.html#std:setting-MAIL_PORT)
* [MAIL_PORT](email.html#std:setting-MAIL_PORT)
* [MAIL_PORT](email.html#std:setting-MAIL_PORT)
* [MAIL_PORT](email.html#std:setting-MAIL_PORT)
* [MAIL_PORT](email.html#std:setting-MAIL_PORT)
* [MAIL_PORT](email.html#std:setting-MAIL_PORT)
* [MAIL_SSL](email.html#std:setting-MAIL_SSL)
* [MAIL_SSL](email.html#std:setting-MAIL_SSL)
* [MAIL_SSL](email.html#std:setting-MAIL_SSL)
* [MAIL_SSL](email.html#std:setting-MAIL_SSL)
* [MAIL_SSL](email.html#std:setting-MAIL_SSL)
* [MAIL_SSL](email.html#std:setting-MAIL_SSL)
* [MAIL_SSL](email.html#std:setting-MAIL_SSL)
* [MAIL_SSL](email.html#std:setting-MAIL_SSL)
* [MAIL_TLS](email.html#std:setting-MAIL_TLS)
* [MAIL_TLS](email.html#std:setting-MAIL_TLS)
* [MAIL_TLS](email.html#std:setting-MAIL_TLS)
* [MAIL_TLS](email.html#std:setting-MAIL_TLS)
* [MAIL_TLS](email.html#std:setting-MAIL_TLS)
* [MAIL_TLS](email.html#std:setting-MAIL_TLS)
* [MAIL_TLS](email.html#std:setting-MAIL_TLS)
* [MAIL_TLS](email.html#std:setting-MAIL_TLS)
* [MAIL_USER](email.html#std:setting-MAIL_USER)
* [MAIL_USER](email.html#std:setting-MAIL_USER)
* [MAIL_USER](email.html#std:setting-MAIL_USER)
* [MAIL_USER](email.html#std:setting-MAIL_USER)
* [MAIL_USER](email.html#std:setting-MAIL_USER)
* [MAIL_USER](email.html#std:setting-MAIL_USER)
* [MAIL_USER](email.html#std:setting-MAIL_USER)
* [MAIL_USER](email.html#std:setting-MAIL_USER)
* [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS)
* [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS)
* [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS)
* [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS)
* [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS)
* [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS)
* [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS)
* [MEDIA_ALLOW_REDIRECTS](media-pipeline.html#std:setting-MEDIA_ALLOW_REDIRECTS)
* [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED)
* [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED)
* [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED)
* [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED)
* [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED)
* [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED)
* [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED)
* [METAREFRESH_ENABLED](downloader-middleware.html#std:setting-METAREFRESH_ENABLED)
* [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY)
* [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY)
* [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY)
* [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY)
* [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY)
* [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY)
* [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY)
* [METAREFRESH_MAXDELAY](downloader-middleware.html#std:setting-METAREFRESH_MAXDELAY)
* [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED)
* [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED)
* [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED)
* [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED)
* [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED)
* [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED)
* [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED)
* [REDIRECT_ENABLED](downloader-middleware.html#std:setting-REDIRECT_ENABLED)
* [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES)
* [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES)
* [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES)
* [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES)
* [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES)
* [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES)
* [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES)
* [REDIRECT_MAX_TIMES](downloader-middleware.html#std:setting-REDIRECT_MAX_TIMES)
* [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED)
* [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED)
* [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED)
* [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED)
* [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED)
* [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED)
* [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED)
* [REFERER_ENABLED](spider-middleware.html#std:setting-REFERER_ENABLED)
* [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY)
* [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY)
* [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY)
* [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY)
* [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY)
* [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY)
* [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY)
* [REFERRER_POLICY](spider-middleware.html#std:setting-REFERRER_POLICY)
* [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED)
* [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED)
* [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED)
* [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED)
* [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED)
* [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED)
* [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED)
* [RETRY_ENABLED](downloader-middleware.html#std:setting-RETRY_ENABLED)
* [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES)
* [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES)
* [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES)
* [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES)
* [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES)
* [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES)
* [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES)
* [RETRY_HTTP_CODES](downloader-middleware.html#std:setting-RETRY_HTTP_CODES)
* [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES)
* [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES)
* [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES)
* [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES)
* [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES)
* [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES)
* [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES)
* [RETRY_TIMES](downloader-middleware.html#std:setting-RETRY_TIMES)
* [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST)
* [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST)
* [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST)
* [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST)
* [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST)
* [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST)
* [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST)
* [TELNETCONSOLE_HOST](telnetconsole.html#std:setting-TELNETCONSOLE_HOST)
* [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD)
* [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD)
* [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD)
* [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD)
* [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD)
* [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD)
* [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD)
* [TELNETCONSOLE_PASSWORD](telnetconsole.html#std:setting-TELNETCONSOLE_PASSWORD)
* [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT)
* [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT)
* [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT)
* [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT)
* [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT)
* [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT)
* [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT)
* [TELNETCONSOLE_PORT](telnetconsole.html#std:setting-TELNETCONSOLE_PORT)
* [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME)
* [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME)
* [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME)
* [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME)
* [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME)
* [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME)
* [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME)
* [TELNETCONSOLE_USERNAME](telnetconsole.html#std:setting-TELNETCONSOLE_USERNAME)
- 簡介
- 第一步
- Scrapy at a glance
- 安裝指南
- Scrapy 教程
- 實例
- 基本概念
- 命令行工具
- Spider
- 選擇器
- 項目
- 項目加載器
- Scrapy shell
- 項目管道
- Feed 導出
- 請求和響應
- 鏈接提取器
- 設置
- 例外情況
- 內置服務
- Logging
- 統計數據集合
- 發送電子郵件
- 遠程登錄控制臺
- Web服務
- 解決具體問題
- 常見問題
- 調試spiders
- Spider 合約
- 常用做法
- 通用爬蟲
- 使用瀏覽器的開發人員工具進行抓取
- 調試內存泄漏
- 下載和處理文件和圖像
- 部署 Spider
- AutoThrottle 擴展
- Benchmarking
- 作業:暫停和恢復爬行
- 延伸 Scrapy
- 體系結構概述
- 下載器中間件
- Spider 中間件
- 擴展
- 核心API
- 信號
- 條目導出器
- 其余所有
- 發行說明
- 為 Scrapy 貢獻
- 版本控制和API穩定性