2025-03-21 06:13:46 [scrapy.utils.log] (PID: 5699) INFO: Scrapy 2.12.0 started (bot: catalog_extraction)
2025-03-21 06:13:47 [scrapy.utils.log] (PID: 5699) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.11 (main, Mar 17 2025, 23:23:20) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36
2025-03-21 06:13:47 [home_depot] (PID: 5699) INFO: Starting extraction spider home_depot...
2025-03-21 06:13:47 [scrapy.addons] (PID: 5699) INFO: Enabled addons:
[]
2025-03-21 06:13:47 [py.warnings] (PID: 5699) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting.
It will be removed in a future version of Scrapy.
  return cls(crawler)

2025-03-21 06:13:47 [scrapy.extensions.telnet] (PID: 5699) INFO: Telnet Password: 5c4d279b04b6bd2c
2025-03-21 06:13:47 [py.warnings] (PID: 5699) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-03-21 06:13:47 [scrapy.middleware] (PID: 5699) INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.closespider.CloseSpider',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy_patchright.memusage.ScrapyPlaywrightMemoryUsageExtension',
 'spidermon.contrib.scrapy.extensions.Spidermon']
2025-03-21 06:13:47 [scrapy.crawler] (PID: 5699) INFO: Overridden settings:
{'BOT_NAME': 'catalog_extraction',
 'CONCURRENT_ITEMS': 250,
 'CONCURRENT_REQUESTS': 24,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'HTTPPROXY_ENABLED': False,
 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/home_depot/a34dde5e061b11f0aeca4200a9fe0102.log',
 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: '
               '%(message)s',
 'LOG_LEVEL': 'INFO',
 'NEWSPIDER_MODULE': 'catalog_extraction.spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['catalog_extraction.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, '
               'like Gecko) Chrome/129.0.0.0 Safari/537.36'}
2025-03-21 06:13:47 [scrapy_poet.injection] (PID: 5699) INFO: Loading providers:
 [<class 'scrapy_poet.page_input_providers.HttpRequestProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpResponseProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpClientProvider'>,
 <class 'scrapy_poet.page_input_providers.PageParamsProvider'>,
 <class 'scrapy_poet.page_input_providers.RequestUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.ResponseUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.StatsProvider'>]
2025-03-21 06:13:47 [scrapy.middleware] (PID: 5699) INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_poet.InjectionMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy_poet.DownloaderStatsMiddleware']
2025-03-21 06:13:47 [NotFoundHandlerSpiderMiddleware] (PID: 5699) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment.
2025-03-21 06:13:47 [scrapy.middleware] (PID: 5699) INFO: Enabled spider middlewares:
['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware',
 'catalog_extraction.middlewares.FixtureSavingMiddleware',
 'scrapy_poet.RetryMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2025-03-21 06:13:47 [scrapy.middleware] (PID: 5699) INFO: Enabled item pipelines:
['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline',
 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline',
 'catalog_extraction.pipelines.PriceRoundingPipeline',
 'scraping_utils.pipelines.AttachSupplierPipeline',
 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline']
2025-03-21 06:13:47 [scrapy.core.engine] (PID: 5699) INFO: Spider opened
2025-03-21 06:13:47 [scrapy.extensions.closespider] (PID: 5699) INFO: Spider will stop when no items are produced after 7200 seconds.
2025-03-21 06:13:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-03-21 06:13:47 [scrapy.extensions.telnet] (PID: 5699) INFO: Telnet console listening on 127.0.0.1:6023
2025-03-21 06:13:47 [scrapy-playwright] (PID: 5699) INFO: Starting download handler
2025-03-21 06:13:47 [scrapy-playwright] (PID: 5699) INFO: Starting download handler
2025-03-21 06:14:02 [scrapy-playwright] (PID: 5699) INFO: Launching browser chromium
2025-03-21 06:14:02 [scrapy-playwright] (PID: 5699) INFO: Browser chromium launched
2025-03-21 06:14:08 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:08 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:08 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:08 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:13 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:13 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:13 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:13 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:20 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:20 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:26 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:26 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:26 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:26 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:26 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:26 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 14 pages (at 14 pages/min), scraped 0 items (at 0 items/min)
2025-03-21 06:14:51 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:51 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:51 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:57 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:57 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:57 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:58 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:58 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:14:58 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:05 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:05 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:05 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:05 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:10 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:10 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:10 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:10 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:16 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:16 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:21 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:21 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:22 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:22 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:25 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:25 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:26 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:26 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:33 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:33 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:33 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:33 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:42 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:42 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:43 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:43 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 34 pages (at 20 pages/min), scraped 2 items (at 2 items/min)
2025-03-21 06:15:52 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:52 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:52 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:52 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:52 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:52 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:58 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:58 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:58 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:15:58 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:05 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/BEHR-PREMIUM-1-gal-N230-7-Rustic-Tobacco-Textured-Low-Lustre-Enamel-Interior-Exterior-Porch-and-Patio-Anti-Slip-Floor-Paint-623001/313152836> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/BEHR-PREMIUM-1-gal-N230-7-Rustic-Tobacco-Textured-Low-Lustre-Enamel-Interior-Exterior-Porch-and-Patio-Anti-Slip-Floor-Paint-623001/313152836
2025-03-21 06:16:05 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:05 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:09 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:10 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:13 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:13 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:13 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:13 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:22 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:23 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:23 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:23 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:29 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:30 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:30 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:30 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:33 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:33 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/RYOBI-ONE-18V-Cordless-3-8-in-Impact-Wrench-Tool-Only-with-3-8-in-Drive-SAE-Impact-Socket-Set-4-Piece-PCL250B-A13401/321350111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/RYOBI-ONE-18V-Cordless-3-8-in-Impact-Wrench-Tool-Only-with-3-8-in-Drive-SAE-Impact-Socket-Set-4-Piece-PCL250B-A13401/321350111 returned 404 status code.
2025-03-21 06:16:33 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:41 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:41 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 56 pages (at 22 pages/min), scraped 5 items (at 3 items/min)
2025-03-21 06:16:50 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:50 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:50 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:50 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:50 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Valencia-Fuchsia-Multi-2-ft-x-6-ft-Border-Runner-Rug-VAL103P-26/308049471> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/SAFAVIEH-Valencia-Fuchsia-Multi-2-ft-x-6-ft-Border-Runner-Rug-VAL103P-26/308049471 returned 404 status code.
2025-03-21 06:16:55 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:55 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:59 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:16:59 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:00 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:00 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:00 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:00 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:07 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:07 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/nuLOOM-Arabella-Contemporary-Bordered-Black-4-ft-x-6-ft-Indoor-Area-Rug-ECRK13B-406/316011623> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/nuLOOM-Arabella-Contemporary-Bordered-Black-4-ft-x-6-ft-Indoor-Area-Rug-ECRK13B-406/316011623 returned 404 status code.
2025-03-21 06:17:08 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:12 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:13 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:13 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:13 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:16 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:16 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/OVE-Decors-Tampa-50-7-8-in-W-x-72-in-H-Rectangular-Pivot-Frameless-Corner-Shower-Enclosure-in-Black-828796054539/316103617> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/OVE-Decors-Tampa-50-7-8-in-W-x-72-in-H-Rectangular-Pivot-Frameless-Corner-Shower-Enclosure-in-Black-828796054539/316103617 returned 404 status code.
2025-03-21 06:17:16 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:22 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:23 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:23 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Allied-Brass-Monte-Carlo-18-in-L-x-3-in-H-x-5-in-W-Clear-Glass-Bathroom-Shelf-in-Antique-Bronze-MC-33-18-ABZ/300613614> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Allied-Brass-Monte-Carlo-18-in-L-x-3-in-H-x-5-in-W-Clear-Glass-Bathroom-Shelf-in-Antique-Bronze-MC-33-18-ABZ/300613614 returned 404 status code.
2025-03-21 06:17:23 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:23 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:26 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Carnegy-Avenue-Purple-4-ft-x-5-ft-Rectangle-Geometric-Area-Rug-CGA-OKR-501295-PU-HD/320232408> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Carnegy-Avenue-Purple-4-ft-x-5-ft-Rectangle-Geometric-Area-Rug-CGA-OKR-501295-PU-HD/320232408 returned 404 status code.
2025-03-21 06:17:31 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Unique-Loom-Marine-Blue-7-ft-1-in-x-7-ft-1-in-Davos-Shag-Solid-Area-Rug-3153325/326886850> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Unique-Loom-Marine-Blue-7-ft-1-in-x-7-ft-1-in-Davos-Shag-Solid-Area-Rug-3153325/326886850 returned 404 status code.
2025-03-21 06:17:31 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:31 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:35 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Abstract-Ivory-Beige-12-ft-x-18-ft-Striped-Area-Rug-ABT141D-1218/326646437> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/SAFAVIEH-Abstract-Ivory-Beige-12-ft-x-18-ft-Striped-Area-Rug-ABT141D-1218/326646437 returned 404 status code.
2025-03-21 06:17:35 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:35 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:41 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:41 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:45 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:45 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:45 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:45 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 81 pages (at 25 pages/min), scraped 7 items (at 2 items/min)
2025-03-21 06:17:48 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/43-5-in-W-x-16-in-D-x-18-in-H-Bathroom-Gray-Linen-Cabinet-2023-8-29-10/327438336> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/43-5-in-W-x-16-in-D-x-18-in-H-Bathroom-Gray-Linen-Cabinet-2023-8-29-10/327438336 returned 404 status code.
2025-03-21 06:17:54 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:54 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:54 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:54 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:57 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Artistic-Weavers-Skadi-Burnt-Orange-8-ft-x-11-ft-Abstract-Area-Rug-S00161012939/308070721> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Livabliss-Skadi-Burnt-Orange-8-ft-x-11-ft-Abstract-Area-Rug-S00161012939/308070721 returned 404 status code.
2025-03-21 06:17:57 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:17:57 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:07 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:07 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:07 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:07 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:07 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:07 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:14 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:14 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:14 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:14 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:17 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Addison-Rugs-Chantille-ACN559-Beige-1-ft-8-in-x-2-ft-6-in-Machine-Washable-Indoor-Outdoor-Geometric-Area-Rug-ACN559BG20X30/327717102> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Addison-Rugs-Chantille-ACN559-Beige-1-ft-8-in-x-2-ft-6-in-Machine-Washable-Indoor-Outdoor-Geometric-Area-Rug-ACN559BG20X30/327717102 returned 404 status code.
2025-03-21 06:18:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:22 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:22 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:28 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:28 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:28 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:28 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:29 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/LOLOI-II-Bianca-Ivory-Multi-18-in-x-18-in-Sample-Contemporary-Sample-Rug-BIANBIA-03IVML160S/326010512> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/LOLOI-II-Bianca-Ivory-Multi-18-in-x-18-in-sample-Contemporary-Sample-Rug-BIANBIA-03IVML160S/326010512 returned 404 status code.
2025-03-21 06:18:40 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:40 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:40 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:40 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:43 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Natural-Fiber-Navy-9-ft-x-12-ft-Solid-Area-Rug-NF368N-9/314594963> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/SAFAVIEH-Natural-Fiber-Navy-9-ft-x-12-ft-Solid-Area-Rug-NF368N-9/314594963 returned 404 status code.
2025-03-21 06:18:43 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:43 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 103 pages (at 22 pages/min), scraped 9 items (at 2 items/min)
2025-03-21 06:18:51 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Cape-Cod-Natural-Blue-11-ft-x-15-ft-Distressed-Diamonds-Area-Rug-CAP351A-1115/322299781> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/SAFAVIEH-Cape-Cod-Natural-Blue-11-ft-x-15-ft-Distressed-Diamonds-Area-Rug-CAP351A-1115/322299781 returned 404 status code.
2025-03-21 06:18:51 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:52 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:52 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:52 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:56 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:56 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:56 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:18:56 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:03 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Courtyard-Gray-Bone-2-ft-x-14-ft-Striped-Indoor-Outdoor-Patio-Runner-Rug-CY6062-236-214/204827564> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/SAFAVIEH-Courtyard-Gray-Bone-2-ft-x-14-ft-Striped-Indoor-Outdoor-Patio-Runner-Rug-CY6062-236-214/204827564 returned 404 status code.
2025-03-21 06:19:03 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:03 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:08 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Unique-Loom-Portland-Orford-Blue-8-ft-x-10-ft-Area-Rug-3147094/311916538> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Unique-Loom-Portland-Orford-Blue-8-ft-x-10-ft-Area-Rug-3147094/311916538 returned 404 status code.
2025-03-21 06:19:08 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:08 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:08 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:08 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:13 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:13 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:13 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:13 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:19 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:19 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:19 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:19 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:24 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:24 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:29 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Capel-Manteo-Vertical-Stripe-Dark-Red-7-ft-x-9-ft-Area-Rug-0050RS07000900530/302065548> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Capel-Manteo-Vertical-Stripe-Dark-Red-7-ft-x-9-ft-Area-Rug-0050RS07000900530/302065548 returned 404 status code.
2025-03-21 06:19:35 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:35 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:35 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:35 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:40 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:40 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:45 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:45 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:45 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:45 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 127 pages (at 24 pages/min), scraped 12 items (at 3 items/min)
2025-03-21 06:19:56 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Well-Woven-Barclay-Medallion-Kashan-Light-Blue-2-in-3-ft-x-3-in-11-ft-Traditional-Area-Rug-541063/305237997> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Well-Woven-Barclay-Medallion-Kashan-Light-Blue-2-in-3-ft-x-3-in-11-ft-Traditional-Area-Rug-541063/305237997 returned 404 status code.
2025-03-21 06:19:56 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:56 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:56 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:56 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:56 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:19:56 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:02 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:02 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:03 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:03 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:06 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Streamline-60-in-x-32-in-Acrylic-Clawfoot-Soaking-Bathtub-in-Matte-Dark-Blue-with-Polished-Chrome-Clawfeet-and-Matte-Pink-Drain-N107CH-PNK/326170647> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Streamline-60-in-x-32-in-Acrylic-Clawfoot-Soaking-Bathtub-in-Matte-Dark-Blue-with-Polished-Chrome-Clawfeet-and-Matte-Pink-Drain-N107CH-PNK/326170647 returned 404 status code.
2025-03-21 06:20:06 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Maisie-Morpho-Blue-Area-Rug-2-X-8-RA32494/325261640> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Maisie-Morpho-Blue-Area-Rug-2-X-8-RA32494/325261640 returned 404 status code.
2025-03-21 06:20:16 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:16 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:16 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:23 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:23 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:23 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:23 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:27 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:27 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:32 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:32 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:32 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:32 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:36 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:37 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:37 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:37 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:43 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:43 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:43 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:43 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 148 pages (at 21 pages/min), scraped 13 items (at 1 items/min)
2025-03-21 06:20:55 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:56 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:56 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:20:56 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:00 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:00 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:00 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:00 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:06 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:07 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:07 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:07 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:07 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:07 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:22 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:23 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:23 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:23 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:27 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:28 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:28 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:28 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:33 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:33 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:33 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:33 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:45 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:45 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:45 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:45 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 169 pages (at 21 pages/min), scraped 15 items (at 2 items/min)
2025-03-21 06:21:50 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:50 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:57 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:57 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:57 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:21:57 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:03 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:03 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:03 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:03 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:09 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:09 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:09 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:10 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:14 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:14 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:14 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:14 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:21 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:21 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:21 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:21 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:28 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:28 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:28 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:28 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:35 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:35 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:36 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:36 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:44 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:44 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:44 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:44 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 187 pages (at 18 pages/min), scraped 15 items (at 0 items/min)
2025-03-21 06:22:49 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:49 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:49 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:49 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:56 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:56 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:57 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:22:57 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:09 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:09 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:09 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:09 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:09 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:09 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:16 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:16 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:16 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:16 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:22 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:22 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:22 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:22 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:38 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:38 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:38 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:38 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:38 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:38 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:45 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:45 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:45 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:45 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 205 pages (at 18 pages/min), scraped 16 items (at 1 items/min)
2025-03-21 06:23:51 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:51 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:58 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:23:58 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:04 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:04 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:05 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:05 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:05 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:05 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:11 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:11 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:11 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:11 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:20 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/BEHR-PREMIUM-PLUS-1-gal-PPU24-17-Hailstorm-Gray-Hi-Gloss-Enamel-Interior-Exterior-Paint-805001/300395374> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/BEHR-PREMIUM-PLUS-1-gal-PPU24-17-Hailstorm-Gray-Hi-Gloss-Enamel-Interior-Exterior-Paint-805001/300395374 returned 404 status code.
2025-03-21 06:24:26 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:26 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:26 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:26 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:33 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:33 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:33 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:33 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:44 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:44 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:44 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:44 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 225 pages (at 20 pages/min), scraped 16 items (at 0 items/min)
2025-03-21 06:24:50 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:50 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:57 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:57 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:57 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:24:57 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:03 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:03 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:04 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:04 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:08 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:08 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:08 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:08 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:15 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:15 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:15 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:15 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:15 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:16 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:27 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Pitt-Glaze-1-gal-PPG1200-2-Sourpatch-Peach-Eggshell-Interior-Waterborne-1-Part-Epoxy-Paint-PPG1200-2PG-01E/317730064> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/Pitt-Glaze-1-gal-PPG1200-2-Sourpatch-Peach-Eggshell-Interior-Waterborne-1-Part-Epoxy-Paint-PPG1200-2PG-01E/317730064
2025-03-21 06:25:27 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:27 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:27 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:27 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:27 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:27 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:39 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/GE-4-Slice-Stainless-Steel-Wide-Slot-Toaster-with-7-Shade-Settings-G9TMA4SSPSS/316150959> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/GE-4-Slice-Stainless-Steel-Wide-Slot-Toaster-with-7-Shade-Settings-G9TMA4SSPSS/316150959
2025-03-21 06:25:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:39 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:39 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:43 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/FEL-PRO-Exhaust-Manifold-Gasket-Set-MS97167/311352425> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/FEL-PRO-Exhaust-Manifold-Gasket-Set-MS97167/311352425
2025-03-21 06:25:46 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Generac-Bisque-Fascia-Base-Wrap-for-Air-Cooled-Whole-House-Generators-7027/304000033> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/Generac-Bisque-Fascia-Base-Wrap-for-Air-Cooled-Whole-House-Generators-7027/304000033
2025-03-21 06:25:46 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:47 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 246 pages (at 21 pages/min), scraped 16 items (at 0 items/min)
2025-03-21 06:25:52 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:52 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:52 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:25:52 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:01 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:01 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:01 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:01 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:01 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/AMERELLE-Chrome-1-Gang-Decorator-Rocker-Wall-Plate-1-Pack-955R/202067760> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/AMERELLE-Diamond-Plate-1-Gang-Decorator-Rocker-Wall-Plate-Chrome-1-Pack-955R/202067760
2025-03-21 06:26:12 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/DECKED-BATTLE-MAT-Series-Black-Heavy-Duty-Single-Piece-Nyracord-Rubber-Truck-Cargo-Mat-AD18BEDMAT/322851014> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/DECKED-BATTLE-MAT-Series-Black-Heavy-Duty-Single-Piece-Nyracord-Rubber-Truck-Cargo-Mat-AD18BEDMAT/322851014
2025-03-21 06:26:12 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:12 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:12 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:12 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:19 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:19 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:19 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:19 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:24 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Celsius-Hayes-Digital-Socket-Fusion-Pipe-Welder-Tool-Kit-Pro-Upto-2-in-HY2PROKITCELSIUS/322001586> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/Celsius-Hayes-Digital-Socket-Fusion-Pipe-Welder-Tool-Kit-Pro-Upto-2-in-HY2PROKITCELSIUS/322001586
2025-03-21 06:26:28 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Craft-Gray-Blue-8-ft-x-10-ft-Abstract-Marble-Area-Rug-CFT864F-8/327596277> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/SAFAVIEH-Craft-Gray-Blue-8-ft-x-10-ft-Abstract-Marble-Area-Rug-CFT864F-8/327596277 returned 404 status code.
2025-03-21 06:26:29 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:29 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:29 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:29 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:40 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Tileon-43-in-W-x-22-in-D-Engineered-Stone-Composite-Vanity-Top-in-Gray-with-White-Rectangle-Single-Sink-with-Faucet-Hole-AYBSZHD1020/322597156> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/Tileon-43-in-W-x-22-in-D-Engineered-Stone-Composite-Vanity-Top-in-Gray-with-White-Rectangle-Single-Sink-with-Faucet-Hole-AYBSZHD1020/322597156
2025-03-21 06:26:40 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:40 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:40 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:40 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:40 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:40 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:46 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:46 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:46 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:46 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 268 pages (at 22 pages/min), scraped 18 items (at 2 items/min)
2025-03-21 06:26:48 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/53-00-in-W-x-15-70-in-D-x-30-00-in-H-Black-Linen-Cabinet-Console-Table-with-4-Doors-TOUTD1993/328268881> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/53-00-in-W-x-15-70-in-D-x-30-00-in-H-Black-Linen-Cabinet-Console-Table-with-4-Doors-TOUTD1993/328268881 returned 404 status code.
2025-03-21 06:26:51 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Slant-Fin-Fine-Line-30-7-in-Filler-Sleeve-for-Baseboard-Heaters-in-Nu-White-101-409/202254765> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/Slant-Fin-Fine-Line-30-7-in-Filler-Sleeve-for-Baseboard-Heaters-in-Nu-White-101-409/202254765
2025-03-21 06:26:56 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:26:56 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:00 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Courtyard-Natural-Blue-7-ft-x-7-ft-Round-Border-Indoor-Outdoor-Patio-Area-Rug-CY2665-3101-7R/205199512> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/SAFAVIEH-Courtyard-Natural-Blue-7-ft-x-7-ft-Round-Border-Indoor-Outdoor-Patio-Area-Rug-CY2665-3101-7R/205199512 returned 404 status code.
2025-03-21 06:27:00 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:00 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:04 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/FANMATS-MLB-Toronto-Blue-Jays-18-in-x-30-in-Cork-Comfort-Mat-25878/310711562> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/FANMATS-MLB-Toronto-Blue-Jays-18-in-x-30-in-Cork-Comfort-Mat-25878/310711562
2025-03-21 06:27:04 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:04 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:14 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Unique-Loom-Portland-Canby-Ivory-Gray-2-ft-2-in-x-12-ft-Runner-Rug-3147295/311932441> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Unique-Loom-Portland-Canby-Ivory-Gray-2-ft-2-in-x-12-ft-Runner-Rug-3147295/311932441 returned 404 status code.
2025-03-21 06:27:14 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:15 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:15 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:15 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:15 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:15 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:18 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Addison-Rugs-Rylee-Blue-3-ft-x-5-ft-Geometric-Indoor-Outdoor-Area-Rug-ARY32BL3X5/326585113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Addison-Rugs-Rylee-Blue-3-ft-x-5-ft-Geometric-Indoor-Outdoor-Area-Rug-ARY32BL3X5/326585113 returned 404 status code.
2025-03-21 06:27:22 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Courtyard-Brown-Natural-7-ft-x-10-ft-Border-Indoor-Outdoor-Patio-Area-Rug-CY2326-3009-6/205199249> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/SAFAVIEH-Courtyard-Brown-Natural-7-ft-x-10-ft-Border-Indoor-Outdoor-Patio-Area-Rug-CY2326-3009-6/205199249 returned 404 status code.
2025-03-21 06:27:22 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:22 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:24 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Aqua-Eden-Sophia-67-in-Solid-Surface-Flatbottom-Freestanding-Bathtub-in-White-HVRTRS673422/301712908> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/Aqua-Eden-Sophia-67-in-Solid-Surface-Flatbottom-Freestanding-Bathtub-in-White-HVRTRS673422/301712908
2025-03-21 06:27:27 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Home-Decorators-Collection-Frontier-7-ft-x-9-ft-Red-Braided-Oval-Area-Rug-BN79R084X108/203890393> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/Home-Decorators-Collection-Frontier-7-ft-x-9-ft-Red-Braided-Oval-Area-Rug-BN79R084X108/203890393
2025-03-21 06:27:30 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/30-in-W-x-18-in-D-x-34-in-H-Single-Sink-Freestanding-Bath-Vanity-in-Gray-with-White-Cultured-Marble-Top-MB-G67FB-G1/327538629> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/Polibi-30-in-W-x-18-in-D-x-34-in-H-Single-Sink-Freestanding-Bath-Vanity-in-Gray-with-White-Ceramic-Top-MB-G67FB-G1/327538629
2025-03-21 06:27:38 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:38 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Streamline-63-in-Acrylic-Clawfoot-Non-Whirlpool-Bathtub-in-Matte-Light-Blue-Oil-Rubbed-Bronze-Clawfeet-Brushed-GunMetal-Drain-N352ORB-BGM/320777168> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Streamline-63-in-Acrylic-Clawfoot-Non-Whirlpool-Bathtub-in-Matte-Light-Blue-Oil-Rubbed-Bronze-Clawfeet-Brushed-GunMetal-Drain-N352ORB-BGM/320777168 returned 404 status code.
2025-03-21 06:27:38 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:38 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:38 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:44 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:44 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:44 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:44 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 292 pages (at 24 pages/min), scraped 20 items (at 2 items/min)
2025-03-21 06:27:49 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:49 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:49 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:49 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:27:53 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Artistic-Weavers-Vernon-Taupe-Rose-9-ft-x-12-ft-Indoor-Machine-Washable-Area-Rug-S00161051210/318281342> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Livabliss-Vernon-Taupe-Rose-9-ft-x-12-ft-Indoor-Machine-Washable-Area-Rug-S00161051210/318281342 returned 404 status code.
2025-03-21 06:27:55 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Laguna-Shag-Ivory-5-ft-x-8-ft-Solid-Area-Rug-SGL303A-5/206785193> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/SAFAVIEH-Laguna-Shag-Ivory-5-ft-x-8-ft-Solid-Area-Rug-SGL303A-5/206785193
2025-03-21 06:28:01 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:01 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:01 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:01 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:06 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:06 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:06 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:06 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:10 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/20-in-W-x-28-in-H-Hanging-or-Surface-Mount-Rectangular-Aluminum-Medicine-Cabinet-with-Mirror-LED-Lights-RB-931T-A2028/325937701> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/20-in-W-x-28-in-H-Hanging-or-Surface-Mount-Rectangular-Aluminum-Medicine-Cabinet-with-Mirror-LED-Lights-RB-931T-A2028/325937701 returned 404 status code.
2025-03-21 06:28:10 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:10 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:18 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Better-Trends-Ombre-Briad-Collection-Black-24-x-72-Runner-100-Cotton-Chenille-Reversible-Indoor-Area-Rug-BROCR26BLK/309373745> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Better-Trends-Ombre-Briad-Collection-Black-24-x-72-Runner-100-Cotton-Chenille-Reversible-Indoor-Area-Rug-BROCR26BLK/309373745 returned 404 status code.
2025-03-21 06:28:18 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:18 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:18 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:18 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:24 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:24 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:24 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:24 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:32 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:32 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:32 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:32 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:38 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:38 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:38 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:38 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:46 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:46 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:46 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:46 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:46 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:46 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 315 pages (at 23 pages/min), scraped 21 items (at 1 items/min)
2025-03-21 06:28:51 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:51 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:51 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:57 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:57 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:57 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:28:57 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:03 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:03 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:03 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:03 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:06 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Craft-Gray-Blue-9-ft-x-12-ft-Distressed-Border-Area-Rug-CFT927F-9/327596475> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/SAFAVIEH-Craft-Gray-Blue-9-ft-x-12-ft-Distressed-Border-Area-Rug-CFT927F-9/327596475 returned 404 status code.
2025-03-21 06:29:06 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:06 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:17 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:17 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:28 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:28 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:28 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:28 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:28 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:28 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:28 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:29 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:30 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Intec-FORCE-2-Wheel-Kit-22300/204842733> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Intec-FORCE-2-Wheel-Kit-22300/204842733 returned 404 status code.
2025-03-21 06:29:35 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:35 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:35 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:35 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:42 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:42 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:42 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:42 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 337 pages (at 22 pages/min), scraped 21 items (at 0 items/min)
2025-03-21 06:29:48 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:48 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:48 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:48 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:48 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:48 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:59 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Glacier-Bay-Mirror-Mounting-Tape-Squares-908220/205195802> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/Glacier-Bay-Mirror-Mounting-Tape-Squares-908220/205195802
2025-03-21 06:29:59 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:59 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:59 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:59 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:59 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:29:59 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:01 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Streamline-57-in-Acrylic-Clawfoot-Non-Whirlpool-Bathtub-in-Glossy-White-with-Matte-Black-Drain-and-Polished-Chrome-Clawfeet-N374CH-BL/324073704> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Streamline-57-in-Acrylic-Clawfoot-Non-Whirlpool-Bathtub-in-Glossy-White-with-Matte-Black-Drain-and-Polished-Chrome-Clawfeet-N374CH-BL/324073704 returned 404 status code.
2025-03-21 06:30:06 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:06 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:06 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:06 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:09 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Well-Woven-Verity-Giselle-Grey-Rust-3-ft-11-in-x-5-ft-3-in-Moroccan-Abstract-Stripe-Area-Rug-VER-110-4/323763988> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Well-Woven-Verity-Giselle-Grey-Rust-3-ft-11-in-x-5-ft-3-in-Moroccan-Abstract-Stripe-Area-Rug-VER-110-4/323763988 returned 404 status code.
2025-03-21 06:30:15 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:15 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:15 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:15 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:22 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/SAFAVIEH-Oregon-Beige-Gray-7-ft-x-7-ft-Border-Medallion-Round-Area-Rug-ORE870B-7R/324638246> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/SAFAVIEH-Oregon-Beige-Gray-7-ft-x-7-ft-Border-Medallion-Round-Area-Rug-ORE870B-7R/324638246 returned 404 status code.
2025-03-21 06:30:22 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Unique-Loom-Outdoor-Botanical-Calypso-Multi-10-ft-x-14-ft-1-in-Area-Rug-3186679/326735728> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Unique-Loom-Outdoor-Botanical-Calypso-Multi-10-ft-x-14-ft-1-in-Area-Rug-3186679/326735728 returned 404 status code.
2025-03-21 06:30:25 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Concord-Global-Trading-Lara-Vase-Gray-7-ft-x-9-ft-Area-Rug-45366/300822299> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Concord-Global-Trading-Lara-Vase-Gray-7-ft-x-9-ft-Area-Rug-45366/300822299 returned 404 status code.
2025-03-21 06:30:31 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:31 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:31 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Addison-Rugs-Chantille-ACN507-Orange-10-ft-x-14-ft-Machine-Washable-Indoor-Outdoor-Geometric-Area-Rug-ACN507OR10X14/327697732> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Addison-Rugs-Chantille-ACN507-Orange-10-ft-x-14-ft-Machine-Washable-Indoor-Outdoor-Geometric-Area-Rug-ACN507OR10X14/327697732 returned 404 status code.
2025-03-21 06:30:41 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:41 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:41 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:41 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:41 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:41 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:41 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:41 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:46 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:46 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:46 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:46 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:30:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 362 pages (at 25 pages/min), scraped 22 items (at 1 items/min)
2025-03-21 06:30:50 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Addison-Rugs-Safari-Grey-3-ft-x-5-ft-Indoor-Outdoor-Washable-Indoor-Outdoor-Washable-Rug-ASF34GR3X5/326583479> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Addison-Rugs-Safari-Grey-3-ft-x-5-ft-Indoor-Outdoor-Washable-Indoor-Outdoor-Washable-Rug-ASF34GR3X5/326583479 returned 404 status code.
2025-03-21 06:30:51 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Custom-Size-Stair-Treads-Solid-Gray-6-5-in-x-26-in-Indoor-Carpet-Stair-Tread-Cover-Slip-Resistant-Backing-Set-of-13-1100-6-5X26-13/317286507> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/RugStylesOnline-Custom-Size-Stair-Treads-Solid-Gray-6-5-in-x-26-in-Indoor-Carpet-Stair-Tread-Cover-Slip-Resistant-Backing-Set-of-13-1100-6-5X26-13/317286507 returned 404 status code.
2025-03-21 06:31:01 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Hydro-Systems-42-in-x-36-in-Single-Threshold-Shower-Base-in-White-HPA4236W/205879392> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/Hydro-Systems-42-in-x-36-in-Single-Threshold-Shower-Base-in-White-HPA4236W/205879392
2025-03-21 06:31:01 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:31:01 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:31:01 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:31:01 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:31:01 [scrapy.downloadermiddlewares.retry] (PID: 5699) ERROR: Gave up retrying <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:31:01 [scrapy.core.scraper] (PID: 5699) ERROR: Error downloading <POST https://apionline.homedepot.com/federation-gateway/graphql?opname=metadata>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-21 06:31:06 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/Streamline-68-in-Acrylic-Clawfoot-Non-Whirlpool-Bathtub-in-Glossy-White-with-Matte-Black-Drain-And-Brushed-Gold-Clawfeet-N903BGL-BL/321191285> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/Streamline-68-in-Acrylic-Clawfoot-Non-Whirlpool-Bathtub-in-Glossy-White-with-Matte-Black-Drain-And-Brushed-Gold-Clawfeet-N903BGL-BL/321191285 returned 404 status code.
2025-03-21 06:31:06 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/24-in-W-x-36-in-H-Single-Door-Rectangular-Bathroom-Medicine-Cabinet-with-Mirror-Recessed-or-Surface-Mount-HL-W2067122786/328646918> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.homedepot.com/p/24-in-W-x-36-in-H-Single-Door-Rectangular-Bathroom-Medicine-Cabinet-with-Mirror-Recessed-or-Surface-Mount-HL-W2067122786/328646918 returned 404 status code.
2025-03-21 06:31:09 [scrapy.crawler] (PID: 5699) INFO: Received SIGINT, shutting down gracefully. Send again to force 
2025-03-21 06:31:09 [scrapy.core.engine] (PID: 5699) INFO: Closing spider (shutdown)
2025-03-21 06:31:47 [scrapy.extensions.logstats] (PID: 5699) INFO: Crawled 384 pages (at 22 pages/min), scraped 22 items (at 0 items/min)
2025-03-21 06:32:12 [scrapy.core.scraper] (PID: 5699) ERROR: Spider error processing <GET https://www.homedepot.com/p/PA26a-Stainless-Steel-Cable-Post-Terminal-10-Pack-96265/318999074> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/spiders/home_depot.py", line 113, in parse
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1742537499.egg/catalog_extraction/pages/home_depot.py", line 20, in validate_input
    raise ProductNotFound(f"Product not found, URL: {self.url}")
scraping_utils.common.exceptions.ProductNotFound: Product not found, URL: https://www.homedepot.com/p/PA26a-Stainless-Steel-Cable-Post-Terminal-10-Pack-96265/318999074
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... FAIL
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.)
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... FAIL
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... OK
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... FAIL
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... OK
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... FAIL
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... OK
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] ----------------------------------------------------------------------
2025-03-21 06:32:12 [home_depot] (PID: 5699) ERROR: [Spidermon] 
======================================================================
FAIL: Extracted Items Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 228, in __next__
    raise StopIteration
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'item_scraped_count' to be '>=' to '160000.0'. Current value: '22'

2025-03-21 06:32:12 [home_depot] (PID: 5699) ERROR: [Spidermon] 
======================================================================
FAIL: Error Count Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 228, in __next__
    raise StopIteration
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'log_count/ERROR' to be '<=' to '376.0'. Current value: '631'

2025-03-21 06:32:12 [home_depot] (PID: 5699) ERROR: [Spidermon] 
======================================================================
FAIL: Finish Reason Monitor/Should have the expected finished reason(s)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 228, in __next__
    raise StopIteration
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 110, in test_should_finish_with_expected_reason
    self.assertTrue(finished_reason in expected_reasons, msg=msg)
AssertionError: Finished with "shutdown" the expected reasons are ['finished']

2025-03-21 06:32:12 [home_depot] (PID: 5699) ERROR: [Spidermon] 
======================================================================
FAIL: Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 228, in __next__
    raise StopIteration
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 282, in test_maximum_retries
    self.assertLessEqual(max_reached, threshold, msg=msg)
AssertionError: Too many requests (285) reached the maximum retry amount

2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] 11 monitors in 0.003s
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] FAILED (failures=4, skipped=1)
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] -------------------------- FINISHED ACTIONS --------------------------
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] ----------------------------------------------------------------------
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] 0 actions in 0.000s
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] OK
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] --------------------------- PASSED ACTIONS ---------------------------
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] ----------------------------------------------------------------------
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] 0 actions in 0.000s
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] OK
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] --------------------------- FAILED ACTIONS ---------------------------
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... ERROR
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] ----------------------------------------------------------------------
2025-03-21 06:32:12 [home_depot] (PID: 5699) ERROR: [Spidermon] 
======================================================================
ERROR: CustomTemplateSendSlackMessageSpiderFinished
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 228, in __next__
    raise StopIteration
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/core/actions.py", line 39, in run
    self.run_action()
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 252, in run_action
    self.manager.send_message(
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 58, in send_message
    return [
           ^
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 59, in <listcomp>
    self.send_message(
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 85, in send_message
    return self._send_channel_message(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 129, in _send_channel_message
    attachments=self._parse_attachments(attachments),
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 171, in _parse_attachments
    python_attachments = ast.literal_eval(attachments)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/ast.py", line 64, in literal_eval
    node_or_string = parse(node_or_string.lstrip(" \t"), mode='eval')
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/ast.py", line 50, in parse
    return compile(source, filename, mode, flags,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<unknown>", line 4
    "text": "•  _Extracted Items Monitor/test_stat_monitor_: Expecting 'item_scraped_count' to be '>=' to '160000.0'. Current value: '22'\n•  _Error Count Monitor/test_stat_monitor_: Expecting 'log_count/ERROR' to be '<=' to '376.0'. Current value: '631'\n•  _Finish Reason Monitor/Should have the expected finished reason(s)_: Finished with "shutdown" the expected reasons are ['finished']\n•  _Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount_: Too many requests (285) reached the maximum retry amount\n",
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
SyntaxError: invalid syntax. Perhaps you forgot a comma?

2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] 1 action in 0.218s
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: [Spidermon] FAILED (errors=1)
2025-03-21 06:32:12 [home_depot] (PID: 5699) INFO: 61 URLs returned ProductNotFound.
2025-03-21 06:32:14 [home_depot] (PID: 5699) INFO: Flagging 55 URLs in the catalog_urls table as 'not found'.
2025-03-21 06:32:14 [home_depot] (PID: 5699) INFO: Stored 55 URLs in the catalog_urls table as 'not found'.
2025-03-21 06:32:14 [home_depot] (PID: 5699) WARNING: 6 URLs were not found in the `catalog_urls` table.
2025-03-21 06:32:14 [home_depot] (PID: 5699) INFO: URLs not found and not flagged: {'https://www.homedepot.com/p/AMERELLE-Diamond-Plate-1-Gang-Decorator-Rocker-Wall-Plate-Chrome-1-Pack-955R/202067760', 'https://www.homedepot.com/p/LOLOI-II-Bianca-Ivory-Multi-18-in-x-18-in-sample-Contemporary-Sample-Rug-BIANBIA-03IVML160S/326010512', 'https://www.homedepot.com/p/Polibi-30-in-W-x-18-in-D-x-34-in-H-Single-Sink-Freestanding-Bath-Vanity-in-Gray-with-White-Ceramic-Top-MB-G67FB-G1/327538629', 'https://www.homedepot.com/p/RugStylesOnline-Custom-Size-Stair-Treads-Solid-Gray-6-5-in-x-26-in-Indoor-Carpet-Stair-Tread-Cover-Slip-Resistant-Backing-Set-of-13-1100-6-5X26-13/317286507', 'https://www.homedepot.com/p/Livabliss-Skadi-Burnt-Orange-8-ft-x-11-ft-Abstract-Area-Rug-S00161012939/308070721', 'https://www.homedepot.com/p/Livabliss-Vernon-Taupe-Rose-9-ft-x-12-ft-Indoor-Machine-Washable-Area-Rug-S00161051210/318281342'}
2025-03-21 06:32:14 [home_depot] (PID: 5699) INFO: Finished processing 'not found' URLs in the `catalog_urls` table.
2025-03-21 06:32:14 [scrapy.extensions.feedexport] (PID: 5699) INFO: Stored bq feed (22 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:1
2025-03-21 06:32:14 [scrapy.statscollectors] (PID: 5699) INFO: Dumping Scrapy stats:
{'NotFoundHandlerSpiderMiddleware/ProductNotFound': 115,
 'NotFoundHandlerSpiderMiddleware/not_found/404_response': 43,
 'NotFoundHandlerSpiderMiddleware/not_found/retrieved': 55,
 'NotFoundHandlerSpiderMiddleware/not_found/table/stored': 55,
 'NotFoundHandlerSpiderMiddleware/not_found/table/to_store': 55,
 'big_query/url': 394,
 'downloader/exception_count': 855,
 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 855,
 'downloader/request_bytes': 2290261,
 'downloader/request_count': 1249,
 'downloader/request_method_count/GET': 394,
 'downloader/request_method_count/POST': 855,
 'downloader/response_bytes': 371756904,
 'downloader/response_count': 394,
 'downloader/response_status_count/200': 351,
 'downloader/response_status_count/404': 43,
 'dupefilter/filtered': 3,
 'elapsed_time_seconds': 1104.828059,
 'feedexport/success_count/BigQueryFeedStorage': 1,
 'finish_reason': 'shutdown',
 'finish_time': datetime.datetime(2025, 3, 21, 6, 32, 12, 597250, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 22,
 'items_per_minute': None,
 'log_count/ERROR': 636,
 'log_count/INFO': 70,
 'log_count/WARNING': 3,
 'memusage/max': 2418442240,
 'memusage/startup': 123441152,
 'playwright/browser_count': 1,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 394,
 'playwright/page_count/closed': 394,
 'playwright/page_count/max_concurrent': 2,
 'playwright/request_count': 41931,
 'playwright/request_count/aborted': 10298,
 'playwright/request_count/method/GET': 30755,
 'playwright/request_count/method/HEAD': 6898,
 'playwright/request_count/method/POST': 4278,
 'playwright/request_count/navigation': 514,
 'playwright/request_count/resource_type/document': 514,
 'playwright/request_count/resource_type/fetch': 2587,
 'playwright/request_count/resource_type/font': 1580,
 'playwright/request_count/resource_type/image': 6091,
 'playwright/request_count/resource_type/other': 2897,
 'playwright/request_count/resource_type/ping': 313,
 'playwright/request_count/resource_type/script': 16772,
 'playwright/request_count/resource_type/stylesheet': 2329,
 'playwright/request_count/resource_type/xhr': 8848,
 'playwright/response_count': 29118,
 'playwright/response_count/method/GET': 26161,
 'playwright/response_count/method/POST': 2957,
 'playwright/response_count/resource_type/document': 451,
 'playwright/response_count/resource_type/fetch': 2034,
 'playwright/response_count/resource_type/font': 1578,
 'playwright/response_count/resource_type/image': 2185,
 'playwright/response_count/resource_type/other': 2888,
 'playwright/response_count/resource_type/ping': 1,
 'playwright/response_count/resource_type/script': 16333,
 'playwright/response_count/resource_type/stylesheet': 2329,
 'playwright/response_count/resource_type/xhr': 1319,
 'product_status/discontinued': 4,
 'proxy_manager/ignored/dont_proxy': 394,
 'proxy_manager/ignored/proxy_defined': 570,
 'proxy_manager/processed': 285,
 'request_depth_max': 1,
 'response_received_count': 394,
 'responses_per_minute': None,
 'retry/count': 570,
 'retry/max_reached': 285,
 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 570,
 'scheduler/dequeued': 1249,
 'scheduler/dequeued/memory': 1249,
 'scheduler/enqueued': 1272,
 'scheduler/enqueued/memory': 1272,
 'spider_exceptions/ProductNotFound': 61,
 'spidermon/validation/fields': 462,
 'spidermon/validation/items': 22,
 'spidermon/validation/validators': 1,
 'spidermon/validation/validators/item/jsonschema': True,
 'spidermon_field_coverage/dict/brand': 1.0,
 'spidermon_field_coverage/dict/categories': 1.0,
 'spidermon_field_coverage/dict/countryOfOrigin': 1.0,
 'spidermon_field_coverage/dict/description': 1.0,
 'spidermon_field_coverage/dict/imageUrl': 1.0,
 'spidermon_field_coverage/dict/inStock': 1.0,
 'spidermon_field_coverage/dict/isFreeShipping': 1.0,
 'spidermon_field_coverage/dict/leadTime': 1.0,
 'spidermon_field_coverage/dict/manufacturer': 1.0,
 'spidermon_field_coverage/dict/manufacturerSku': 1.0,
 'spidermon_field_coverage/dict/name': 1.0,
 'spidermon_field_coverage/dict/packagingIncrement': 1.0,
 'spidermon_field_coverage/dict/prices': 1.0,
 'spidermon_field_coverage/dict/productStatus': 1.0,
 'spidermon_field_coverage/dict/relatedSkus': 1.0,
 'spidermon_field_coverage/dict/specifications': 1.0,
 'spidermon_field_coverage/dict/supplier': 1.0,
 'spidermon_field_coverage/dict/supplierSku': 1.0,
 'spidermon_field_coverage/dict/uom': 1.0,
 'spidermon_field_coverage/dict/url': 1.0,
 'spidermon_field_coverage/dict/weight': 1.0,
 'spidermon_item_scraped_count': 22,
 'spidermon_item_scraped_count/dict': 22,
 'spidermon_item_scraped_count/dict/brand': 22,
 'spidermon_item_scraped_count/dict/categories': 22,
 'spidermon_item_scraped_count/dict/countryOfOrigin': 22,
 'spidermon_item_scraped_count/dict/description': 22,
 'spidermon_item_scraped_count/dict/imageUrl': 22,
 'spidermon_item_scraped_count/dict/inStock': 22,
 'spidermon_item_scraped_count/dict/isFreeShipping': 22,
 'spidermon_item_scraped_count/dict/leadTime': 22,
 'spidermon_item_scraped_count/dict/manufacturer': 22,
 'spidermon_item_scraped_count/dict/manufacturerSku': 22,
 'spidermon_item_scraped_count/dict/name': 22,
 'spidermon_item_scraped_count/dict/packagingIncrement': 22,
 'spidermon_item_scraped_count/dict/prices': 22,
 'spidermon_item_scraped_count/dict/productStatus': 22,
 'spidermon_item_scraped_count/dict/relatedSkus': 22,
 'spidermon_item_scraped_count/dict/specifications': 22,
 'spidermon_item_scraped_count/dict/supplier': 22,
 'spidermon_item_scraped_count/dict/supplierSku': 22,
 'spidermon_item_scraped_count/dict/uom': 22,
 'spidermon_item_scraped_count/dict/url': 22,
 'spidermon_item_scraped_count/dict/weight': 22,
 'start_requests/big_query': 394,
 'start_time': datetime.datetime(2025, 3, 21, 6, 13, 47, 769191, tzinfo=datetime.timezone.utc)}
2025-03-21 06:32:14 [scrapy.core.engine] (PID: 5699) INFO: Spider closed (shutdown)
2025-03-21 06:32:14 [scrapy-playwright] (PID: 5699) INFO: Closing download handler
2025-03-21 06:32:14 [scrapy-playwright] (PID: 5699) INFO: Closing download handler
2025-03-21 06:32:14 [scrapy-playwright] (PID: 5699) INFO: Closing browser