属性在后台时不更新，但在 运行 内联时工作正常
Attribute doesn't update when backgrounded but works fine when run inline
我正在编写一个屏幕抓取工具，它从 post 中获取 url 列表，然后访问 url 并获取页面上所有链接的列表。然后它会访问所有链接（原始链接和来自刮擦的链接）并获取图像列表。当我 运行 作业内联时一切正常（除了需要 30 秒才能完成，这是一个问题，因为它需要永远响应 API 调用）。出于某种原因，当我采用相同的代码并使用后台工作人员对其进行 运行 时，有 2 个 URL 永远不会更新为完成。它始终是相同的 2 个网址。
奇怪的是我收到了错误消息
3 TID-ov9t89ido WARN: NoMethodError: undefined method `search' for #<Mechanize::File:0x007f9d86e77a40>
3 TID-ov9t89ido 警告：/app/app/models/scraper.rb:16:in scrape_images'
/app/app/workers/image_worker.rb:5:in执行'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:151:in execute_job'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:133:inblock (2 levels) in process'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:127:in block in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/newrelic_rpm-3.12.1.298/lib/new_relic/agent/instrumentation/sidekiq.rb:33:in调用中阻塞'
/app/vendor/bundle/ruby/2.2.0/gems/newrelic_rpm-3.12.1.298/lib/new_relic/agent/instrumentation/controller_instrumentation.rb:361:in perform_action_with_newrelic_trace'
/app/vendor/bundle/ruby/2.2.0/gems/newrelic_rpm-3.12.1.298/lib/new_relic/agent/instrumentation/sidekiq.rb:29:incall'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:129:in block in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/server/active_record.rb:6:incall'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:129:in block in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/server/retry_jobs.rb:74:incall'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:129:in block in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/server/logging.rb:11:in调用中阻塞'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/logging.rb:31:in with_context'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/server/logging.rb:7:incall'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:129:in block in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:132:incall'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:132:in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:128:inblock in process'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:167:in stats'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:127:inprocess'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:79:in process_one'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:67:in运行'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/util.rb:16:in watchdog'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/util.rb:24:in块在 safe_thread'
来自此代码：
def self.scrape_images(uri)
page = get_page(uri)
base_url = page.uri.to_s
images = page.search('//img') || []
qualify_images(uri, images).push(base_url)
end
我看到 Mechanize 不是线程安全的，我认为这可能是我的问题，但我不知道当它适用于其他所有内容时它会如何给我这个错误。任何帮助都是光荣的，感谢阅读。
我正在添加答案，因为我在搜索时没有在 SO 上找到答案。如果 Mechanize 访问内容类型为 .txt 的页面，它 return 不是 Page 对象而是 return 文件对象。在我的案例中，我用保护条款解决了它：
return [] unless page.class == Mechanize::Page
我正在编写一个屏幕抓取工具，它从 post 中获取 url 列表，然后访问 url 并获取页面上所有链接的列表。然后它会访问所有链接（原始链接和来自刮擦的链接）并获取图像列表。当我 运行 作业内联时一切正常（除了需要 30 秒才能完成，这是一个问题，因为它需要永远响应 API 调用）。出于某种原因，当我采用相同的代码并使用后台工作人员对其进行 运行 时，有 2 个 URL 永远不会更新为完成。它始终是相同的 2 个网址。
奇怪的是我收到了错误消息
3 TID-ov9t89ido WARN: NoMethodError: undefined method `search' for #<Mechanize::File:0x007f9d86e77a40>
3 TID-ov9t89ido 警告：/app/app/models/scraper.rb:16:in scrape_images'
/app/app/workers/image_worker.rb:5:in执行'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:151:in execute_job'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:133:inblock (2 levels) in process'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:127:in block in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/newrelic_rpm-3.12.1.298/lib/new_relic/agent/instrumentation/sidekiq.rb:33:in调用中阻塞'
/app/vendor/bundle/ruby/2.2.0/gems/newrelic_rpm-3.12.1.298/lib/new_relic/agent/instrumentation/controller_instrumentation.rb:361:in perform_action_with_newrelic_trace'
/app/vendor/bundle/ruby/2.2.0/gems/newrelic_rpm-3.12.1.298/lib/new_relic/agent/instrumentation/sidekiq.rb:29:incall'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:129:in block in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/server/active_record.rb:6:incall'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:129:in block in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/server/retry_jobs.rb:74:incall'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:129:in block in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/server/logging.rb:11:in调用中阻塞'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/logging.rb:31:in with_context'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/server/logging.rb:7:incall'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:129:in block in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:132:incall'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/middleware/chain.rb:132:in invoke'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:128:inblock in process'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:167:in stats'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:127:inprocess'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:79:in process_one'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/processor.rb:67:in运行'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/util.rb:16:in watchdog'
/app/vendor/bundle/ruby/2.2.0/gems/sidekiq-4.1.1/lib/sidekiq/util.rb:24:in块在 safe_thread'
来自此代码：
def self.scrape_images(uri)
page = get_page(uri)
base_url = page.uri.to_s
images = page.search('//img') || []
qualify_images(uri, images).push(base_url)
end
我看到 Mechanize 不是线程安全的，我认为这可能是我的问题，但我不知道当它适用于其他所有内容时它会如何给我这个错误。任何帮助都是光荣的，感谢阅读。
我正在添加答案，因为我在搜索时没有在 SO 上找到答案。如果 Mechanize 访问内容类型为 .txt 的页面，它 return 不是 Page 对象而是 return 文件对象。在我的案例中，我用保护条款解决了它：
return [] unless page.class == Mechanize::Page