从CSV任务到SQLite的耙子标记

Question

我有一个耙子任务，通过一个 CSV 的 ID 文件。然后，我查询数据库以查看数据库中是否存在该 ID。如果存在，我使用 act_as_taggable 添加一个标签。脚本运行良好，直到它到达第一个匹配项并尝试将标记写入我的 SQLite 数据库。我收到数据库锁定错误。我想知道我是否达到了 SQLite 的 I/O 限制，需要切换到成熟的 MySQL 数据库。

if defined?(Rails) && (Rails.env == 'development')
  Rails.logger = Logger.new(STDOUT)
end
require 'csv'
desc "Tag Voters that early voted from the Secretary of State Website"
task :tag_early => [:environment] do
  file ="db/AllAbsentees.csv"
  CSV.foreach(file, :headers=> true) do |row|
    @voter_id = row[1]
    puts "Working on Row" + row[1]
    @voter = Voter.where(:state_id => @voter_id).first()
    unless @voter.blank?
      @voter.tag_list = "2012_GEN_EARLY_VOTER"
      @voter.save()
      puts "Voter #" + @voter_id + "tagged"
    end
  end
end

    Voter Load (1.2ms)  SELECT "voters".* FROM "voters" WHERE "voters"."state_id" = '00008030' LIMIT 1
  ActsAsTaggableOn::Tag Load (0.2ms)  SELECT "tags".* FROM "tags" INNER JOIN "taggings" ON "tags"."id" = "taggings"."tag_id" WHERE "taggings"."taggable_id" = 11944 AND "taggings"."taggable_type" = 'Voter' AND (taggings.context = 'tags' AND taggings.tagger_id IS NULL)
   (0.1ms)  begin transaction
   (0.4ms)  UPDATE "voters" SET "updated_at" = '2012-11-23 00:02:33.438114' WHERE "voters"."id" = 11944
  ActsAsTaggableOn::Tag Load (0.1ms)  SELECT "tags".* FROM "tags" WHERE (lower(name) = '2012_gen_early_voter')
  ActsAsTaggableOn::Tag Load (0.2ms)  SELECT "tags".* FROM "tags" INNER JOIN "taggings" ON "tags"."id" = "taggings"."tag_id" WHERE "taggings"."taggable_id" = 11944 AND "taggings"."taggable_type" = 'Voter' AND (taggings.context = 'tags' AND taggings.tagger_id IS NULL)
  ActsAsTaggableOn::Tagging Exists (0.1ms)  SELECT 1 AS one FROM "taggings" WHERE ("taggings"."tag_id" = 19 AND "taggings"."taggable_type" = 'Voter' AND "taggings"."taggable_id" = 11944 AND "taggings"."context" = 'tags' AND "taggings"."tagger_id" IS NULL AND "taggings"."tagger_type" IS NULL) LIMIT 1
  SQL (1.4ms)  INSERT INTO "taggings" ("context", "created_at", "tag_id", "taggable_id", "taggable_type", "tagger_id", "tagger_type") VALUES (?, ?, ?, ?, ?, ?, ?)  [["context", "tags"], ["created_at", Fri, 23 Nov 2012 00:02:33 UTC +00:00], ["tag_id", 19], ["taggable_id", 11944], ["taggable_type", "Voter"], ["tagger_id", nil], ["tagger_type", nil]]
   (5053.1ms)  commit transaction
SQLite3::BusyException: database is locked: commit transaction
   (99.7ms)  rollback transaction
rake aborted!
SQLite3::BusyException: database is locked: commit transaction

Answer 1

SQLite 没有太多的并发性;对于要写入数据库的事务，必须没有其他读取或写入连接。

确保没有其他程序同时读取或写入数据库，并且您自己的程序中的所有数据库访问都使用相同的数据库连接。