hudmol / as_spreadsheet_bulk_updater Goto Github PK

We've noticed that when one of the “Spreadsheet Bulk Update Job” is running, all users are blocked from saving edits to any record (accession, recourse, etc.) that is linked to any top container. This is a big problem at my institution, where some users are running jobs that take over an hour to complete.

Is it possible to stop this from happening, so that changes could be made even while the background job is running?

Or maybe to pop up a warning message on records linked to top containers before users start editing a record, so that they know they won't be able to save changes until the background job is done?

Thank you!

We're trying to add notes to archival objects with the spreadsheet, and while the notes are added, they default to publish?=false, so they're not showing up in the PUI. Is this a possible bug? or are we doing it wrong?
(thank you for this great tool!)

When I try to export the spreadsheet for a collection, I'm getting the following error. It is only appearing for one of the four series. I've only copied the first part of the error report below. Thanks in advance!

{"error":"key not found: "type": org/jruby/RubyHash.java:1261:in fetch'\n\t/archivesspace/plugins/as_spreadsheet_bulk_updater/backend/model/spreadsheet_builder.rb:340:in block in calculate_subrecord_counts'\n\t/archivesspace/gems/gems/sequel-5.9.0/lib/sequel/dataset/actions.rb:151:in block in each'\n\t/archivesspace/gems/gems/sequel-5.9.0/lib/sequel/adapters/jdbc.rb:795:in process_result_set'\n\t/archivesspace/gems/gems/sequel-5.9.0/lib/sequel/adapters/jdbc.rb:726:in `block in fetch_rows'\n\t/archivesspace/gems/gems/sequel-...

System: ArchivesSpace 2.8.1, RHEL 7.8, Java JDK 1.8.0_262

1. Installed the plugin to plugins/as_spreadsheet_bulk_updater
2. Added 'as_spreadsheet_bulk_updater' to AppConfig[:plugins]
3. Ran ./scripts/initialize-plugin.sh as_spreadsheet_bulk_updater. Though it installed bundler, it doesn't look like it installed anything from the plugin's Gemfile:

[root@aspace-staging1 archivesspace]$ ./scripts/initialize-plugin.sh as_spreadsheet_bulk_updater

Successfully installed bundler-2.1.4
Parsing documentation for bundler-2.1.4
Done installing documentation for bundler after 6 seconds
1 gem installed
Don't run Bundler as root. Bundler can ask for sudo if it is needed, and
installing your bundle as root will break this application for all non-root
users on this machine.

The Gemfile specifies no dependencies
Bundle complete! 0 Gemfile dependencies, 1 gem now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.

4. Starting up the application fails with this message in the log:

...
WARNING: ERROR: initialization failed
org.jruby.rack.RackInitializationException: no such file to load -- write_xlsx
        from org/jruby/RubyKernel.java:974:in `require'
        from /opt/archivesspace-v2.8.1/archivesspace/plugins/as_spreadsheet_bulk_updater/backend/model/spreadsheet_builder.rb:1:in `<main>'
...

Has there been any talk of adding other note fields or giving the user the ability to add additional notes to the spreadsheet manually? My institution is interested in including the phsyloc field specifically.

Hey @payten ,

We have our ASpace setup over paths:

• Staff -> https://dev-findingaids.archives.newschool.edu/staff/
• PUI -> https://dev-findingaids.archives.newschool.edu

I had to edit the routes.rb to get this to work on our setup.

ArchivesSpace::Application.routes.draw do

  [AppConfig[:frontend_proxy_prefix], AppConfig[:frontend_prefix]].uniq.each do |prefix|

    scope prefix do
      match('/plugins/spreadsheet_bulk_updater/download' => 'spreadsheet_bulk_updater#download_form', :via => [:get])
      match('/plugins/spreadsheet_bulk_updater/download' => 'spreadsheet_bulk_updater#download', :via => [:post])
    end
  end
end

Hi,

I have the digitization_work_order plugin successfully installed but I can't seem to get as_spreadsheet_bulk_updater to initialize with the ArchivesSpace initialize-plugin.sh script. The plugin is renamed to remove the version number. When I initialize it I get the following error:

[!] There was an error parsing `Gemfile`: no such file to load -- xlsx_streaming_reader. Bundler cannot continue.

 #  from /opt/archivesspace_2_8_1/plugins/as_spreadsheet_bulk_updater/Gemfile:43
 #  -------------------------------------------
 #  local_gems.each do |gem|
 >    require gem.fetch(:gem)
 #  end
 #  -------------------------------------------

I can resolve this by manually downloading and plopping the xlsx_streaming_reader gem into the local_gems directory (sans version number). initialize-plugin.sh then succeeds with the following:

Successfully installed bundler-2.1.4
Parsing documentation for bundler-2.1.4
Done installing documentation for bundler after 6 seconds
1 gem installed
Don't run Bundler as root. Bundler can ask for sudo if it is needed, and installing your bundle as root will break this application for all non-root users on this machine.
The Gemfile specifies no dependencies
Resolving dependencies...
Bundle complete! 0 Gemfile dependencies, 1 gem now installed.
Use bundle info [gemname] to see where a bundled gem is installed.

But when I try to run ASpace I get a looping initialization error:

INFO: INFO: resetting rack response due exception: org.jruby.rack.RackInitializationException:
[!] There was an error parsing `Gemfile`: no such file to load -- xlsx_streaming_reader. Bundler cannot continue.

 #  from /opt/archivesspace_2_8_1/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/Gemfile:64
 #  -------------------------------------------
 #  require 'asutils'
 >  ASUtils.load_plugin_gems(self)
 #  -------------------------------------------

        from org/jruby/RubyKernel.java:974:in `require'
        from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:54:in `require'
        from (eval):43:in `block in (eval)'
        from org/jruby/RubyArray.java:1809:in `each'
        from (eval):42:in `(eval)'
        from org/jruby/RubyBasicObject.java:2628:in `instance_eval'
        from uri:classloader:/asutils.rb:253:in `block in load_plugin_gems'
        from org/jruby/RubyArray.java:1809:in `each'
        from uri:classloader:/asutils.rb:249:in `load_plugin_gems'
        from /opt/archivesspace_2_8_1/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/Gemfile:64:in `(eval)'
        from org/jruby/RubyBasicObject.java:2640:in `instance_eval'
        from /opt/archivesspace_2_8_1/gems/gems/bundler-2.1.4/lib/bundler/dsl.rb:47:in `eval_gemfile'
        from /opt/archivesspace_2_8_1/gems/gems/bundler-2.1.4/lib/bundler/dsl.rb:12:in `evaluate'
        from /opt/archivesspace_2_8_1/gems/gems/bundler-2.1.4/lib/bundler/definition.rb:34:in `build'
        from /opt/archivesspace_2_8_1/gems/gems/bundler-2.1.4/lib/bundler.rb:195:in `definition'
        from /opt/archivesspace_2_8_1/gems/gems/bundler-2.1.4/lib/bundler.rb:143:in `setup'
        from /opt/archivesspace_2_8_1/gems/gems/bundler-2.1.4/lib/bundler/setup.rb:20:in `block in <main>'
        from /opt/archivesspace_2_8_1/gems/gems/bundler-2.1.4/lib/bundler/ui/shell.rb:136:in `with_level'
        from /opt/archivesspace_2_8_1/gems/gems/bundler-2.1.4/lib/bundler/ui/shell.rb:88:in `silence'
        from /opt/archivesspace_2_8_1/gems/gems/bundler-2.1.4/lib/bundler/setup.rb:20:in `<main>'
        from org/jruby/RubyKernel.java:974:in `require'
        from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:130:in `require'
        from /opt/archivesspace_2_8_1/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/main.rb:1:in `<main>'
        from org/jruby/RubyKernel.java:974:in `require'
        from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:54:in `require'
        from /opt/archivesspace_2_8_1/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/config.ru:4:in `block in <main>'
        from org/jruby/RubyBasicObject.java:2622:in `instance_eval'
        from uri:classloader:/vendor/rack-2.2.3/rack/builder.rb:125:in `initialize'
        from /opt/archivesspace_2_8_1/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/config.ru:1:in `<main>'
        from launcher/launcher.rb:92:in `start_server'
        from launcher/launcher.rb:157:in `main'
        from launcher/launcher.rb:261:in `<main>'

Any ideas about how I should proceed? Let me know if you need any more details.

Thanks,
Will Bonnett
George Washington University Libraries

Tried using this today and got this error.

{"error":{"db_error":["Database integrity constraint conflict: Java::ComMysqlJdbc::MysqlDataTruncation: Data truncation: Cannot create a JSON value from a string with CHARACTER SET 'binary'."]}}​

I tried exporting a spreadsheet from a couple of different resources and selected a couple of different fields to make sure there wasn't something going on with the original resource I was working with but got the same error. I noticed some changes have been made since yesterday so, just wanted to give you a heads up.

Hello,
the start of archivesspace with the plugin enabled come out with a Java error related to write_xlsx:

WARNING: ERROR: initialization failed
org.jruby.rack.RackInitializationException: no such file to load -- write_xlsx

All the setup guidelines have been followed.
Gem env and gem file shows the write_xlsx gem is installed.
Thanks
Giuliano

Tried to update records with a spreadsheet and got the following error message (frustratingly, after all the AO's seemed to update properly):

!!! Errors encountered during processing !!!

All changes have been reverted.

Sheet name: Updates
Row number: 3
Column: N/A
JSONModel Property: notes/2/subnotes
Errors: Must contain at least one subnote

Please correct any issues with your import spreadsheet and retry.

a bug, perhaps?

After unzipping the plugin, the unzipped directory needs to be renamed from as_spreadsheet_bulk_updater-1.0 to as_spreadsheet_bulk_updater. This isn't mentioned in the installation instructions but it won't work without it.