arvados.git
5 years agoMerge branch 'master' into 14723-cwl-multiple-file-targets
Eric Biagiotti [Fri, 19 Apr 2019 14:59:24 +0000 (10:59 -0400)]
Merge branch 'master' into 14723-cwl-multiple-file-targets

refs #14723

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14723: Adds comments for the changes to StagingPathMapper
Eric Biagiotti [Fri, 19 Apr 2019 14:59:06 +0000 (10:59 -0400)]
14723: Adds comments for the changes to StagingPathMapper

Also improves executor exception handling mapping logic.

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoMerge branch '13996-new-api-config' refs #13996
Peter Amstutz [Thu, 18 Apr 2019 19:28:50 +0000 (15:28 -0400)]
Merge branch '13996-new-api-config' refs #13996

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '15002-cancel-completed-container'
Eric Biagiotti [Thu, 18 Apr 2019 18:41:29 +0000 (14:41 -0400)]
Merge branch '15002-cancel-completed-container'

refs #15002

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago15002: Adds admin feature for cancelling completed containers
Eric Biagiotti [Fri, 12 Apr 2019 13:55:33 +0000 (09:55 -0400)]
15002: Adds admin feature for cancelling completed containers

- Adds documentation and fixed dispatchcloud container test

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoMerge branch '15109-logs-table-admin-docs'
Lucas Di Pentima [Wed, 17 Apr 2019 21:31:40 +0000 (18:31 -0300)]
Merge branch '15109-logs-table-admin-docs'
Closes #15109

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '15002-container-permissions'
Tom Clegg [Wed, 17 Apr 2019 21:28:56 +0000 (17:28 -0400)]
Merge branch '15002-container-permissions'

refs #15002

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15002: Test invalid state changes, too.
Tom Clegg [Wed, 17 Apr 2019 21:23:08 +0000 (17:23 -0400)]
15002: Test invalid state changes, too.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15109: Adds missing doc file.
Lucas Di Pentima [Wed, 17 Apr 2019 20:30:11 +0000 (17:30 -0300)]
15109: Adds missing doc file.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago15109: Adds admin doc section on how to manage the api server's log table.
Lucas Di Pentima [Wed, 17 Apr 2019 20:29:08 +0000 (17:29 -0300)]
15109: Adds admin doc section on how to manage the api server's log table.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago15002: Fix container update permissions.
Tom Clegg [Wed, 17 Apr 2019 19:45:47 +0000 (15:45 -0400)]
15002: Fix container update permissions.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoFix "failed" status leaking to subsequent attempt.
Tom Clegg [Wed, 17 Apr 2019 19:43:37 +0000 (15:43 -0400)]
Fix "failed" status leaking to subsequent attempt.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoFix "failed" status leaking to subsequent attempt.
Tom Clegg [Wed, 17 Apr 2019 19:42:03 +0000 (15:42 -0400)]
Fix "failed" status leaking to subsequent attempt.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoUpdate arvbox documentation for devenv config, no issue #
Peter Amstutz [Fri, 12 Apr 2019 20:06:20 +0000 (16:06 -0400)]
Update arvbox documentation for devenv config, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoAdd gradle to arvbox, refs #14670
Peter Amstutz [Fri, 12 Apr 2019 18:43:50 +0000 (14:43 -0400)]
Add gradle to arvbox, refs #14670

Also adds a new "devenv" config that starts a minimal container
environment with no services and $HOME bind mounted into the
container.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Improve docs a bit
Peter Amstutz [Fri, 12 Apr 2019 14:28:50 +0000 (10:28 -0400)]
13996: Improve docs a bit

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Enable ERB for application.yml and database.yml
Peter Amstutz [Thu, 11 Apr 2019 20:47:07 +0000 (16:47 -0400)]
13996: Enable ERB for application.yml and database.yml

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14723: Fixes trailing whitespace
Eric Biagiotti [Thu, 11 Apr 2019 19:58:21 +0000 (15:58 -0400)]
14723: Fixes trailing whitespace

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoMention the credential expiry date option in the instructions to create Azure
Ward Vandewege [Thu, 11 Apr 2019 19:33:03 +0000 (15:33 -0400)]
Mention the credential expiry date option in the instructions to create Azure
credentials for Node Manager.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago13996: Documentation for config migration
Peter Amstutz [Thu, 11 Apr 2019 18:36:15 +0000 (14:36 -0400)]
13996: Documentation for config migration

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Tweak rake tasks
Peter Amstutz [Thu, 11 Apr 2019 15:42:58 +0000 (11:42 -0400)]
13996: Tweak rake tasks

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Update rest of code for cleaner config access
Peter Amstutz [Thu, 11 Apr 2019 14:34:14 +0000 (10:34 -0400)]
13996: Update rest of code for cleaner config access

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Don't override name of test db if one was provided in database.yml
Peter Amstutz [Thu, 11 Apr 2019 14:00:26 +0000 (10:00 -0400)]
13996: Don't override name of test db if one was provided in database.yml

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Update tests for cleaner config access
Peter Amstutz [Wed, 10 Apr 2019 21:44:29 +0000 (17:44 -0400)]
13996: Update tests for cleaner config access

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Copy config into OrderedOptions for nicer access
Peter Amstutz [Wed, 10 Apr 2019 21:07:08 +0000 (17:07 -0400)]
13996: Copy config into OrderedOptions for nicer access

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14723: Adds tests for multiple file targets and literal name resolution
Eric Biagiotti [Wed, 10 Apr 2019 20:31:26 +0000 (16:31 -0400)]
14723: Adds tests for multiple file targets and literal name resolution

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13996: Move configuration load earlier, before database setup
Peter Amstutz [Wed, 10 Apr 2019 18:06:41 +0000 (14:06 -0400)]
13996: Move configuration load earlier, before database setup

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14723: Fixes literal mapping and name conflict resolution
Eric Biagiotti [Tue, 9 Apr 2019 20:23:32 +0000 (16:23 -0400)]
14723:  Fixes literal mapping and name conflict resolution

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13996: Fix legacy_jobs_api check
Peter Amstutz [Tue, 9 Apr 2019 17:43:00 +0000 (13:43 -0400)]
13996: Fix legacy_jobs_api check

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Re-add symlink config.default.yml
Peter Amstutz [Tue, 9 Apr 2019 16:14:19 +0000 (12:14 -0400)]
13996: Re-add symlink config.default.yml

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Fix tests.
Peter Amstutz [Tue, 9 Apr 2019 14:25:45 +0000 (10:25 -0400)]
13996: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14723: Mapping each target destination to an input file WIP
Eric Biagiotti [Tue, 9 Apr 2019 13:45:04 +0000 (09:45 -0400)]
14723: Mapping each target destination to an input file WIP

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago15042: handle config.default.yml in our packaging.
Ward Vandewege [Fri, 5 Apr 2019 17:09:00 +0000 (13:09 -0400)]
15042: handle config.default.yml in our packaging.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago13996: rename config.defaults.yml to config.default.yml, to remain consistent
Ward Vandewege [Fri, 5 Apr 2019 17:07:00 +0000 (13:07 -0400)]
13996: rename config.defaults.yml to config.default.yml, to remain consistent
with our existing default files.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago13996: Can now use database info from config.yml
Peter Amstutz [Wed, 3 Apr 2019 20:41:58 +0000 (16:41 -0400)]
13996: Can now use database info from config.yml

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Refactor, create ConfigLoader class
Peter Amstutz [Tue, 2 Apr 2019 15:28:23 +0000 (11:28 -0400)]
13996: Refactor, create ConfigLoader class

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Adjust config:dump to dump active config
Peter Amstutz [Tue, 26 Mar 2019 21:52:35 +0000 (17:52 -0400)]
13996: Adjust config:dump to dump active config

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Update comments
Peter Amstutz [Tue, 26 Mar 2019 21:34:30 +0000 (17:34 -0400)]
13996: Update comments

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Add rake config:diff
Peter Amstutz [Tue, 26 Mar 2019 21:10:00 +0000 (17:10 -0400)]
13996: Add rake config:diff

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Fix discovery document remoteHosts
Peter Amstutz [Tue, 26 Mar 2019 20:31:06 +0000 (16:31 -0400)]
13996: Fix discovery document remoteHosts

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Explicitly get string representation of URLs
Peter Amstutz [Tue, 26 Mar 2019 18:38:59 +0000 (14:38 -0400)]
13996: Explicitly get string representation of URLs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Don't force check for GitInternalDir, breaks tests
Peter Amstutz [Tue, 26 Mar 2019 18:07:53 +0000 (14:07 -0400)]
13996: Don't force check for GitInternalDir, breaks tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Unit tests pass
Peter Amstutz [Tue, 26 Mar 2019 17:43:39 +0000 (13:43 -0400)]
13996: Unit tests pass

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Fixing test WIP
Peter Amstutz [Mon, 25 Mar 2019 20:39:23 +0000 (16:39 -0400)]
13996: Fixing test WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Migrate tests to new config
Peter Amstutz [Mon, 25 Mar 2019 15:28:33 +0000 (11:28 -0400)]
13996: Migrate tests to new config

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: More config migrations, refactor some code into config_loader.rb
Peter Amstutz [Fri, 22 Mar 2019 21:34:12 +0000 (17:34 -0400)]
13996: More config migrations, refactor some code into config_loader.rb

ActiveSupport::Duration is serialized properly when dumping config.

Non-empty string checks to use !.empty?

Because some configuration parameters could previously be either false
or a string, which are now just an empty string, but empty strings in
Ruby are truthy.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Parsing durations wip
Peter Amstutz [Fri, 22 Mar 2019 14:42:51 +0000 (10:42 -0400)]
13996: Parsing durations wip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Migrate majority of defaults to config.defaults.yml
Peter Amstutz [Thu, 21 Mar 2019 20:39:32 +0000 (16:39 -0400)]
13996: Migrate majority of defaults to config.defaults.yml

API server knows types of config parameters (needed for type coercion,
also useful for type checking.)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: More config updates
Peter Amstutz [Thu, 21 Mar 2019 16:38:09 +0000 (12:38 -0400)]
13996: More config updates

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Updating API server to use new config object WIP
Peter Amstutz [Wed, 20 Mar 2019 21:33:51 +0000 (17:33 -0400)]
13996: Updating API server to use new config object WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Migrating defaults to new config structure
Peter Amstutz [Tue, 19 Mar 2019 21:50:18 +0000 (17:50 -0400)]
13996: Migrating defaults to new config structure

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13996: Config migration WIP
Peter Amstutz [Tue, 19 Mar 2019 20:40:19 +0000 (16:40 -0400)]
13996: Config migration WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14873-api-rails5-upgrade'
Lucas Di Pentima [Mon, 8 Apr 2019 14:14:15 +0000 (11:14 -0300)]
Merge branch '14873-api-rails5-upgrade'
Closes #14873

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Fixes performance test.
Lucas Di Pentima [Mon, 8 Apr 2019 14:05:11 +0000 (11:05 -0300)]
14873: Fixes performance test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Updates dependency on our themes_for_rails fork.
Lucas Di Pentima [Sat, 6 Apr 2019 15:24:53 +0000 (12:24 -0300)]
14873: Updates dependency on our themes_for_rails fork.

The newer version eliminates cwa couple of deprecation warnings.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Upgrades missing config settings.
Lucas Di Pentima [Sat, 6 Apr 2019 14:29:08 +0000 (11:29 -0300)]
14873: Upgrades missing config settings.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Fixes typo on schema file.
Lucas Di Pentima [Fri, 5 Apr 2019 13:16:37 +0000 (10:16 -0300)]
14873: Fixes typo on schema file.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Adjusts latest API Server changes to be rails5 worthy.
Lucas Di Pentima [Fri, 5 Apr 2019 12:59:26 +0000 (09:59 -0300)]
14873: Adjusts latest API Server changes to be rails5 worthy.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch 'master' into 14873-api-rails5-upgrade
Lucas Di Pentima [Fri, 5 Apr 2019 12:26:15 +0000 (09:26 -0300)]
Merge branch 'master' into 14873-api-rails5-upgrade

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Fixes permission benchmark test
Lucas Di Pentima [Thu, 4 Apr 2019 22:25:11 +0000 (19:25 -0300)]
14873: Fixes permission benchmark test

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Changes perftest with benchmark because of unidentified errors.
Lucas Di Pentima [Thu, 4 Apr 2019 21:24:50 +0000 (18:24 -0300)]
14873: Changes perftest with benchmark because of unidentified errors.

Didn't want to dilate the migraton any longer because of this. If it's
critical we could investigate further.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agocheck-exist uses default python (oops) refs #15040
Peter Amstutz [Thu, 4 Apr 2019 20:44:19 +0000 (16:44 -0400)]
check-exist uses default python (oops) refs #15040

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14873: Migrated functional tests to be integration tests.
Lucas Di Pentima [Thu, 4 Apr 2019 19:11:55 +0000 (16:11 -0300)]
14873: Migrated functional tests to be integration tests.

Making more than 1 request on functional tests produces issues hard
to debug. Instead, those kind of tests should be done as integration tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoRun check-exist.py in Docker container refs #15040
Peter Amstutz [Thu, 4 Apr 2019 15:13:04 +0000 (11:13 -0400)]
Run check-exist.py in Docker container refs #15040

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14484-collection-record-update'
Eric Biagiotti [Thu, 4 Apr 2019 14:54:49 +0000 (10:54 -0400)]
Merge branch '14484-collection-record-update'

refs #14484

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoPin networkx because 2.2 is the last version to support Python 2.7 and 3.4
Peter Amstutz [Thu, 4 Apr 2019 14:41:27 +0000 (10:41 -0400)]
Pin networkx because 2.2 is the last version to support Python 2.7 and 3.4

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14873: Modifies failing tests for debugging purposes.
Lucas Di Pentima [Thu, 4 Apr 2019 13:50:44 +0000 (10:50 -0300)]
14873: Modifies failing tests for debugging purposes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoFix stale cached container state after successful Cancel.
Tom Clegg [Thu, 4 Apr 2019 13:44:07 +0000 (09:44 -0400)]
Fix stale cached container state after successful Cancel.

Avoids needless retries between a successful Cancel and the next sync.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '14796-dispatchcloud-install-docs'
Tom Clegg [Wed, 3 Apr 2019 21:11:25 +0000 (17:11 -0400)]
Merge branch '14796-dispatchcloud-install-docs'

refs #14796

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge remote-tracking branch 'origin/master' into 14484-collection-record-update
Eric Biagiotti [Wed, 3 Apr 2019 20:42:25 +0000 (16:42 -0400)]
Merge remote-tracking branch 'origin/master' into 14484-collection-record-update

refs #14484

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14796: Tweak example boot probe command.
Tom Clegg [Wed, 3 Apr 2019 20:24:35 +0000 (16:24 -0400)]
14796: Tweak example boot probe command.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14796: Add Amazon EC2 configuration example.
Tom Clegg [Wed, 3 Apr 2019 20:23:17 +0000 (16:23 -0400)]
14796: Add Amazon EC2 configuration example.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14484: Adds test for updating a collection with file stats and manifest changes
Eric Biagiotti [Wed, 3 Apr 2019 20:20:26 +0000 (16:20 -0400)]
14484: Adds test for updating a collection with file stats and manifest changes

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14484: Improves test coverage and attribute setting performance
Eric Biagiotti [Wed, 3 Apr 2019 20:01:26 +0000 (16:01 -0400)]
14484: Improves test coverage and attribute setting performance

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14796: Add arvados-dispatch-cloud (experimental) to install docs.
Tom Clegg [Wed, 3 Apr 2019 15:39:47 +0000 (11:39 -0400)]
14796: Add arvados-dispatch-cloud (experimental) to install docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14873: Adds JSONB columns to discovery doc.
Lucas Di Pentima [Wed, 3 Apr 2019 00:45:30 +0000 (21:45 -0300)]
14873: Adds JSONB columns to discovery doc.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Removes byebug debug call on test.
Lucas Di Pentima [Tue, 2 Apr 2019 23:26:17 +0000 (20:26 -0300)]
14873: Removes byebug debug call on test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Fixes JSON custom types.
Lucas Di Pentima [Tue, 2 Apr 2019 22:13:25 +0000 (19:13 -0300)]
14873: Fixes JSON custom types.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Custom JSON attributes that default to [] or {} when nil.
Lucas Di Pentima [Tue, 2 Apr 2019 21:36:08 +0000 (18:36 -0300)]
14873: Custom JSON attributes that default to [] or {} when nil.

Previously we used the 'serialize' call to declare a JSONB column as a Hash
or Array and this had the side effect to default to an empty hash or array
when assigning nil (whether was reading from the database or passed as a param).
JSONB columns shouldn't be now declared as serialized because Rails would serialize
their contents twice, but not declaring them makes us lose their side effect.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Fixes nested params behavior on controller tests.
Lucas Di Pentima [Tue, 2 Apr 2019 21:30:11 +0000 (18:30 -0300)]
14873: Fixes nested params behavior on controller tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14873: Updates test for fix deprecation warning.
Lucas Di Pentima [Tue, 2 Apr 2019 18:37:07 +0000 (15:37 -0300)]
14873: Updates test for fix deprecation warning.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoGive up if test services don't come up.
Tom Clegg [Tue, 2 Apr 2019 18:18:17 +0000 (14:18 -0400)]
Give up if test services don't come up.

refs #15044

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoRemove dependency on jq.
Tom Clegg [Tue, 2 Apr 2019 18:11:55 +0000 (14:11 -0400)]
Remove dependency on jq.

refs #15044

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '15044-test-fixes'
Tom Clegg [Tue, 2 Apr 2019 17:28:10 +0000 (13:28 -0400)]
Merge branch '15044-test-fixes'

closes #15044

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15044: Sanity-check test services when bringing them up.
Tom Clegg [Tue, 2 Apr 2019 17:24:45 +0000 (13:24 -0400)]
15044: Sanity-check test services when bringing them up.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14873: Reverts previous fixture changes.
Lucas Di Pentima [Tue, 2 Apr 2019 16:23:44 +0000 (13:23 -0300)]
14873: Reverts previous fixture changes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14484: Update collection model to overwrite file stats if a change is attempted
Eric Biagiotti [Tue, 2 Apr 2019 15:49:29 +0000 (11:49 -0400)]
14484: Update collection model to overwrite file stats if a change is attempted

Also updates tests and documentation

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago15044: Require newer mocha.
Tom Clegg [Tue, 2 Apr 2019 14:20:45 +0000 (10:20 -0400)]
15044: Require newer mocha.

Without this, old dev environments will not necessarily support the
non-deprecated usage (require 'mocha/minitest').

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch 'arvbox-cert-docs' no issue #
Peter Amstutz [Mon, 1 Apr 2019 18:58:40 +0000 (14:58 -0400)]
Merge branch 'arvbox-cert-docs' no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14844: Adds collections controller tests and updates collection model tests
Eric Biagiotti [Mon, 1 Apr 2019 18:49:42 +0000 (14:49 -0400)]
14844: Adds collections controller tests and updates collection model tests

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoUpdate arvbox docs to describe how to install root cert
Peter Amstutz [Mon, 1 Apr 2019 16:28:12 +0000 (12:28 -0400)]
Update arvbox docs to describe how to install root cert

Remove slurm from arvbox

Arvbox cluster ids now always start with 'x' to be consistent with
cluster identifier guidelines for "experimental/local-only/private clusters"

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14484: Moves the file count and total size callback to after_validation
Eric Biagiotti [Mon, 1 Apr 2019 15:37:33 +0000 (11:37 -0400)]
14484: Moves the file count and total size callback to after_validation

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoMerge branch '14758-keepproxy-panic'
Tom Clegg [Mon, 1 Apr 2019 15:16:58 +0000 (11:16 -0400)]
Merge branch '14758-keepproxy-panic'

fixes #14758

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14758: Fix panic on error reading request body.
Tom Clegg [Mon, 1 Apr 2019 14:40:43 +0000 (10:40 -0400)]
14758: Fix panic on error reading request body.

The deferred inline func panics if status != 200 && err == nil.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '15050-limit-cdl-containers' closes #15050
Peter Amstutz [Mon, 1 Apr 2019 15:08:53 +0000 (11:08 -0400)]
Merge branch '15050-limit-cdl-containers' closes #15050

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoAdd another nil check to Azure driver.
Tom Clegg [Sun, 31 Mar 2019 19:25:11 +0000 (15:25 -0400)]
Add another nil check to Azure driver.

refs #15007

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15050: After waking up, check if the container was cancelled
Peter Amstutz [Fri, 29 Mar 2019 20:27:04 +0000 (16:27 -0400)]
15050: After waking up, check if the container was cancelled

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago15044: Fix sensitivity to group existence on the testing host.
Tom Clegg [Fri, 29 Mar 2019 19:22:44 +0000 (15:22 -0400)]
15044: Fix sensitivity to group existence on the testing host.

Also fix some ruby warnings.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14484: Moves test for grouping pdhs to its own file
Eric Biagiotti [Fri, 29 Mar 2019 19:08:36 +0000 (15:08 -0400)]
14484: Moves test for grouping pdhs to its own file

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14484: Moves pdh grouping into a lib module
Eric Biagiotti [Fri, 29 Mar 2019 18:46:30 +0000 (14:46 -0400)]
14484: Moves pdh grouping into a lib module

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>