arvados.git
4 years ago15028: Bump cwltool version for bugfix.
Peter Amstutz [Fri, 7 Jun 2019 19:27:05 +0000 (15:27 -0400)]
15028: Bump cwltool version for bugfix.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15311-api-no-colons' refs #15311
Peter Amstutz [Fri, 7 Jun 2019 14:41:23 +0000 (10:41 -0400)]
Merge branch '15311-api-no-colons' refs #15311

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15311: Remove stringify-symbol behavior on database load
Peter Amstutz [Thu, 6 Jun 2019 15:36:34 +0000 (11:36 -0400)]
15311: Remove stringify-symbol behavior on database load

* Add test case demonstrating bug

* Remove convert_serialized_symbols_to_strings hook

* Add "rake symbols:check" to warn you if there are any serialized
columns that may have legacy symbols.

* Add "rake symbols:stringify" to warn you if there are any serialized
columns that may have legacy symbols.

* Add release notes for checking and stringifying symbols.

* Add table of contents to upgrading doc page.

* Add note about the has_symbol_keys_in_database_somehow fixture.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMake sdk/cli testable in interactive mode.
Ward Vandewege [Fri, 7 Jun 2019 01:26:27 +0000 (21:26 -0400)]
Make sdk/cli testable in interactive mode.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoFix the build by disabling an old crunch-job (jobs api) test that now
Ward Vandewege [Fri, 7 Jun 2019 01:16:30 +0000 (21:16 -0400)]
Fix the build by disabling an old crunch-job (jobs api) test that now
depends on the presence of a post 1.3 version of the
python-arvados-python-client package being present.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoMerge branch '15306-api-nonjson-params'
Lucas Di Pentima [Thu, 6 Jun 2019 17:37:49 +0000 (14:37 -0300)]
Merge branch '15306-api-nonjson-params'
Closes #15306

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Adds warning log message when parameter isn't boolean.
Lucas Di Pentima [Thu, 6 Jun 2019 16:55:19 +0000 (13:55 -0300)]
15306: Adds warning log message when parameter isn't boolean.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Moves include_trash param declaration to the controller.
Lucas Di Pentima [Thu, 6 Jun 2019 16:48:47 +0000 (13:48 -0300)]
15306: Moves include_trash param declaration to the controller.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Adds include_trash param definition to container requests.
Lucas Di Pentima [Thu, 6 Jun 2019 12:44:31 +0000 (09:44 -0300)]
15306: Adds include_trash param definition to container requests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoCorrect the release date for 1.4.0 in our documentation.
Ward Vandewege [Wed, 5 Jun 2019 20:59:37 +0000 (16:59 -0400)]
Correct the release date for 1.4.0 in our documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years ago15306: Fixes tests to POST form & json encoded params.
Lucas Di Pentima [Wed, 5 Jun 2019 20:52:48 +0000 (17:52 -0300)]
15306: Fixes tests to POST form & json encoded params.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Don't interpret include_trash="false" as include_trash=true.
Lucas Di Pentima [Wed, 5 Jun 2019 19:59:29 +0000 (16:59 -0300)]
15306: Don't interpret include_trash="false" as include_trash=true.

The same goes to include_old_versions params at find_objects_for_index().
If any of those params aren't declared as boolean, assume false.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMerge branch '9945-crunch-job-python-path'
Ward Vandewege [Wed, 5 Jun 2019 17:53:28 +0000 (13:53 -0400)]
Merge branch '9945-crunch-job-python-path'

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoCrunch-job needs to call the python executable from our sdk package for
Ward Vandewege [Wed, 5 Jun 2019 16:49:27 +0000 (12:49 -0400)]
Crunch-job needs to call the python executable from our sdk package for
collating job output.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years ago15306: Fixes issue on groups controller.
Lucas Di Pentima [Wed, 5 Jun 2019 13:08:10 +0000 (10:08 -0300)]
15306: Fixes issue on groups controller.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Adds similar test to groups, exposing the same issue as collections.
Lucas Di Pentima [Wed, 5 Jun 2019 13:07:44 +0000 (10:07 -0300)]
15306: Adds similar test to groups, exposing the same issue as collections.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Fixes the bug.
Lucas Di Pentima [Tue, 4 Jun 2019 23:34:21 +0000 (20:34 -0300)]
15306: Fixes the bug.

The problem was coming from 2 sides:

1) The collections#show action didn't have the required parameters definitions.
2) The load_required_parameters callback was being called after the object
   lookup callback.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Adds more test cases confirming the issue is encoding independent.
Lucas Di Pentima [Tue, 4 Jun 2019 23:32:13 +0000 (20:32 -0300)]
15306: Adds more test cases confirming the issue is encoding independent.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Removes trailing slash on test.
Lucas Di Pentima [Tue, 4 Jun 2019 19:36:19 +0000 (16:36 -0300)]
15306: Removes trailing slash on test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Adds testing on collections#show that expose the bug.
Lucas Di Pentima [Tue, 4 Jun 2019 19:30:01 +0000 (16:30 -0300)]
15306: Adds testing on collections#show that expose the bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Don't check for empty responses now that we use a filter.
Lucas Di Pentima [Tue, 4 Jun 2019 18:23:47 +0000 (15:23 -0300)]
15306: Don't check for empty responses now that we use a filter.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15306: Avoid paging in query string tests, too.
Tom Clegg [Tue, 4 Jun 2019 18:08:34 +0000 (14:08 -0400)]
15306: Avoid paging in query string tests, too.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15306: Adjust tests: check ?include_trash= and avoid paging.
Tom Clegg [Tue, 4 Jun 2019 18:02:02 +0000 (14:02 -0400)]
15306: Adjust tests: check ?include_trash= and avoid paging.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15306: Adds integration tests with query string & form encoded params.
Lucas Di Pentima [Tue, 4 Jun 2019 17:39:21 +0000 (14:39 -0300)]
15306: Adds integration tests with query string & form encoded params.

Specifically testing include_trash on collections.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMerge branch '15028-cwl-v1.1' refs #15028
Peter Amstutz [Tue, 4 Jun 2019 17:20:24 +0000 (13:20 -0400)]
Merge branch '15028-cwl-v1.1' refs #15028

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15003-duration-format'
Tom Clegg [Tue, 4 Jun 2019 13:28:04 +0000 (09:28 -0400)]
Merge branch '15003-duration-format'

refs #15003

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15028: Update to latest cwltool.
Peter Amstutz [Mon, 3 Jun 2019 21:08:19 +0000 (17:08 -0400)]
15028: Update to latest cwltool.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15286-fixes'
Ward Vandewege [Mon, 3 Jun 2019 20:51:19 +0000 (16:51 -0400)]
Merge branch '15286-fixes'

Fixes from the 1.4 branch.

refs #15286

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoDo not blow up when Rails.configuration.Users.UserProfileNotificationAddress is
Ward Vandewege [Mon, 3 Jun 2019 19:14:37 +0000 (15:14 -0400)]
Do not blow up when Rails.configuration.Users.UserProfileNotificationAddress is
set to the empty string, which is the default since #13996 (it defaulted to a
dummy e-mail adress before).

refs #15286
refs #13996

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoUpdate the 'upgrading' documentation to reflect the v1.4.0 release, and warn
Ward Vandewege [Fri, 31 May 2019 19:42:37 +0000 (15:42 -0400)]
Update the 'upgrading' documentation to reflect the v1.4.0 release, and warn
about the db migration that can take some time during upgrade.

refs #15093

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoAddress review comments.
Ward Vandewege [Fri, 31 May 2019 19:27:38 +0000 (15:27 -0400)]
Address review comments.

refs #15093

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoMove the population of the new columns on the collections table to a standalone
Ward Vandewege [Fri, 31 May 2019 18:51:50 +0000 (14:51 -0400)]
Move the population of the new columns on the collections table to a standalone
script that should be run separate from the migration. Add a note to the
upgrade documentation along those lines. Make the script not blow up on
collections with invalid manifests, but rather just skip them.

refs #15093
refs #14484

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoMerge branch '14931-custom-tags'
Tom Clegg [Mon, 3 Jun 2019 18:59:56 +0000 (14:59 -0400)]
Merge branch '14931-custom-tags'

closes #14931

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago14931: Change default tag prefix to "Arvados".
Tom Clegg [Mon, 3 Jun 2019 15:58:55 +0000 (11:58 -0400)]
14931: Change default tag prefix to "Arvados".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Format durations as "336h", not "336h0m0s".
Tom Clegg [Fri, 31 May 2019 20:15:05 +0000 (16:15 -0400)]
15003: Format durations as "336h", not "336h0m0s".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago14931: Pass custom tags to cloud driver for shared resources.
Tom Clegg [Thu, 30 May 2019 14:49:57 +0000 (10:49 -0400)]
14931: Pass custom tags to cloud driver for shared resources.

Neither driver uses them yet: the only shared resources being created
are AWS key pairs, which don't support tags.

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/Using_Tags.html

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago14931: Add configurable prefix for built-in tags.
Tom Clegg [Thu, 30 May 2019 14:13:07 +0000 (10:13 -0400)]
14931: Add configurable prefix for built-in tags.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago14931: Tag and filter instances by SetID, so driver doesn't need to.
Tom Clegg [Wed, 29 May 2019 20:01:36 +0000 (16:01 -0400)]
14931: Tag and filter instances by SetID, so driver doesn't need to.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago14931: Support extra tags on resources created by dispatchcloud.
Tom Clegg [Tue, 28 May 2019 19:39:11 +0000 (15:39 -0400)]
14931: Support extra tags on resources created by dispatchcloud.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15003-new-config-struct'
Tom Clegg [Fri, 31 May 2019 17:54:57 +0000 (13:54 -0400)]
Merge branch '15003-new-config-struct'

refs #15003

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Merge branch 'master'
Tom Clegg [Fri, 31 May 2019 17:54:10 +0000 (13:54 -0400)]
15003: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Update doc comment on Map, and use it in lib/service.
Tom Clegg [Fri, 31 May 2019 17:28:03 +0000 (13:28 -0400)]
15003: Update doc comment on Map, and use it in lib/service.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15028: Fix bashism
Peter Amstutz [Fri, 31 May 2019 16:04:18 +0000 (12:04 -0400)]
15028: Fix bashism

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15028: Move 'conformance' default to v1.0 fallback
Peter Amstutz [Fri, 31 May 2019 15:53:41 +0000 (11:53 -0400)]
15028: Move 'conformance' default to v1.0 fallback

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15028: 'conformance' changed to 'conformance-v1.0'
Peter Amstutz [Fri, 31 May 2019 15:30:48 +0000 (11:30 -0400)]
15028: 'conformance' changed to 'conformance-v1.0'

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15028: Fix test on python3. Add conformance-v1.1 to run_in_arvbox suites.
Peter Amstutz [Fri, 31 May 2019 15:28:21 +0000 (11:28 -0400)]
15028: Fix test on python3.  Add conformance-v1.1 to run_in_arvbox suites.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15028: Fix tests
Peter Amstutz [Thu, 30 May 2019 21:05:29 +0000 (17:05 -0400)]
15028: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoFix syntax for python3.
Tom Clegg [Thu, 30 May 2019 18:25:23 +0000 (14:25 -0400)]
Fix syntax for python3.

refs #14964

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoFix reporting logs on container requests refs #15028
Peter Amstutz [Tue, 23 Apr 2019 22:01:55 +0000 (18:01 -0400)]
Fix reporting logs on container requests refs #15028

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '14878-priority-race'
Tom Clegg [Tue, 28 May 2019 18:05:47 +0000 (14:05 -0400)]
Merge branch '14878-priority-race'

fixes #14878

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago14878: Add comment.
Tom Clegg [Tue, 28 May 2019 18:05:05 +0000 (14:05 -0400)]
14878: Add comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Ignore SAMPLE entries in default config file.
Tom Clegg [Tue, 28 May 2019 17:53:47 +0000 (13:53 -0400)]
15003: Ignore SAMPLE entries in default config file.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15028: Bump schema salad version. Use containers API preferentially.
Peter Amstutz [Tue, 28 May 2019 17:40:14 +0000 (13:40 -0400)]
15028: Bump schema salad version.  Use containers API preferentially.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15028: Bump cwltool to accept v1.1
Peter Amstutz [Tue, 28 May 2019 17:03:41 +0000 (13:03 -0400)]
15028: Bump cwltool to accept v1.1

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15275-attribute-dirtyness-bugfix'
Lucas Di Pentima [Tue, 28 May 2019 15:41:51 +0000 (12:41 -0300)]
Merge branch '15275-attribute-dirtyness-bugfix'
Closes #15275

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14878: Skip flock() when testing priority updater.
Tom Clegg [Tue, 28 May 2019 15:04:35 +0000 (11:04 -0400)]
14878: Skip flock() when testing priority updater.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15275: Adds test for different jsonb properties comparisons cases.
Lucas Di Pentima [Tue, 28 May 2019 14:27:43 +0000 (11:27 -0300)]
15275: Adds test for different jsonb properties comparisons cases.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15003: Dedup fixture consts.
Tom Clegg [Tue, 28 May 2019 14:04:38 +0000 (10:04 -0400)]
15003: Dedup fixture consts.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Fix import cycle.
Tom Clegg [Tue, 28 May 2019 14:02:49 +0000 (10:02 -0400)]
15003: Fix import cycle.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Port health aggregator from NodeProfiles to Services.
Tom Clegg [Tue, 28 May 2019 13:48:28 +0000 (09:48 -0400)]
15003: Port health aggregator from NodeProfiles to Services.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15275: Checks for jsonb types changes by comparing deserialized values.
Lucas Di Pentima [Fri, 24 May 2019 21:11:23 +0000 (18:11 -0300)]
15275: Checks for jsonb types changes by comparing deserialized values.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoarvbox use lowercase keys for database connection params refs #15273
Peter Amstutz [Fri, 24 May 2019 20:31:49 +0000 (16:31 -0400)]
arvbox use lowercase keys for database connection params refs #15273

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15003: Remove NodeProfiles section from integration test config.
Tom Clegg [Fri, 24 May 2019 19:15:25 +0000 (15:15 -0400)]
15003: Remove NodeProfiles section from integration test config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Remove debug printf.
Tom Clegg [Fri, 24 May 2019 19:12:20 +0000 (15:12 -0400)]
15003: Remove debug printf.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Merge branch 'master'
Tom Clegg [Fri, 24 May 2019 19:11:45 +0000 (15:11 -0400)]
15003: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Update docs to new config struct.
Tom Clegg [Fri, 24 May 2019 18:48:24 +0000 (14:48 -0400)]
15003: Update docs to new config struct.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Update dispatchcloud to new config struct.
Tom Clegg [Fri, 24 May 2019 17:55:37 +0000 (13:55 -0400)]
15003: Update dispatchcloud to new config struct.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Use lib/cmd and lib/service packages for health service.
Tom Clegg [Fri, 24 May 2019 17:34:16 +0000 (13:34 -0400)]
15003: Use lib/cmd and lib/service packages for health service.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Remove NodeProfiles section from cluster config.
Tom Clegg [Fri, 24 May 2019 17:22:12 +0000 (13:22 -0400)]
15003: Remove NodeProfiles section from cluster config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch 'master' into 15275-attribute-dirtyness-bugfix
Lucas Di Pentima [Fri, 24 May 2019 18:34:01 +0000 (15:34 -0300)]
Merge branch 'master' into 15275-attribute-dirtyness-bugfix

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15275: Re-adds the test exposing this branch's particular bug.
Lucas Di Pentima [Fri, 24 May 2019 18:33:13 +0000 (15:33 -0300)]
15275: Re-adds the test exposing this branch's particular bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMerge branch '15275-collection-delete-bugfix'. Refs #15275
Lucas Di Pentima [Fri, 24 May 2019 18:11:34 +0000 (15:11 -0300)]
Merge branch '15275-collection-delete-bugfix'. Refs #15275

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15275: Simplifies method code.
Lucas Di Pentima [Fri, 24 May 2019 18:00:40 +0000 (15:00 -0300)]
15275: Simplifies method code.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15275: Don't create snapshots whenever is_trashed is true.
Lucas Di Pentima [Fri, 24 May 2019 17:58:59 +0000 (14:58 -0300)]
15275: Don't create snapshots whenever is_trashed is true.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15275: Don't create snapshot when trashing collection.
Lucas Di Pentima [Fri, 24 May 2019 15:36:54 +0000 (12:36 -0300)]
15275: Don't create snapshot when trashing collection.

Also, skips test about bogus properties field changes, for now.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15275: Adds another test exposing the jsonb changed field bug.
Lucas Di Pentima [Fri, 24 May 2019 13:55:14 +0000 (10:55 -0300)]
15275: Adds another test exposing the jsonb changed field bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15275: Moves comment to its proper place.
Lucas Di Pentima [Fri, 24 May 2019 13:31:40 +0000 (10:31 -0300)]
15275: Moves comment to its proper place.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15275: Avoids running manage_versioning when not needed.
Lucas Di Pentima [Fri, 24 May 2019 01:22:02 +0000 (22:22 -0300)]
15275: Avoids running manage_versioning when not needed.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15275: Saves snapshot as system user instead of assigning a signed manifest to it
Lucas Di Pentima [Thu, 23 May 2019 23:07:13 +0000 (20:07 -0300)]
15275: Saves snapshot as system user instead of assigning a signed manifest to it

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15725: Adds test exposing 2 issues when trashing collections with versioning
Lucas Di Pentima [Thu, 23 May 2019 22:53:12 +0000 (19:53 -0300)]
15725: Adds test exposing 2 issues when trashing collections with versioning

1) Snapshot being created when deleting a collection
2) Permission denied error when trying to create the new snapshot

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMake sure that the libpam-arvados package puts its various files in the place
Ward Vandewege [Thu, 23 May 2019 18:45:35 +0000 (14:45 -0400)]
Make sure that the libpam-arvados package puts its various files in the place
where the pam subsystem will expect them, not inside the virtualenv.

Also, remove the code from sdk/pam/setup.py that installed a copy of the
libpam-arvados.py file under /usr/data/lib/security/libpam_arvados.py for
legacy reasons.

refs #9945
refs #15186

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoMerge branch '15273-db-conn-keys'
Tom Clegg [Thu, 23 May 2019 18:23:54 +0000 (14:23 -0400)]
Merge branch '15273-db-conn-keys'

fixes #15273

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15273: Fix key-conflict test.
Tom Clegg [Thu, 23 May 2019 18:23:26 +0000 (14:23 -0400)]
15273: Fix key-conflict test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15273: Use lowercase keys for database connection params.
Tom Clegg [Thu, 23 May 2019 17:42:37 +0000 (13:42 -0400)]
15273: Use lowercase keys for database connection params.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15003: Add dispatch-cloud configs to default/template file.
Tom Clegg [Thu, 23 May 2019 15:38:09 +0000 (11:38 -0400)]
15003: Add dispatch-cloud configs to default/template file.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15003-disable-config-warnings'
Tom Clegg [Thu, 23 May 2019 15:27:26 +0000 (11:27 -0400)]
Merge branch '15003-disable-config-warnings'

refs #15003

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15258-wb-report-issue-bugfix'
Lucas Di Pentima [Thu, 23 May 2019 14:03:13 +0000 (11:03 -0300)]
Merge branch '15258-wb-report-issue-bugfix'
Closes #15258

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15003: Temporarily disable config warnings.
Tom Clegg [Thu, 23 May 2019 13:31:40 +0000 (09:31 -0400)]
15003: Temporarily disable config warnings.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15258: Explicitly require libs instead of relying on autoloading.
Lucas Di Pentima [Thu, 23 May 2019 13:14:21 +0000 (10:14 -0300)]
15258: Explicitly require libs instead of relying on autoloading.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15258: Removes /lib from eager load paths because of failing integration tests.
Lucas Di Pentima [Thu, 23 May 2019 12:52:10 +0000 (09:52 -0300)]
15258: Removes /lib from eager load paths because of failing integration tests.

PhantomJS started to randomly fail, maybe because of memory or timing reasons.
This change exposes the bug observed on production, on development & test envs.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15003: Fix warnings about site-specific keys.
Tom Clegg [Thu, 23 May 2019 04:24:14 +0000 (00:24 -0400)]
15003: Fix warnings about site-specific keys.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoIncrease client_max_body_size in arvbox to support file uploads.
Peter Amstutz [Wed, 22 May 2019 21:31:48 +0000 (17:31 -0400)]
Increase client_max_body_size in arvbox to support file uploads.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15258: Adds /lib to the eager_load paths.
Lucas Di Pentima [Wed, 22 May 2019 19:57:19 +0000 (16:57 -0300)]
15258: Adds /lib to the eager_load paths.

On rails 5.0 the autoload paths stopped working on production environments
for thread safety concerns.
See: https://github.com/rails/rails/commit/a71350cae0082193ad8c66d65ab62e8bb0b7853b

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoWhile our Python SDK now supports Python 3.4+, our FUSE driver does not yet. On
Ward Vandewege [Tue, 21 May 2019 17:27:41 +0000 (13:27 -0400)]
While our Python SDK now supports Python 3.4+, our FUSE driver does not yet. On
the FUSE driver installation page, we should be mentioning the latter, not the
former.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoOur Python SDK now also supports version 3.4+, update the fuse drive doc page
Ward Vandewege [Tue, 21 May 2019 14:36:24 +0000 (10:36 -0400)]
Our Python SDK now also supports version 3.4+, update the fuse drive doc page
accordingly.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoFix cwl tests refs #15241
Peter Amstutz [Mon, 20 May 2019 20:42:11 +0000 (16:42 -0400)]
Fix cwl tests refs #15241

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15241-collection-input' refs #15241
Peter Amstutz [Mon, 20 May 2019 19:48:27 +0000 (15:48 -0400)]
Merge branch '15241-collection-input' refs #15241

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15241: Fix input bare collection as directory
Peter Amstutz [Mon, 20 May 2019 19:46:17 +0000 (15:46 -0400)]
15241: Fix input bare collection as directory

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '14988-wb-rails5-upgrade'
Lucas Di Pentima [Fri, 17 May 2019 17:31:29 +0000 (14:31 -0300)]
Merge branch '14988-wb-rails5-upgrade'
Closes #14988

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMerge branch '15227-apiserver-properties-bugfix'
Lucas Di Pentima [Fri, 17 May 2019 17:30:33 +0000 (14:30 -0300)]
Merge branch '15227-apiserver-properties-bugfix'
Closes #15227

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>