arvados.git
8 years ago9617: Reorganized code reusing the invalid_constraint list on both create & update...
Lucas Di Pentima [Tue, 2 Aug 2016 14:50:05 +0000 (11:50 -0300)]
9617: Reorganized code reusing the invalid_constraint list on both create & update tests. Separated the successful test case to be on its own.

8 years ago9617: Added one more invalid constraint case to the tests, also check for container_u...
Lucas Di Pentima [Tue, 2 Aug 2016 13:28:57 +0000 (10:28 -0300)]
9617: Added one more invalid constraint case to the tests, also check for container_uuid on successful test

8 years ago9617: Corrected style following suggestions and also compacted the code to avoid...
Lucas Di Pentima [Mon, 1 Aug 2016 21:30:16 +0000 (18:30 -0300)]
9617: Corrected style following suggestions and also compacted the code to avoid repetition.

8 years ago9617: Added validations on updates & tests on sucessful cases.
Lucas Di Pentima [Mon, 1 Aug 2016 19:44:16 +0000 (16:44 -0300)]
9617: Added validations on updates & tests on sucessful cases.

8 years ago9617, 9618: Added validations and wrote the corresponding test. Also, corrected some...
Lucas Di Pentima [Fri, 29 Jul 2016 21:07:15 +0000 (18:07 -0300)]
9617, 9618: Added validations and wrote the corresponding test. Also, corrected some other tests to conform this new requirement.

8 years agorefs #9552
radhika [Thu, 28 Jul 2016 18:27:27 +0000 (14:27 -0400)]
refs #9552
Merge branch '9552-compute-checksum-flag'

8 years ago9552: add compute-checksum flag to arvados-cwl-runner
radhika [Thu, 28 Jul 2016 17:36:26 +0000 (13:36 -0400)]
9552: add compute-checksum flag to arvados-cwl-runner

8 years agoWe have a new build job at ci.curoverse.com. Update the build status
Ward Vandewege [Thu, 28 Jul 2016 00:23:06 +0000 (20:23 -0400)]
We have a new build job at ci.curoverse.com. Update the build status
icon in README.md accordingly.

No issue #

8 years agocloses #9581
radhika [Wed, 27 Jul 2016 21:15:00 +0000 (17:15 -0400)]
closes #9581
Merge branch '9581-slurm-dispatcher-config'

8 years ago9581: add json config file handling to slurm dispatcher.
radhika [Tue, 26 Jul 2016 16:28:27 +0000 (12:28 -0400)]
9581: add json config file handling to slurm dispatcher.

8 years agoMerge branch '8555-s3-trash'
Tom Clegg [Wed, 27 Jul 2016 19:22:26 +0000 (15:22 -0400)]
Merge branch '8555-s3-trash'

closes #8555

8 years ago8555: Fail Go tests if not gofmted.
Tom Clegg [Wed, 27 Jul 2016 15:29:17 +0000 (11:29 -0400)]
8555: Fail Go tests if not gofmted.

8 years ago8555: golint
Tom Clegg [Tue, 26 Jul 2016 20:29:57 +0000 (16:29 -0400)]
8555: golint

8 years ago8555: Fix up comments.
Tom Clegg [Tue, 26 Jul 2016 20:26:15 +0000 (16:26 -0400)]
8555: Fix up comments.

8 years ago8555: gofmt
Tom Clegg [Tue, 26 Jul 2016 20:20:30 +0000 (16:20 -0400)]
8555: gofmt

8 years ago8555: Test Get() after successful Untrash. Test Put+Mtime in all scenarios.
Tom Clegg [Tue, 26 Jul 2016 16:25:35 +0000 (12:25 -0400)]
8555: Test Get() after successful Untrash. Test Put+Mtime in all scenarios.

8 years ago8555: Untrash to repair inconsistent state (trash/X without recentX).
Tom Clegg [Tue, 26 Jul 2016 15:07:46 +0000 (11:07 -0400)]
8555: Untrash to repair inconsistent state (trash/X without recentX).

8 years ago8555: Log statistics in EmptyTrash.
Tom Clegg [Tue, 26 Jul 2016 13:44:56 +0000 (09:44 -0400)]
8555: Log statistics in EmptyTrash.

8 years ago8555: Improve variable names and comments.
Tom Clegg [Tue, 26 Jul 2016 13:38:07 +0000 (09:38 -0400)]
8555: Improve variable names and comments.

8 years ago8555: Reformat test cases.
Tom Clegg [Tue, 26 Jul 2016 13:19:30 +0000 (09:19 -0400)]
8555: Reformat test cases.

8 years ago8555: De-obfuscate test case.
Tom Clegg [Fri, 22 Jul 2016 18:04:34 +0000 (14:04 -0400)]
8555: De-obfuscate test case.

8 years ago8555: Fix EmptyTrash so it can clean up old races.
Tom Clegg [Thu, 21 Jul 2016 15:44:17 +0000 (11:44 -0400)]
8555: Fix EmptyTrash so it can clean up old races.

8 years ago8555: golint
Tom Clegg [Wed, 20 Jul 2016 15:56:59 +0000 (11:56 -0400)]
8555: golint

8 years ago8555: gofmt
Tom Clegg [Wed, 20 Jul 2016 15:42:14 +0000 (11:42 -0400)]
8555: gofmt

8 years ago8555: Test various backend states. Update recent/X timestamp during Untrash.
Tom Clegg [Wed, 20 Jul 2016 15:40:41 +0000 (11:40 -0400)]
8555: Test various backend states. Update recent/X timestamp during Untrash.

8 years ago8555: Move checkRaceWindow out to a func, tweak comments
Tom Clegg [Mon, 18 Jul 2016 19:47:23 +0000 (15:47 -0400)]
8555: Move checkRaceWindow out to a func, tweak comments

8 years ago8555: Add log messages for time-parsing errors.
Tom Clegg [Thu, 14 Jul 2016 20:08:16 +0000 (16:08 -0400)]
8555: Add log messages for time-parsing errors.

8 years ago8555: Implement trash with race-recovery for S3 volumes.
Tom Clegg [Thu, 14 Jul 2016 19:53:20 +0000 (15:53 -0400)]
8555: Implement trash with race-recovery for S3 volumes.

See https://dev.arvados.org/projects/arvados/wiki/S3_bucket_volume_implementation

8 years agocloses #8568
radhika [Wed, 27 Jul 2016 17:26:39 +0000 (13:26 -0400)]
closes #8568
Merge branch '8568-docker-version-support'

8 years agoMerge branch 'master' into 8568-docker-version-support
radhika [Wed, 27 Jul 2016 17:26:06 +0000 (13:26 -0400)]
Merge branch 'master' into 8568-docker-version-support

8 years agocloses #9552
radhika [Wed, 27 Jul 2016 16:13:15 +0000 (12:13 -0400)]
closes #9552
Merge branch '9552-compute-checksum-flag'

8 years agoMerge branch 'master' into 9552-compute-checksum-flag
radhika [Wed, 27 Jul 2016 16:07:35 +0000 (12:07 -0400)]
Merge branch 'master' into 9552-compute-checksum-flag

Conflicts:
sdk/cwl/setup.py

8 years ago9659: Bump CWL SDK's versioned dependency on PySDK.
Brett Smith [Tue, 26 Jul 2016 20:54:39 +0000 (16:54 -0400)]
9659: Bump CWL SDK's versioned dependency on PySDK.

The CWL SDK depends on the change made to arv-run in
27816b602e9da83a2565e6fe8f87f250555b1ba5.  Update the version
dependency in setup.py to reflect this.  Refs #9570, #9659.

8 years ago8568: Enhance image_hash parsing when using Docker 1.10+
radhika [Tue, 26 Jul 2016 20:23:14 +0000 (16:23 -0400)]
8568: Enhance image_hash parsing when using Docker 1.10+

8 years ago9552: update cwltool version, which offer compute_checksum flag.
radhika [Tue, 26 Jul 2016 18:47:32 +0000 (14:47 -0400)]
9552: update cwltool version, which offer compute_checksum flag.

8 years agoMerge branch '9551-python-keep-services-env'
Lucas Di Pentima [Tue, 26 Jul 2016 14:28:38 +0000 (11:28 -0300)]
Merge branch '9551-python-keep-services-env'

9551: Python SDK support for ARVADOS_KEEP_SERVICES environment variable. Closes #9551

8 years ago9551: Replaced ARVADOS_KEEP_PROXY with ARVADOS_KEEP_SERVICES new var on tests. Added...
Lucas Di Pentima [Tue, 26 Jul 2016 14:03:57 +0000 (11:03 -0300)]
9551: Replaced ARVADOS_KEEP_PROXY with ARVADOS_KEEP_SERVICES new var on tests. Added proxy URI validation test.

8 years ago9551: Proxy URLs validation. Iteration optimization builind _keep_services list
Lucas Di Pentima [Tue, 26 Jul 2016 13:34:12 +0000 (10:34 -0300)]
9551: Proxy URLs validation. Iteration optimization builind _keep_services list

8 years agoMerge branch '9550-keep-services-env'
Tom Clegg [Tue, 26 Jul 2016 12:59:48 +0000 (08:59 -0400)]
Merge branch '9550-keep-services-env'

closes #9550

8 years ago9550: Ignore extra spaces in ARVADOS_KEEP_SERVICES, and ensure each entry is an absol...
Tom Clegg [Mon, 25 Jul 2016 20:41:25 +0000 (16:41 -0400)]
9550: Ignore extra spaces in ARVADOS_KEEP_SERVICES, and ensure each entry is an absolute URI.

8 years ago9550: Update comments.
Tom Clegg [Mon, 25 Jul 2016 19:54:41 +0000 (15:54 -0400)]
9550: Update comments.

8 years ago9550: Add service discovery override field to new SDK.
Tom Clegg [Fri, 22 Jul 2016 13:59:32 +0000 (09:59 -0400)]
9550: Add service discovery override field to new SDK.

8 years ago9550: Allow overriding keep services discovery with ARVADOS_KEEP_SERVICES env var.
Tom Clegg [Fri, 22 Jul 2016 13:41:47 +0000 (09:41 -0400)]
9550: Allow overriding keep services discovery with ARVADOS_KEEP_SERVICES env var.

8 years ago9551: Change proxy parameter priority over environment variables. Updated docstring...
Lucas Di Pentima [Tue, 26 Jul 2016 12:39:17 +0000 (09:39 -0300)]
9551: Change proxy parameter priority over environment variables. Updated docstring to mention ARVADOS_KEEP_SERVICES.

8 years ago9551: Added support for env var ARVADOS_KEEP_SERVICES as a special case of a proxy.
Lucas Di Pentima [Mon, 25 Jul 2016 20:32:46 +0000 (17:32 -0300)]
9551: Added support for env var ARVADOS_KEEP_SERVICES as a special case of a proxy.

8 years agoMerge branch '9613-test-profile-save'
Tom Clegg [Thu, 21 Jul 2016 23:35:56 +0000 (19:35 -0400)]
Merge branch '9613-test-profile-save'

closes #9613

8 years ago9613: Touch up "find required field" loop.
Tom Clegg [Thu, 21 Jul 2016 23:34:43 +0000 (19:34 -0400)]
9613: Touch up "find required field" loop.

8 years ago9613: Ensure submitted values are saved, and displayed on the edit form after it...
Tom Clegg [Thu, 21 Jul 2016 19:50:00 +0000 (15:50 -0400)]
9613: Ensure submitted values are saved, and displayed on the edit form after it reloads.

8 years ago9613: Dry up user profile tests.
Tom Clegg [Thu, 21 Jul 2016 19:25:28 +0000 (15:25 -0400)]
9613: Dry up user profile tests.

8 years agoMerge branch '9639-split-workbench-tests'
Ward Vandewege [Thu, 21 Jul 2016 19:43:07 +0000 (15:43 -0400)]
Merge branch '9639-split-workbench-tests'

refs #9639

8 years ago9639: Make it possible to run unit, functional and integration tests for
Ward Vandewege [Thu, 21 Jul 2016 19:02:21 +0000 (15:02 -0400)]
9639: Make it possible to run unit, functional and integration tests for
Workbench separately.

refs #9639

8 years ago9639: Relax unnecessarily strict time limit.
Tom Clegg [Thu, 21 Jul 2016 02:35:01 +0000 (22:35 -0400)]
9639: Relax unnecessarily strict time limit.

refs #9639

8 years ago9639: Delete all cached discovery docs, but do not delete the cache directory.
Tom Clegg [Wed, 20 Jul 2016 21:14:47 +0000 (17:14 -0400)]
9639: Delete all cached discovery docs, but do not delete the cache directory.

refs #9639

8 years ago9639: Avoid sharing rvm gemsets between concurrent builds.
Tom Clegg [Wed, 20 Jul 2016 20:03:18 +0000 (16:03 -0400)]
9639: Avoid sharing rvm gemsets between concurrent builds.

refs #9639

8 years agocloses #9319
radhika [Tue, 19 Jul 2016 20:03:23 +0000 (16:03 -0400)]
closes #9319
Merge branch '9319-all-processes-index'

8 years ago9319: /all_processes index page.
radhika [Tue, 5 Jul 2016 23:13:13 +0000 (19:13 -0400)]
9319: /all_processes index page.

8 years ago9624: Fix format string.
Tom Clegg [Tue, 19 Jul 2016 19:11:43 +0000 (15:11 -0400)]
9624: Fix format string.

closes #9624

8 years agoMerge branch '9613-user-profile-string-keys'
Tom Clegg [Tue, 19 Jul 2016 13:30:27 +0000 (09:30 -0400)]
Merge branch '9613-user-profile-string-keys'

refs #9613

8 years ago9262: Stop setting sbatch --priority in crunch-dispatch-slurm.
Brett Smith [Tue, 19 Jul 2016 13:07:02 +0000 (09:07 -0400)]
9262: Stop setting sbatch --priority in crunch-dispatch-slurm.

There are a few reasons we want to back this out:

* `--priority` is a relatively new feature of SLURM, added in 14.03,
  and it's not clear how many users are running that.
* Setting `--priority` requires extra privileges, per the sbatch man
  page, and it's not clear crunch-dispatch-slurm should run with
  those.
* There are multiple ways to set the "priority" of a SLURM job.
  There's also a niceness value.  Which is correct to use is probably
  ultimately going to depend on site rules or conventions.  We need to
  get more feedback on what people are doing before we implement
  something.  We might need configurations options along the lines of
  "translate container priority into this option with this scaling
  factor," or something like that.

Per discussion with Tom Clegg.  Closes #9626.

8 years agoMerge branch '9438-http-default-timeout'
Lucas Di Pentima [Mon, 18 Jul 2016 21:25:42 +0000 (18:25 -0300)]
Merge branch '9438-http-default-timeout'

9438: Added a new var DefaultSecureClient and assigned a 5 minute timeout to both InsecureHTTPClient and DefaultSecureClient.

refs #9438

8 years ago9438: Eliminated redundant casting
Lucas Di Pentima [Mon, 18 Jul 2016 20:47:38 +0000 (17:47 -0300)]
9438: Eliminated redundant casting

8 years ago9613: Stop prepending ":" to profile keys.
Tom Clegg [Mon, 18 Jul 2016 03:24:11 +0000 (23:24 -0400)]
9613: Stop prepending ":" to profile keys.

8 years agoMerge branch '9614-cwl-no-websockets'
Nico Cesar [Sun, 17 Jul 2016 13:37:09 +0000 (09:37 -0400)]
Merge branch '9614-cwl-no-websockets'

closes #9614

8 years ago9614: Don't use websockets for event notification until it is more reliable.
Peter Amstutz [Sat, 16 Jul 2016 20:21:58 +0000 (16:21 -0400)]
9614: Don't use websockets for event notification until it is more reliable.

8 years agoPin the html5lib package we build for centos6 and centos7 to version
Ward Vandewege [Fri, 15 Jul 2016 21:09:38 +0000 (17:09 -0400)]
Pin the html5lib package we build for centos6 and centos7 to version
0.9999999, because newer versions have a dependency on a
python-setuptools 0.18.5 which we don't have in the build containers
(yet).

refs #9459

8 years agoMerge branch '9459-arvbox-demo-version-arg-wip'
Brett Smith [Fri, 15 Jul 2016 20:14:56 +0000 (16:14 -0400)]
Merge branch '9459-arvbox-demo-version-arg-wip'

Refs #9459.  Closes #9531.

8 years ago9459: arvbox-demo accepts version arguments for Git checkouts.
Brett Smith [Thu, 30 Jun 2016 21:45:12 +0000 (17:45 -0400)]
9459: arvbox-demo accepts version arguments for Git checkouts.

8 years ago9438: Added a new var DefaultSecureClient and assigned a 5 minute timeout to both...
Lucas Di Pentima [Fri, 15 Jul 2016 19:46:09 +0000 (16:46 -0300)]
9438: Added a new var DefaultSecureClient and assigned a 5 minute timeout to both InsecureHTTPClient and DefaultSecureClient

8 years agoBump version of setuptools used by run_tests.sh for cwl-runner dependency refs #9570
Peter Amstutz [Fri, 15 Jul 2016 19:16:17 +0000 (15:16 -0400)]
Bump version of setuptools used by run_tests.sh for cwl-runner dependency refs #9570

8 years agoMerge branch '9369-arv-cwl-docs' closes #9369
Peter Amstutz [Fri, 15 Jul 2016 18:30:50 +0000 (14:30 -0400)]
Merge branch '9369-arv-cwl-docs' closes #9369

8 years ago9369: Copyedit CLI SDK install guide.
Brett Smith [Fri, 15 Jul 2016 18:26:45 +0000 (14:26 -0400)]
9369: Copyedit CLI SDK install guide.

8 years ago9369: Remove cwl install from Python SDK page. Remove "sudo -i" from
Peter Amstutz [Fri, 15 Jul 2016 18:11:37 +0000 (14:11 -0400)]
9369: Remove cwl install from Python SDK page.  Remove "sudo -i" from
pip/python install instructions.  Fixup use of ~$ prompt in example
instructions.

8 years agoMerge branch 'master' into 9369-arv-cwl-docs
Peter Amstutz [Fri, 15 Jul 2016 17:11:49 +0000 (13:11 -0400)]
Merge branch 'master' into 9369-arv-cwl-docs

8 years agoMerge branch '9570-cwl-runner-fixes' closes #9570 (again)
Peter Amstutz [Fri, 15 Jul 2016 17:11:07 +0000 (13:11 -0400)]
Merge branch '9570-cwl-runner-fixes' closes #9570 (again)

8 years ago9369: Copyedits throughout the CWL documentation.
Brett Smith [Fri, 15 Jul 2016 15:03:56 +0000 (11:03 -0400)]
9369: Copyedits throughout the CWL documentation.

8 years ago9369: Add note about Javascript eval timeout.
Peter Amstutz [Fri, 15 Jul 2016 14:00:22 +0000 (10:00 -0400)]
9369: Add note about Javascript eval timeout.

8 years ago9570: Raise exception on workflow failure.
Peter Amstutz [Fri, 15 Jul 2016 13:52:02 +0000 (09:52 -0400)]
9570: Raise exception on workflow failure.

8 years ago9369: bwa-mem-input-local hashbang uses cwltool.
Peter Amstutz [Fri, 15 Jul 2016 13:41:29 +0000 (09:41 -0400)]
9369: bwa-mem-input-local hashbang uses cwltool.

8 years ago9570: Use special path mapper for staging files to output dir.
Peter Amstutz [Thu, 14 Jul 2016 20:57:27 +0000 (16:57 -0400)]
9570: Use special path mapper for staging files to output dir.

8 years ago9570: Call normalizeFilesDirs to make sure basename is there.
Peter Amstutz [Thu, 14 Jul 2016 20:40:24 +0000 (16:40 -0400)]
9570: Call normalizeFilesDirs to make sure basename is there.

8 years ago9570: Just add keep: to input keep locators in cwl-runner.
Peter Amstutz [Thu, 14 Jul 2016 20:34:19 +0000 (16:34 -0400)]
9570: Just add keep: to input keep locators in cwl-runner.

8 years ago9570: Adjust Directory objects, too.
Peter Amstutz [Thu, 14 Jul 2016 19:40:05 +0000 (15:40 -0400)]
9570: Adjust Directory objects, too.

8 years ago9570: Remove spurious print statement.
Peter Amstutz [Thu, 14 Jul 2016 19:01:39 +0000 (15:01 -0400)]
9570: Remove spurious print statement.

8 years ago9570: Bump cwltool dependency
Peter Amstutz [Thu, 14 Jul 2016 18:54:18 +0000 (14:54 -0400)]
9570: Bump cwltool dependency

8 years ago9570: Update cwl-runner for latest cwltool. Ensure use_container,
Peter Amstutz [Thu, 14 Jul 2016 17:57:09 +0000 (13:57 -0400)]
9570: Update cwl-runner for latest cwltool.  Ensure use_container,
tmpdir_prefix and on_error are set.

8 years agoMerge branch 'fix-python-sdk-mac' of https://github.com/adambom/arvados
Tom Clegg [Thu, 14 Jul 2016 20:47:38 +0000 (16:47 -0400)]
Merge branch 'fix-python-sdk-mac' of https://github.com/adambom/arvados

No issue #

8 years agoMonkey patch socket constants on apple only
Adam Savitzky [Thu, 14 Jul 2016 20:38:38 +0000 (13:38 -0700)]
Monkey patch socket constants on apple only

8 years agoRemove spurious print introduced in 6884eed, refs #9570
Peter Amstutz [Thu, 14 Jul 2016 19:21:30 +0000 (15:21 -0400)]
Remove spurious print introduced in 6884eed, refs #9570

8 years ago9369: Add section about Docker. Change cluster references to qr1hi. Fix path to...
Peter Amstutz [Thu, 14 Jul 2016 17:34:25 +0000 (13:34 -0400)]
9369: Add section about Docker.  Change cluster references to qr1hi.  Fix path to use /home/example.

8 years ago9369: Update CLI install documentation to include arvados-cwl-runner (& arvados-pytho...
Peter Amstutz [Thu, 14 Jul 2016 17:32:02 +0000 (13:32 -0400)]
9369: Update CLI install documentation to include arvados-cwl-runner (& arvados-python-client)

8 years agoPatch socket configuration for Apple systems
Adam Savitzky [Wed, 13 Jul 2016 22:54:54 +0000 (15:54 -0700)]
Patch socket configuration for Apple systems

8 years ago9369: Update tutorial to CWL v1.0
Peter Amstutz [Wed, 13 Jul 2016 21:32:32 +0000 (17:32 -0400)]
9369: Update tutorial to CWL v1.0

8 years agoMerge branch '9459-test_with_arvbox_tweaks'
Nico Cesar [Wed, 13 Jul 2016 21:18:52 +0000 (17:18 -0400)]
Merge branch '9459-test_with_arvbox_tweaks'

refs #9459

8 years ago9459: added test_in_arvbox.sh and arvbox the docker tag parameter.
Nico Cesar [Tue, 12 Jul 2016 19:32:25 +0000 (15:32 -0400)]
9459: added test_in_arvbox.sh and arvbox the docker tag parameter.

refs #9459

8 years agoMerge branch '9567-keep-web-session-test'
Tom Clegg [Wed, 13 Jul 2016 19:17:18 +0000 (15:17 -0400)]
Merge branch '9567-keep-web-session-test'

refs #9567

8 years ago9567: Use longer timeouts for keep-web download tests.
Tom Clegg [Wed, 13 Jul 2016 19:14:14 +0000 (15:14 -0400)]
9567: Use longer timeouts for keep-web download tests.

8 years ago9567: Print log messages from keep et al. as they appear, even in jenkins where stdou...
Tom Clegg [Wed, 13 Jul 2016 19:05:38 +0000 (15:05 -0400)]
9567: Print log messages from keep et al. as they appear, even in jenkins where stdout is not a tty.

8 years agoFix tests. refs #9570
Peter Amstutz [Wed, 13 Jul 2016 18:45:39 +0000 (14:45 -0400)]
Fix tests. refs #9570

8 years agoMerge branch '9486-retry-instance-limit-exceeded' closes #9486
Peter Amstutz [Wed, 13 Jul 2016 16:51:21 +0000 (12:51 -0400)]
Merge branch '9486-retry-instance-limit-exceeded' closes #9486

8 years agoMerge branch '9570-cwl-v1.0' closes #9570
Peter Amstutz [Wed, 13 Jul 2016 16:49:57 +0000 (12:49 -0400)]
Merge branch '9570-cwl-v1.0' closes #9570