arvados.git
7 years ago10344: Move to tools 10344-import-workflow-from-git
Peter Amstutz [Fri, 28 Oct 2016 15:41:45 +0000 (11:41 -0400)]
10344: Move to tools

7 years ago10344: Script to setup workflow import post-commit and post-update hooks.
Peter Amstutz [Fri, 28 Oct 2016 15:35:29 +0000 (11:35 -0400)]
10344: Script to setup workflow import post-commit and post-update hooks.

7 years ago10344: Use logger
Peter Amstutz [Thu, 27 Oct 2016 15:04:47 +0000 (11:04 -0400)]
10344: Use logger

7 years ago10344: Tweak Docker naming and some error reporting.
Peter Amstutz [Thu, 27 Oct 2016 14:42:51 +0000 (10:42 -0400)]
10344: Tweak Docker naming and some error reporting.

7 years ago10344: Add links so workflows are updated instead of recreated each time.
Peter Amstutz [Thu, 27 Oct 2016 13:59:31 +0000 (09:59 -0400)]
10344: Add links so workflows are updated instead of recreated each time.

7 years agoWorkflow import script handles Dockerfile and CWLFile from git repo.
Peter Amstutz [Thu, 27 Oct 2016 02:51:54 +0000 (22:51 -0400)]
Workflow import script handles Dockerfile and CWLFile from git repo.

7 years agoMerge branch '10008-check-token-exp-on-open' refs #10008
Tom Clegg [Wed, 26 Oct 2016 15:40:42 +0000 (11:40 -0400)]
Merge branch '10008-check-token-exp-on-open' refs #10008

7 years ago10008: Comment to explain known deficiencies.
Tom Clegg [Wed, 26 Oct 2016 15:13:10 +0000 (11:13 -0400)]
10008: Comment to explain known deficiencies.

7 years agocloses #10079
radhika [Tue, 25 Oct 2016 22:25:58 +0000 (18:25 -0400)]
closes #10079
Merge branch '10079-pipeline-display-perf'

7 years ago10079: show spinner when a child component details are being displayed using ajax.
radhika [Tue, 25 Oct 2016 16:35:55 +0000 (12:35 -0400)]
10079: show spinner when a child component details are being displayed using ajax.

7 years ago10079: add "parent" to work_unit to aid the child display
radhika [Sun, 23 Oct 2016 01:47:51 +0000 (21:47 -0400)]
10079: add "parent" to work_unit to aid the child display

7 years ago10079: fixed route so that @object is available
radhika [Fri, 21 Oct 2016 21:19:53 +0000 (17:19 -0400)]
10079: fixed route so that @object is available

7 years ago10079: checking log_link on children needs to be an integration test.
radhika [Wed, 19 Oct 2016 21:17:56 +0000 (17:17 -0400)]
10079: checking log_link on children needs to be an integration test.

7 years ago10079: show_child_component method needs anonymous access
radhika [Wed, 19 Oct 2016 20:19:23 +0000 (16:19 -0400)]
10079: show_child_component method needs anonymous access

7 years ago10079: ajax to display child component details; not working yet.
radhika [Tue, 18 Oct 2016 04:24:13 +0000 (00:24 -0400)]
10079: ajax to display child component details; not working yet.

7 years ago10079: Move Log and Output links into child details. This will make it possible
radhika [Thu, 13 Oct 2016 21:21:04 +0000 (17:21 -0400)]
10079: Move Log and Output links into child details. This will make it possible
to not need tt preload the jobs and outputs during the pipeline display. Instead,
they can be fetched when the child panel is expanded by the user.

7 years ago10291: Update --help message. refs #10291
Tom Clegg [Tue, 25 Oct 2016 19:05:10 +0000 (15:05 -0400)]
10291: Update --help message. refs #10291

7 years agoMerge branch '10172-crunch2-container-output' closes #10172
Peter Amstutz [Tue, 25 Oct 2016 17:00:23 +0000 (13:00 -0400)]
Merge branch '10172-crunch2-container-output' closes #10172

7 years ago10008: Comment to explain ancestor update.
Tom Clegg [Tue, 25 Oct 2016 15:39:17 +0000 (11:39 -0400)]
10008: Comment to explain ancestor update.

7 years ago10172: Add container.output check to TestFullRunWithAPI.
Peter Amstutz [Tue, 25 Oct 2016 15:08:43 +0000 (11:08 -0400)]
10172: Add container.output check to TestFullRunWithAPI.

7 years ago10172: Add skip_before_filter :find_object_by_uuid for current. Typo fixes.
Peter Amstutz [Tue, 25 Oct 2016 14:51:14 +0000 (10:51 -0400)]
10172: Add skip_before_filter :find_object_by_uuid for current.  Typo fixes.

7 years agoMerge branch '10194-jobs-image-versioning' refs #10194
Peter Amstutz [Tue, 25 Oct 2016 01:33:40 +0000 (21:33 -0400)]
Merge branch '10194-jobs-image-versioning' refs #10194

7 years ago10194: Improve versioning of arvados/jobs image.
Peter Amstutz [Fri, 21 Oct 2016 20:35:09 +0000 (16:35 -0400)]
10194: Improve versioning of arvados/jobs image.

arvados-cwl-runner sets version to max(cwl-runner, python-sdk).

build/run-build-docker-jobs-image.sh determines package versions corresponding
to current commit and supplies explicit package versions as Docker build arg.

7 years agoMerge branch '10232-non-exclusive-keys' refs #10232
Tom Clegg [Fri, 21 Oct 2016 20:08:45 +0000 (16:08 -0400)]
Merge branch '10232-non-exclusive-keys' refs #10232

7 years ago10008: Move test setup from __init__() to setUp()
Tom Clegg [Fri, 21 Oct 2016 19:27:34 +0000 (15:27 -0400)]
10008: Move test setup from __init__() to setUp()

7 years ago10008: Merge branch 'master' into 10008-flaky-token-test
Tom Clegg [Fri, 21 Oct 2016 19:19:51 +0000 (15:19 -0400)]
10008: Merge branch 'master' into 10008-flaky-token-test

7 years ago10008: Call checkupdate() on ancestors when opening a file.
Tom Clegg [Fri, 21 Oct 2016 19:16:24 +0000 (15:16 -0400)]
10008: Call checkupdate() on ancestors when opening a file.

7 years ago10232: Call getpwnam() and getgrnam() for every name instead of relying on Etc.to_enum().
Tom Clegg [Fri, 21 Oct 2016 15:18:32 +0000 (11:18 -0400)]
10232: Call getpwnam() and getgrnam() for every name instead of relying on Etc.to_enum().

7 years agoAdd requests to ubuntu1204 backport lists, refs #10194
Peter Amstutz [Fri, 21 Oct 2016 15:06:51 +0000 (11:06 -0400)]
Add requests to ubuntu1204 backport lists, refs #10194

7 years agoMerge branch '10194-cwl-version-skew' closes #10194
Peter Amstutz [Fri, 21 Oct 2016 14:15:56 +0000 (10:15 -0400)]
Merge branch '10194-cwl-version-skew' closes #10194

7 years agoMerge branch 'master' into 10194-cwl-version-skew
Peter Amstutz [Fri, 21 Oct 2016 14:15:10 +0000 (10:15 -0400)]
Merge branch 'master' into 10194-cwl-version-skew

Conflicts:
sdk/cwl/tests/test_job.py

7 years ago10194: Use SETUP_DIR for checking git version and writing _version.py. Add
Peter Amstutz [Fri, 21 Oct 2016 13:52:36 +0000 (09:52 -0400)]
10194: Use SETUP_DIR for checking git version and writing _version.py.  Add
comment about calling cwltool.docker.get_image(dockerRequirement, pull_image).

7 years ago10172: Fix container request test. Replace
Peter Amstutz [Fri, 21 Oct 2016 12:47:05 +0000 (08:47 -0400)]
10172: Fix container request test.  Replace
Thread.current[:api_client_authorization] with
current_api_client_authorization.

7 years ago10232: dont create user logic was wrong
Nico Cesar [Fri, 21 Oct 2016 11:38:37 +0000 (07:38 -0400)]
10232: dont create user logic was wrong

refs #10232

7 years ago10232: --dont-create-user flag and sanity check for non-existing users
Nico Cesar [Fri, 21 Oct 2016 11:10:22 +0000 (07:10 -0400)]
10232: --dont-create-user flag and sanity check for non-existing users

refs #10232

7 years agoMerge branch 'crunch-job_finds_newer_docker_hashes' of https://github.com/tmooney...
Tom Clegg [Fri, 21 Oct 2016 05:18:54 +0000 (01:18 -0400)]
Merge branch 'crunch-job_finds_newer_docker_hashes' of https://github.com/tmooney/arvados

No issue #

7 years agoCheck docker version to decide whether to use -f with docker tag, refs #10025
Peter Amstutz [Fri, 21 Oct 2016 02:46:54 +0000 (22:46 -0400)]
Check docker version to decide whether to use -f with docker tag, refs #10025

7 years ago10172: Add test for API: true and container setting output.
Peter Amstutz [Fri, 21 Oct 2016 01:38:28 +0000 (21:38 -0400)]
10172: Add test for API: true and container setting output.

7 years agoMerge branch '10025-arvbox-layers' closes #10025
Peter Amstutz [Fri, 21 Oct 2016 01:25:15 +0000 (21:25 -0400)]
Merge branch '10025-arvbox-layers' closes #10025

7 years ago10172: If RuntimeConstraints.API is set, refresh container record to check if
Peter Amstutz [Thu, 20 Oct 2016 21:06:48 +0000 (17:06 -0400)]
10172: If RuntimeConstraints.API is set, refresh container record to check if
output field has been already set by the container.

7 years ago10172: Bugfix getting container output when container is reused. Tweak output
Peter Amstutz [Thu, 20 Oct 2016 21:05:28 +0000 (17:05 -0400)]
10172: Bugfix getting container output when container is reused.  Tweak output
to report "Job" or "Container" depending on which API is in use.

7 years ago10172: crunch_script only updates task record on error, will normally be
Peter Amstutz [Thu, 20 Oct 2016 20:08:52 +0000 (16:08 -0400)]
10172: crunch_script only updates task record on error, will normally be
updated in set_crunch_output().

7 years agoMerge branch 'master' into 10172-crunch2-container-output
Peter Amstutz [Thu, 20 Oct 2016 19:47:59 +0000 (15:47 -0400)]
Merge branch 'master' into 10172-crunch2-container-output

7 years ago10172: Detect when running as crunch container or job and set output.
Peter Amstutz [Thu, 20 Oct 2016 19:42:28 +0000 (15:42 -0400)]
10172: Detect when running as crunch container or job and set output.

7 years ago10172: Tests and related fixes for auth_uuid setting output on container.
Peter Amstutz [Thu, 20 Oct 2016 19:16:00 +0000 (15:16 -0400)]
10172: Tests and related fixes for auth_uuid setting output on container.

7 years agoMerge branch '10291-really-disable-apis' closes #10291
Tom Clegg [Thu, 20 Oct 2016 15:53:49 +0000 (11:53 -0400)]
Merge branch '10291-really-disable-apis' closes #10291

7 years ago10291: Test multiple disabled APIs.
Tom Clegg [Thu, 20 Oct 2016 13:11:08 +0000 (09:11 -0400)]
10291: Test multiple disabled APIs.

7 years ago10291: Respond 404 to requests for disabled APIs.
Tom Clegg [Thu, 20 Oct 2016 13:06:10 +0000 (09:06 -0400)]
10291: Respond 404 to requests for disabled APIs.

7 years agoMerge branch '10287-sso-username' refs #10287
Tom Clegg [Thu, 20 Oct 2016 10:01:43 +0000 (06:01 -0400)]
Merge branch '10287-sso-username' refs #10287

7 years agoMerge branch '10291-discovery-blacklist' refs #10291
Tom Clegg [Thu, 20 Oct 2016 09:15:49 +0000 (05:15 -0400)]
Merge branch '10291-discovery-blacklist' refs #10291

7 years ago10287: Perform blacklist and duplicate checks on usernames received from SSO.
Tom Clegg [Thu, 20 Oct 2016 08:58:27 +0000 (04:58 -0400)]
10287: Perform blacklist and duplicate checks on usernames received from SSO.

7 years agoSupport Docker v1.10+ hashes that include sha256: prefix.
Thomas Mooney [Wed, 19 Oct 2016 22:59:52 +0000 (17:59 -0500)]
Support Docker v1.10+ hashes that include sha256: prefix.

7 years ago10287: When creating a new account, if provided use 'username' from SSO server.
Peter Amstutz [Wed, 19 Oct 2016 21:14:51 +0000 (17:14 -0400)]
10287: When creating a new account, if provided use 'username' from SSO server.

7 years agoMerge branch '10216-allow-cr-bypass-reuse'
Lucas Di Pentima [Wed, 19 Oct 2016 20:11:04 +0000 (17:11 -0300)]
Merge branch '10216-allow-cr-bypass-reuse'
Closes #10216

7 years ago10216: Merge branch 'master' into 10216-allow-cr-bypass-reuse
Lucas Di Pentima [Wed, 19 Oct 2016 20:10:16 +0000 (17:10 -0300)]
10216: Merge branch 'master' into 10216-allow-cr-bypass-reuse

7 years ago10216: Modified test case, adding it to an already existing test.
Lucas Di Pentima [Wed, 19 Oct 2016 20:08:24 +0000 (17:08 -0300)]
10216: Modified test case, adding it to an already existing test.

7 years ago10216: Added use_existing field to Container Request. When false and CR is committed...
Lucas Di Pentima [Wed, 19 Oct 2016 18:06:44 +0000 (15:06 -0300)]
10216: Added use_existing field to Container Request. When false and CR is committed, a new container will always be created.
Added test case for this new behaviour.

7 years ago10291: Check discovery document before trying to choose/use a work API.
Tom Clegg [Wed, 19 Oct 2016 15:44:12 +0000 (11:44 -0400)]
10291: Check discovery document before trying to choose/use a work API.

7 years ago10291: Fix catching all exceptions in test case.
Tom Clegg [Wed, 19 Oct 2016 15:30:31 +0000 (11:30 -0400)]
10291: Fix catching all exceptions in test case.

7 years ago10291: Add config to disable API methods.
Tom Clegg [Wed, 19 Oct 2016 15:32:44 +0000 (11:32 -0400)]
10291: Add config to disable API methods.

7 years agoMerge branch '10297-container-image-file-sha256' refs #10297
Tom Clegg [Wed, 19 Oct 2016 09:29:26 +0000 (05:29 -0400)]
Merge branch '10297-container-image-file-sha256' refs #10297

7 years ago10297: Accept docker images named sha256:{...}.tar when specified by PDH.
Tom Clegg [Wed, 19 Oct 2016 09:05:09 +0000 (05:05 -0400)]
10297: Accept docker images named sha256:{...}.tar when specified by PDH.

7 years ago10194: Package testing passes for debian7
Peter Amstutz [Tue, 18 Oct 2016 20:39:55 +0000 (16:39 -0400)]
10194: Package testing passes for debian7

7 years ago10194: Add package test for arvados-cwl-runner. Symlink package tests so
Peter Amstutz [Tue, 18 Oct 2016 17:00:44 +0000 (13:00 -0400)]
10194: Add package test for arvados-cwl-runner.  Symlink package tests so
they run for .deb distributions.

7 years ago10194: Update test
Peter Amstutz [Tue, 18 Oct 2016 15:13:19 +0000 (11:13 -0400)]
10194: Update test

7 years agoFix wrong environment variable ARVADOS_API_INSECURE -> ARVADOS_API_HOST_INSECURE...
Tom Clegg [Tue, 18 Oct 2016 14:49:38 +0000 (10:49 -0400)]
Fix wrong environment variable ARVADOS_API_INSECURE -> ARVADOS_API_HOST_INSECURE. No issue #

7 years agoMerge branch '10232-non-exclusive-keys' refs #10232
Tom Clegg [Tue, 18 Oct 2016 14:37:26 +0000 (10:37 -0400)]
Merge branch '10232-non-exclusive-keys' refs #10232

7 years agoAlways log sbatch command, not just on failure. No issue #
Tom Clegg [Tue, 18 Oct 2016 14:30:01 +0000 (10:30 -0400)]
Always log sbatch command, not just on failure. No issue #

7 years ago10232: Increase ascii art.
Tom Clegg [Tue, 18 Oct 2016 13:01:54 +0000 (09:01 -0400)]
10232: Increase ascii art.

7 years ago10232: Own just a section of authorized_keys instead of clobbering the whole thing...
Tom Clegg [Tue, 18 Oct 2016 12:35:13 +0000 (08:35 -0400)]
10232: Own just a section of authorized_keys instead of clobbering the whole thing, unless --xclusive flag given

7 years ago10194: Create job with pinned cwl version.
Peter Amstutz [Mon, 17 Oct 2016 21:06:17 +0000 (17:06 -0400)]
10194: Create job with pinned cwl version.

7 years ago10194: arvados/jobs a-c-r pinning WIP
Peter Amstutz [Mon, 17 Oct 2016 19:02:31 +0000 (15:02 -0400)]
10194: arvados/jobs a-c-r pinning WIP

7 years agoFix API server version pin on arvados-cli. refs #10259
Peter Amstutz [Mon, 17 Oct 2016 19:47:32 +0000 (15:47 -0400)]
Fix API server version pin on arvados-cli. refs #10259

7 years agoMerge branch '10259-cwl-pipeline-null' refs #10259
Peter Amstutz [Mon, 17 Oct 2016 19:35:26 +0000 (15:35 -0400)]
Merge branch '10259-cwl-pipeline-null' refs #10259

7 years ago10259: Move trim_listing out of upload_instance
Peter Amstutz [Mon, 17 Oct 2016 19:27:25 +0000 (15:27 -0400)]
10259: Move trim_listing out of upload_instance

7 years agoMerge branch 'master' into 10259-cwl-pipeline-null
Peter Amstutz [Mon, 17 Oct 2016 19:07:09 +0000 (15:07 -0400)]
Merge branch 'master' into 10259-cwl-pipeline-null

7 years agoMerge branch '10200-cwl-crunch-script' closes #10200
Peter Amstutz [Mon, 17 Oct 2016 19:05:53 +0000 (15:05 -0400)]
Merge branch '10200-cwl-crunch-script' closes #10200

7 years ago10259: Update arvados-cli version pin
Peter Amstutz [Mon, 17 Oct 2016 18:18:02 +0000 (14:18 -0400)]
10259: Update arvados-cli version pin

7 years ago3486: Accept false and nil/null as parameter values, and avoid translating nil to...
Tom Clegg [Fri, 14 Oct 2016 21:12:51 +0000 (17:12 -0400)]
3486: Accept false and nil/null as parameter values, and avoid translating nil to false.

7 years ago10259: When creating pipeline to be managed by a-r-p-i, wrap value in dict for
Peter Amstutz [Mon, 17 Oct 2016 14:47:43 +0000 (10:47 -0400)]
10259: When creating pipeline to be managed by a-r-p-i, wrap value in dict for
false and null as well.

7 years ago10194: Record git version in package
Peter Amstutz [Mon, 17 Oct 2016 17:48:39 +0000 (13:48 -0400)]
10194: Record git version in package

7 years ago10200: Copy cwl-runner crunch script into arvados_cwl package to avoid version skew...
Peter Amstutz [Wed, 12 Oct 2016 16:00:11 +0000 (12:00 -0400)]
10200: Copy cwl-runner crunch script into arvados_cwl package to avoid version skew.  Keep old cwl-runner code as a fallback to avoid breaking installations that haven't been updated.

7 years ago10025: run-build-docker-images.sh can use "arvbox build" instead of "rebuild"
Peter Amstutz [Mon, 17 Oct 2016 15:57:43 +0000 (11:57 -0400)]
10025: run-build-docker-images.sh can use "arvbox build" instead of "rebuild"
now because caching should be better behaved.

7 years ago10025: If $TAG starts with '-' it is not a tag.
Peter Amstutz [Mon, 17 Oct 2016 15:26:44 +0000 (11:26 -0400)]
10025: If $TAG starts with '-' it is not a tag.

7 years ago10025: Add ARG arvados_version to .dev and .demo
Peter Amstutz [Mon, 17 Oct 2016 13:53:37 +0000 (09:53 -0400)]
10025: Add ARG arvados_version to .dev and .demo

7 years ago10025: Use docker tag -f to change "latest".
Peter Amstutz [Mon, 17 Oct 2016 13:48:38 +0000 (09:48 -0400)]
10025: Use docker tag -f to change "latest".

7 years agoRemove obsolete comment. No issue #
Tom Clegg [Mon, 17 Oct 2016 13:24:03 +0000 (09:24 -0400)]
Remove obsolete comment. No issue #

7 years ago9956: Fix startup log message. refs #9956
Tom Clegg [Mon, 17 Oct 2016 12:58:01 +0000 (08:58 -0400)]
9956: Fix startup log message. refs #9956

7 years agoMerge branch '10211-double-close-crash' closes #10211
Tom Clegg [Mon, 17 Oct 2016 12:50:57 +0000 (08:50 -0400)]
Merge branch '10211-double-close-crash' closes #10211

7 years agoMerge branch '10281-directory-replication' closes #10281
Tom Clegg [Mon, 17 Oct 2016 12:39:10 +0000 (08:39 -0400)]
Merge branch '10281-directory-replication' closes #10281

7 years ago10281: Test default replication=1 for directory volumes.
Tom Clegg [Mon, 17 Oct 2016 12:26:26 +0000 (08:26 -0400)]
10281: Test default replication=1 for directory volumes.

7 years ago10281: Update comment.
Tom Clegg [Mon, 17 Oct 2016 12:12:27 +0000 (08:12 -0400)]
10281: Update comment.

7 years ago10281: Add DirectoryReplication config.
Tom Clegg [Mon, 17 Oct 2016 12:06:05 +0000 (08:06 -0400)]
10281: Add DirectoryReplication config.

7 years agoMerge branch '10280-squeue-error' closes #10280
Tom Clegg [Mon, 17 Oct 2016 10:39:41 +0000 (06:39 -0400)]
Merge branch '10280-squeue-error' closes #10280

7 years agoMerge branch '9956-keepstore-config' refs #9956
Tom Clegg [Mon, 17 Oct 2016 10:16:04 +0000 (06:16 -0400)]
Merge branch '9956-keepstore-config' refs #9956

7 years ago10280: Fix ignored error from cmd.Start().
Tom Clegg [Mon, 17 Oct 2016 10:15:29 +0000 (06:15 -0400)]
10280: Fix ignored error from cmd.Start().

7 years ago9956: gofmt
Tom Clegg [Mon, 17 Oct 2016 09:41:02 +0000 (05:41 -0400)]
9956: gofmt

7 years ago10211: Clarify expected result of double-close.
Tom Clegg [Mon, 17 Oct 2016 09:11:25 +0000 (05:11 -0400)]
10211: Clarify expected result of double-close.

7 years ago9956: Fix run_test_server: default is now -enforce-permissions=true.
Tom Clegg [Mon, 17 Oct 2016 08:57:18 +0000 (04:57 -0400)]
9956: Fix run_test_server: default is now -enforce-permissions=true.

7 years agoMerge branch 'master' into 9956-keepstore-config
Tom Clegg [Mon, 17 Oct 2016 08:32:37 +0000 (04:32 -0400)]
Merge branch 'master' into 9956-keepstore-config

Conflicts:
services/keepstore/keepstore.go