Commit Graph

205 Commits

Author SHA1 Message Date
Michal Pristas
b90ca9700f cancell context with timeouts (#825) 2018-10-26 20:10:45 +02:00
Tomasz Tomalak
01104d3fe2 Add bucket check and create to storage/s3 tests (#801)
* Add bucket check and create for storage/s3 tests

* Add context with default time duration
2018-10-24 12:21:57 -07:00
Marwan Sulaiman
24fb4b7399 Remove olympus mention in doc comment (#812) 2018-10-24 13:50:13 +02:00
Marwan Sulaiman
2d589f1945 Remove CSRF option from config (#814) 2018-10-24 10:59:33 +02:00
Henry Jenkins
d26b99d41c Upgrade Buffalo (#789)
* Upgrade buffalo

* Switch to go modules everywhere

* Fixes from buffalo fix

* Add missing modules from module list

* Update vendored modules in /vendor

* Stop using vendor directory for tests

* Check go.mod and go.sum files on verify

* Upgrade Buffalo from v0.13.0 to v0.13.1

* Fix test for new Buffalo

Allow for new Buffalo code

* Add test for endpoint with trailing slash
2018-10-23 16:49:32 -07:00
Henry Jenkins
532e93e119 Remove Olympus code (#779)
* Remove nolonger used moniker package

Usage was removed in 97d8013

* Remove reference to Zeus

Use name Proxy for now.

* Remove Olympus code

See github issue #777

* Remove Olympus related vendor modules

* Mention Olympus removal in docs

* Add note about no registries existing

* Remove eventlog

* Update docs for Olympus removal
2018-10-22 11:52:02 -07:00
Tomasz Tomalak
f665b0c2eb Fix skipped mongo and minio tests (#791) 2018-10-18 14:36:28 -07:00
Tomasz Tomalak
480d8c8e8c Implement storage.Backend for S3 storage (#750)
* Implement storage.Backend for S3 storage

* Adapt S3 storage test after refactor, Fix skiped minio tests

* Add defer to Close calls in s3.getter methods

* CR fixes

* Fix doc align

* Tweak err checks

* Fix parse test for S3 configs and cleanup error messages in storage.s3
2018-10-15 21:46:08 -04:00
Laurence Withers
4cda44cdd8 storage/fs: don't mark files as executables (#782)
When creating files, don't set the permission bits as 0777
(os.ModePerm), since that will cause them to be marked as executable.
Instead set them to 0666.

Add a comment explaining the umask will be subtracted, which is why 0666
(and not e.g. 0644 or 0600) is appropriate.
2018-10-15 14:06:04 +02:00
Manu Gupta
13083b9d32 Support custom ca's and make insecure as part optional default being false (#767)
* Support custom ca's and make insecure as part optional default being false

* Fix gofmt issue

* Fix newline
2018-10-15 11:14:48 +02:00
Manu Gupta
fc9486b1cb Allow users to use certificates from the system cert pool (#756) 2018-10-08 16:34:28 -05:00
Michal Pristas
89d9dd2609 updated single letter props (#746) 2018-10-05 08:54:57 -07:00
Marwan Sulaiman
6753def0b7 Authenticate by providing Github Token only (#739)
* Authenticate by providing Github Token only

* docs: add backticks to env var

* add optional word to docs
2018-10-04 19:35:16 -04:00
Marwan Sulaiman
97d8013876 Refactor storage tests (#727)
* Refactor storage tests

* minio: check object err

* remove inaccurate test

* storage/fs: use memory
2018-10-04 16:16:24 -07:00
Marwan Sulaiman
337488c202 Add stackdriver to traces (#737) 2018-10-04 18:47:38 -04:00
Bhavesh Praveen
73e45cb413 Tracing Exporter for Datadog #714 (#723)
* Tracing Exporter for Datadog #714

* Tracing Exporter for Datadog #714
2018-10-03 22:48:10 -04:00
Tomasz Tomalak
dfe939e14c Proxy: Add HGRC file mount (#720)
* Proxy: Add HGRC file mount

* Rename and move dotFile initializer, lower permission for authFiles
2018-10-03 20:13:57 +02:00
marpio
31b66be9a2 close zip reader (#724) 2018-10-03 18:21:50 +02:00
Don McNamara
39d10b3a1b Clean up store before test. (#719) 2018-10-03 18:16:04 +02:00
marpio
d370b5a240 ignore line endings in gomod tests (#718) 2018-10-02 13:38:59 +02:00
marpio
bc4e533d49 Use go mod download -json (#710)
* use go mod download -json

* annotate json, fix build

* add comment

* address review feedback
2018-10-01 20:53:17 +02:00
Aravind
7ee25d59d6 Fix typo in comment (#709) 2018-10-01 09:09:29 +02:00
Zachary Romero
e5b307354c Patch points of test flag leakage (#667) 2018-09-29 19:26:19 +02:00
Manu Gupta
2c3d72d52e Save http status in the outermost span (#694)
* Save http status in the outermost span

Co-authored-by: Federico Paolinelli <fedepaol@gmail.com>

* Use ochttp to use span status and store http status code as a tag

* Make the conditional oneliner
2018-09-22 00:28:18 -04:00
marpio
bcc896f226 rename example to dev and rm test config (#691) 2018-09-20 16:38:08 -04:00
marpio
29b6b6ffab Minio conf + tests refactoring (#680)
* cleanup tests and change minio port

* fix cleanup

* cleanup

* fix config test

* add comment to travis

* revert to generic minio addr

* fix test

* switch to test config

* adapt timeouts

* use example config

* fix test... again

* add new lines
2018-09-20 21:31:21 +02:00
Marwan Sulaiman
5fd3e12270 Update OpenCensus to v0.17.0 (#686)
* Update OpenCensus to v0.17.0

* fix typo

* Rename go file to match pkg name
2018-09-20 12:50:32 -04:00
Marwan Sulaiman
fe65b9703f Use config for trace url (#681)
* Use config for trace url

* pr updates

* fix typo

* fix typo
2018-09-20 12:00:13 -04:00
Marwan Sulaiman
5dcaeb8ab8 Trace stash operations (#682)
* Trace stash operations

* fix build
2018-09-20 10:59:42 -04:00
Marwan Sulaiman
8174795715 Fix module.ClearFiles operation name (#685) 2018-09-20 08:57:33 +02:00
Don McNamara
3db7a667f0 Clean up error operation names to match function names. (#614) 2018-09-19 23:43:09 -04:00
Aravind
d4941647af Refactored to remove pkg/cdn (#672) 2018-09-19 08:36:23 +02:00
Marwan Sulaiman
8cfe8b8064 Clean up Config (#673) 2018-09-19 01:44:59 -04:00
Marwan Sulaiman
4b34b1fd28 pkg/errors: add comment to exported function (#676) 2018-09-19 01:38:15 -04:00
tnextday
d4c1363d9c Add HTTP_PROXY environment variable to go_get_fetcher (#668)
* Add HTTP_PROXY env to go_get_fetcher

* gofmt
2018-09-17 20:28:42 +02:00
marpio
6af44242fb Fix list (#607)
* merge list from storage with the one from go list

* fix and rename

* move stuff to semver pkg

* fix gofmt

* move union out of semver pkg

* add tests

* fix err msg

* fix tests

* error handling

* error handling, go list refactoring

* fix list

* cleanup

* fix gofmt
2018-09-13 14:12:17 -07:00
marpio
f25c427239 Fix for Windows 10 (#648)
* ps: add cdefault conf

* init - add config

* add required env vars for win10

* update test_e2e.ps1 to use go build -mod=vendor
2018-09-13 13:57:37 -07:00
Manu Gupta
89d7b35ccd remove opentracing stuff from the code (#652) 2018-09-13 13:24:04 -04:00
Manu Gupta
57b11e8489 Shorten op names and remove spans from handlers (#647) 2018-09-11 23:20:32 -04:00
Rohan Chakravarthy
0e470d0294 Plumb config - Latest (#627)
* switch proxy to config file

pull in single flight changes

* changes for single-flight

* intermediate stage. All tests passing. pkg still has env refs

* remove all env references

* delete config/env entirely

* fix failing tests

* create the config.toml file as part of dev setup

* create config file only if it doesn't exist

* update Dockerfiles to use config file

* move composing elements to the top

* verbose parameter naming

* newline

* add flag for config file path

* update docs with config file flag

* remove unnecessary nil check

* use filepath.join

* rename redis port to address

* fix path.join

* fix issues after merge

* add vendor dir
2018-09-11 15:04:20 -07:00
Manu Gupta
bb250437da Instrumenting observability with opencensus (#604)
* Initial chanages for observability

* Fix some panics to start testing

* Export tracing properly

* First example of child spans using opencensus

* Add spans to download protocol

* Add url to traces

* Remove opentracing

* Remove gopkg.* files

* Start deprecating opentracing

* Resolve stupid build errors

* Use observability package

* Fix test errors

* Convert buffalo spans to observercontext

* change package name

* defer flush to the end of the app execution

* Change op names to the correct package

* Rename pkg/observability to pkg/observ

* Show traces for the package

* Keep tracing in the earlier way

* Add info from request headers

* Remove whitespace

* Move exporter url to env var

* Add to env file for documentation

* Remove opentracing stuff

* Use stdlib

* Shorten service name

* Add a service name to olympus as well

* Add test to test if there is a recursion or not

* Add Ops Suite

* Move around code

* Make sure the service is not instantiated if the exporter is not found
2018-09-11 10:31:20 -07:00
Tobias Klauser
ec2748ecc3 Remove unused file in pkg/module and clean up dependencies (#625)
* pkg/module: Remove unused file parser.go

PR #618 removed the last remaining user of the functions/types defined
in parser.go

* go.mod: update

The last user of github.com/sabhiram/go-gitignore was removed. Run 'go
mod tidy' to remove the dependency.

* vendor: remove unused dependency

The last user of github.com/sabhiram/go-gitignore was removed. Remove
the vendored copy as well by running 'go mod vendor'.
2018-09-07 02:04:23 -04:00
Marwan Sulaiman
ea96158f8f Athens: introduce Single Flight (#573)
* Athens: introduce singleflight

* fix ci

* small fixes

* Remove unnecessary method

* simplify folder structure

* dcoument stasher iface

* fixes

* Fix olympus

* Remove Version from Download Protocol

* fix olympus

* refactor fetcher

* consolodate wrapping styles

* fix olympus

* Further refactoring

* fix typo
2018-09-03 16:31:13 -04:00
Marwan Sulaiman
249a1a6e4e Remove unused stuff (#618) 2018-09-01 14:34:21 -04:00
Rohan Chakravarthy
7c745fb3d9 add a configuration file (#453)
* complete updated config package

* use envconfig+toml instead of viper. Add descriptions in example config file

* add unit tests

* debug gofmt on build server

* force dummy commit

* skip gofmt to validate other tests are passing

* unset env vars for example file parsing test

* cleanup tests

* test improvements

* re-enable gofmt

* naming

* PR comments

* fix failing test after olympus default endpoint change

* remove rdbms config

* set defaults in code

* add support for proxyfilteroff

* add basic auth params

* update gopkg.lock

* undo gopkg.lock changes made during merge

* remove defaults

* explicitly specify all env variables

* remove rdbms from example

* remove user and pass to disable basic auth by default

* switch to memory by default for the proxy

* fix tests after config file change
2018-08-31 14:23:41 -04:00
Rohan Chakravarthy
697a7a5073 remove olympus storage implementation and proxy worker (#513)
* remove olympus storage implementation and proxy worker

* cleanup after merge conflicts

* remove newline
2018-08-30 03:47:04 -04:00
Arthur Mello
e5ce3f7c6e Set a default value for ATHENS_MONGO_CONNECTION_STRING env var (#580)
* Set a default value for ATHENS_MONGO_CONNECTION_STRING env var

- ATHENS_MONGO_CONNECTION_STRING will default to mongodb://127.0.0.1:27017 if not set

* Fix Get function call

* Update user of env.MongoConnectionString
2018-08-28 11:56:15 +02:00
Michal Pristas
539700e598 KindNotFound for all storages (#560)
* all exc mongo

* module, version associated with each storage error

* remove confusion

* removed formatted error in favor of raw flavor

* once more
2018-08-24 20:00:00 +02:00
Marwan Sulaiman
4a618990a2 pkg/download/goget: ensure each List func gets its own GOPATH (#559)
* pkg/download/goget: ensure each List func gets its own GOPATH

* Add list tests

* fix diskref tests
2018-08-24 10:19:17 -04:00
Marwan Sulaiman
fc581c3784 pkg/storage: ensure mongo returns KindNotFound (#558) 2018-08-24 02:13:09 -04:00