Dvc: Team members should use the same profile for s3?

Created on 21 Nov 2018  路  4Comments  路  Source: iterative/dvc

I usually use aws cli with a profile (for example aws s3 ls --profile myprof).

Therefore, I set .dvc/config as follows:

['remote "myremote"']
url = s3://mybucket/folder
profile = myprof

When this configuration file is pushed to the git repository, all members' profile for s3 is set to myprof.
Is there a way to personally set the profile?

(Sorry for sending it before completion)

Most helpful comment

You could use the local configuration, @mizgyo, so every team member have different assigned profiles.

https://dvc.org/doc/commands-reference/config

Or you can create another profile with just the access needed for S3 operations:

s3:ListBucket
s3:GetObject
s3:PutObject
s3:DeleteObject

And share that one with your team members.

All 4 comments

Hi @mizgyo ! Could you please elaborate on your question?

You could use the local configuration, @mizgyo, so every team member have different assigned profiles.

https://dvc.org/doc/commands-reference/config

Or you can create another profile with just the access needed for S3 operations:

s3:ListBucket
s3:GetObject
s3:PutObject
s3:DeleteObject

And share that one with your team members.

@mizgyo You can use local config to set your private settings that are not going to be pushed to git. Just use --local flag for respective dvc config and dvc remote commands, or write directly to .dvc/config.local.

Thanks for your reply.
The local configuration is what I was looking for.
I misunderstood that local configuration is set in the repository instead of machine local.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

dmpetrov picture dmpetrov  路  3Comments

GildedHonour picture GildedHonour  路  3Comments

anotherbugmaster picture anotherbugmaster  路  3Comments

dnabanita7 picture dnabanita7  路  3Comments

mdscruggs picture mdscruggs  路  3Comments