Rexray: Directory permissions and ownership using rexray/s3fs volume plugin

Created on 3 May 2018 · 10Comments · Source: rexray/rexray

Summary

Cannot chown or chmod directory using rexray/s3fs docker volume plugin

Bug Reports

I'm able to mount minio, and file perms are 644, but cannot te perms or ownership on directories

Version

Please paste the output of rexray version. For example:

$ rexray version
REX-Ray
-------
Binary: /var/lib/docker/plugins/edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f/rootfs/usr/bin/rexray
Flavor: client+agent+controller
SemVer: 0.11.2
OsArch: Linux-x86_64
Commit: fc8bfbd2d02c2690fc3a755a9560dd12c88e0852
Formed: Sat, 24 Feb 2018 20:51:22 ART

Expected Behavior

I mount from a docker container a minio bucket using docker volume plugin rexray/s3fs and expect to inherit file and dir ownership and permissions from root dir.

Actual Behavior

When I mount the bucket, files are in perm 644, but dirs are owned by root and perms 000.
d---------. 1 root root 0 May 3 17:15 uploads

Steps To Reproduce

# cat /etc/os-release
NAME="Container Linux by CoreOS"
ID=coreos
VERSION=1688.5.3
VERSION_ID=1688.5.3
BUILD_ID=2018-04-03-0547
PRETTY_NAME="Container Linux by CoreOS 1688.5.3 (Rhyolite)"
ANSI_COLOR="38;5;75"
HOME_URL="https://coreos.com/"
BUG_REPORT_URL="https://issues.coreos.com"
COREOS_BOARD="amd64-usr"

# docker version
Client:
 Version:       17.12.1-ce
 API version:   1.35
 Go version:    go1.9.4
 Git commit:    7390fc6
 Built: Tue Feb 27 22:10:31 2018
 OS/Arch:       linux/amd64

Server:
 Engine:
  Version:      17.12.1-ce
  API version:  1.35 (minimum version 1.12)
  Go version:   go1.9.4
  Git commit:   7390fc6
  Built:        Tue Feb 27 22:10:31 2018
  OS/Arch:      linux/amd64
  Experimental: false

# docker plugin install rexray/s3fs --alias nasbackup/minio \
  S3FS_OPTIONS="allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000" \
  S3FS_ENDPOINT="http://172.19.64.12:9000" \
  S3FS_ACCESSKEY="accessKey" \
  S3FS_SECRETKEY="secret" \
  REXRAY_LOGLEVEL=debug

# cat > Dockerfile <<EOF
FROM php:5.6.13-apache

ADD src /var/www/html

RUN chown -R www-data:www-data /var/www/html

RUN mkdir /var/www/html/uploads &&\
  chown www-data:www-data /var/www/html/uploads && \
  chmod 0755 /var/www/html/uploads

VOLUME /var/www/html/uploads
EOF

# mkdir src

# cat > src/index.php <<EOF
<?
file_put_contents('uploads/test.1', "YES\n");
?>
EOF

# docker build -t test .

# docker run  \
  -d \
  --name test1 \
  -p 80:80 \
  --mount type=volume,volume-driver=nasbackup/minio,src=test,target=/var/www/html/uploads \
  test

# curl  http://localhost:80
<b>Warning</b>:  file_put_contents(uploads/test.1): failed to open stream: Operation not permitted in <b>/var/www/html/index.php</b> on line <b>3</b><br />

I tried also without success:

add to dockerdfile USER www-data, and start apache in port 8080
--mount type=volume,volume-driver=nasbackup/minio,src=test,target=/var/www/html/uploads,volume-opt=opts=uid=33
--mount type=volume,volume-driver=nasbackup/minio,src=test,target=/var/www/html/uploads,volume-opt=opts=gid=33
--mount type=volume,volume-driver=nasbackup/minio,src=test,target=/var/www/html/uploads,volume-opt=opts=dir_mode=0666
LINUX_VOLUME_ROOTPATH=/
LINUX_VOLUME_FILEMODE=755
LINUX_VOLUME_FILEMODE=0755

Configuration Files

# docker plugin inspect nasbackup/minio
[
{
"Config": {
"Args": {
"Description": "",
"Name": "",
"Settable": null,
"Value": null
},
"Description": "REX-Ray FUSE Driver for Amazon Simple Storage Service (S3FS)",
"DockerVersion": "18.02.0-ce",
"Documentation": "https://github.com/thecodeteam/rexray/.docker/plugins/s3fs",
"Entrypoint": [
"/rexray.sh",
"rexray",
"start",
"-f",
"--nopid"
],
"Env": [
{
"Description": "",
"Name": "REXRAY_LOGLEVEL",
"Settable": [
"value"
],
"Value": "warn"
},
{
"Description": "",
"Name": "LIBSTORAGE_INTEGRATION_VOLUME_OPERATIONS_MOUNT_ROOTPATH",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "LINUX_VOLUME_ROOTPATH",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "LINUX_VOLUME_FILEMODE",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "HTTP_PROXY",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "S3FS_ENDPOINT",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "S3FS_ACCESSKEY",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "S3FS_DISABLEPATHSTYLE",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "S3FS_MAXRETRIES",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "S3FS_OPTIONS",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "S3FS_REGION",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "S3FS_SECRETKEY",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "",
"Name": "CSI_ENDPOINT",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "The name of the CSI plug-in used by the CSI module.",
"Name": "X_CSI_DRIVER",
"Settable": [
"value"
],
"Value": ""
},
{
"Description": "A flag that disables the CSI to libStorage bridge.",
"Name": "X_CSI_NATIVE",
"Settable": [
"value"
],
"Value": "false"
}
],
"Interface": {
"Socket": "rexray.sock",
"Types": [
"docker.volumedriver/1.0"
]
},
"IpcHost": false,
"Linux": {
"AllowAllDevices": true,
"Capabilities": [
"CAP_SYS_ADMIN"
],
"Devices": null
},
"Mounts": [
{
"Description": "",
"Destination": "/dev",
"Name": "",
"Options": [
"rbind"
],
"Settable": null,
"Source": "/dev",
"Type": "bind"
}
],
"Network": {
"Type": "host"
},
"PidHost": false,
"PropagatedMount": "/var/lib/rexray",
"User": {},
"WorkDir": "",
"rootfs": {
"diff_ids": [
"sha256:eebe6ffed8f4c85b884ec7c227cff7ed9a9c189f8d28949aa20c395dd121869f"
],
"type": "layers"
}
},
"Enabled": true,
"Id": "edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f",
"Name": "nasbackup/minio:latest",
"PluginReference": "docker.io/rexray/s3fs:latest",
"Settings": {
"Args": [],
"Devices": [],
"Env": [
"REXRAY_LOGLEVEL=debug",
"LIBSTORAGE_INTEGRATION_VOLUME_OPERATIONS_MOUNT_ROOTPATH=",
"LINUX_VOLUME_ROOTPATH=",
"LINUX_VOLUME_FILEMODE=",
"HTTP_PROXY=",
"S3FS_ENDPOINT=http://172.19.64.12:9000",
"S3FS_ACCESSKEY=accessKey",
"S3FS_DISABLEPATHSTYLE=",
"S3FS_MAXRETRIES=",
"S3FS_OPTIONS=allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000",
"S3FS_REGION=",
"S3FS_SECRETKEY=secret",
"CSI_ENDPOINT=",
"X_CSI_DRIVER=",
"X_CSI_NATIVE=false"
],
"Mounts": [
{
"Description": "",
"Destination": "/dev",
"Name": "",
"Options": [
"rbind"
],
"Settable": null,
"Source": "/dev",
"Type": "bind"
}
]
}
}
]

Logs

May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"Entering go-plugins-helpers capabilitiesPath\" time=1525378656055 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"Entering go-plugins-helpers capabilitiesPath\" time=1525378656056 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"Entering go-plugins-helpers getPath\" time=1525378656056 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"inspecting volume\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=map[] osDriver=linux service=s3fs storageDriver=libstorage time=1525378656057 volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"inspecting volume\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=map[] osDriver=linux service=s3fs storageDriver=libstorage time=1525378656057 volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"storage executor initialized\" cmd=s3fs driver=s3fs host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" integrationDriver=linux opts=[allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656069 txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"xli localdevices success\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" integrationDriver=linux osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656070 txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"http request\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656071 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=schema-validator route=volumeInspect server=jewel-hugger-sc time=1525378656071 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=storage-session-handler route=volumeInspect server=jewel-hugger-sc time=1525378656071 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-svc-handler route=volumeInspect server=jewel-hugger-sc time=1525378656071 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=service-validator route=volumeInspect server=jewel-hugger-sc time=1525378656072 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=volumeInspect server=jewel-hugger-sc time=1525378656072 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=local-devices-handler route=volumeInspect server=jewel-hugger-sc time=1525378656072 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=instanceIDs-handler route=volumeInspect server=jewel-hugger-sc time=1525378656072 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-global-handler route=volumeInspect server=jewel-hugger-sc time=1525378656072 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=error-handler route=volumeInspect server=jewel-hugger-sc time=1525378656072 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=volumeInspect server=jewel-hugger-sc time=1525378656073 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=query-params-handler route=volumeInspect server=jewel-hugger-sc time=1525378656073 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=attachments len(value)=1 route=volumeInspect server=jewel-hugger-sc time=1525378656073 tls=false value=[0] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=byName len(value)=1 route=volumeInspect server=jewel-hugger-sc time=1525378656073 tls=false value=[] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Tx=\"txID=964c1c04-b67d-4136-4a4c-f48be8928f4f, txCR=1525378656\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656073 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"skipping global auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656073 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Instanceid=[s3fs=coreos_clamav01] host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656073 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Localdevices=[s3fs=] host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656074 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting storage service\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc service=s3fs time=1525378656074 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"skipping svc auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656074 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"driver is not StorageDriverWithLogin\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656074 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting task service\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656074 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting task service\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656075 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"executing task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656075 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"driver is not StorageDriverVolInspectByName\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656076 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting s3 service connection\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" region=us-east-1 route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656076 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"got existing s3 service connection\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" region=us-east-1 route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656076 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"DEBUG: Request s3/ListBuckets Details:\n---[ REQUEST POST-SIGN ]-----------------------------\nGET / HTTP/1.1\r\nHost: 172.19.64.12:9000\r\nUser-Agent: aws-sdk-go/1.12.46 (go1.9.1; linux; amd64)\r\nAuthorization: AWS4-HMAC-SHA256 Credential=5A73SJ5G3AX6NJBLDDVP/20180503/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=c9b73fbe197c4e9bb3766765580e76cb806970ab925a7eede47316ce666e36f1\r\nX-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855\r\nX-Amz-Date: 20180503T201736Z\r\nAccept-Encoding: gzip\r\n\r\n\n-----------------------------------------------------\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"DEBUG: Response s3/ListBuckets Details:\n---[ RESPONSE ]--------------------------------------\nHTTP/1.1 200 OK\r\nTransfer-Encoding: chunked\r\nAccept-Ranges: bytes\r\nContent-Security-Policy: block-all-mixed-content\r\nContent-Type: application/xml\r\nDate: Thu, 03 May 2018 20:17:36 GMT\r\nServer: Minio/RELEASE.2018-04-19T22-54-58Z (linux; amd64)\r\nVary: Origin\r\nX-Amz-Request-Id: 152B3BCE4F3B0302\r\nX-Xss-Protection: \\"1; mode=block\\"\r\n\r\n\n-----------------------------------------------------\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"\n02d6176db174dc93cb1b899f7c6078f08654445fe8cf1b6ce98d8855f66bdbf4backup2018-04-26T17:00:54.000Zinternos-db2018-04-24T14:12:38.000Zminio-volume2018-05-03T16:58:44.000Ztest2018-05-03T17:15:27.000Ztickets-uploads2018-05-03T06:45:03.000Ztraefik-configs2018-05-03T06:15:02.000Z\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"skipping response schema validation; disabled\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656090 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"task completed\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656091 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"volume inspected\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux service=s3fs storageDriver=libstorage time=1525378656091 volume=&{test map[server:s3fs name:test size:0 iops:0 type: availabilityZone: fields:map[] service:s3fs]} volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"removing task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" removedAfter=0s route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 tasksLen=1 time=1525378656093 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"removed task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 tasksLen=0 time=1525378656094 tls=false txCR=1525378656 txID=964c1c04-b67d-4136-4a4c-f48be8928f4f " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"Entering go-plugins-helpers mountPath\" time=1525378656596 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"mounting volume\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=&{false false } osDriver=linux service=s3fs storageDriver=libstorage time=1525378656601 volumeID= volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"mounting volume\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=&{false false } osDriver=linux service=s3fs storageDriver=libstorage time=1525378656601 volumeID= volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"storage executor initialized\" cmd=s3fs driver=s3fs host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" integrationDriver=linux opts=[allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656608 txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"xli localdevices success\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" integrationDriver=linux osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656609 txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"http request\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656609 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=schema-validator route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=storage-session-handler route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-svc-handler route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=service-validator route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=local-devices-handler route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=instanceIDs-handler route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-global-handler route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=error-handler route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=query-params-handler route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=attachments len(value)=1 route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false value=[31] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=byName len(value)=1 route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false value=[] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Tx=\"txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1, txCR=1525378656\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656610 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"skipping global auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656611 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Instanceid=[s3fs=coreos_clamav01] host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656611 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Localdevices=[s3fs=] host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656611 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting storage service\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc service=s3fs time=1525378656611 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"skipping svc auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656611 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"driver is not StorageDriverWithLogin\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656611 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting task service\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656611 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"executing task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656613 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"driver is not StorageDriverVolInspectByName\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656613 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting s3 service connection\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" region=us-east-1 route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656613 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"got existing s3 service connection\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" region=us-east-1 route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656614 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"DEBUG: Request s3/ListBuckets Details:\n---[ REQUEST POST-SIGN ]-----------------------------\nGET / HTTP/1.1\r\nHost: 172.19.64.12:9000\r\nUser-Agent: aws-sdk-go/1.12.46 (go1.9.1; linux; amd64)\r\nAuthorization: AWS4-HMAC-SHA256 Credential=5A73SJ5G3AX6NJBLDDVP/20180503/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=c9b73fbe197c4e9bb3766765580e76cb806970ab925a7eede47316ce666e36f1\r\nX-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855\r\nX-Amz-Date: 20180503T201736Z\r\nAccept-Encoding: gzip\r\n\r\n\n-----------------------------------------------------\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting task service\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656615 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"DEBUG: Response s3/ListBuckets Details:\n---[ RESPONSE ]--------------------------------------\nHTTP/1.1 200 OK\r\nTransfer-Encoding: chunked\r\nAccept-Ranges: bytes\r\nContent-Security-Policy: block-all-mixed-content\r\nContent-Type: application/xml\r\nDate: Thu, 03 May 2018 20:17:36 GMT\r\nServer: Minio/RELEASE.2018-04-19T22-54-58Z (linux; amd64)\r\nVary: Origin\r\nX-Amz-Request-Id: 152B3BCE6F5BCAE1\r\nX-Xss-Protection: \\"1; mode=block\\"\r\n\r\n\n-----------------------------------------------------\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"\n02d6176db174dc93cb1b899f7c6078f08654445fe8cf1b6ce98d8855f66bdbf4backup2018-04-26T17:00:54.000Zinternos-db2018-04-24T14:12:38.000Zminio-volume2018-05-03T16:58:44.000Ztest2018-05-03T17:15:27.000Ztickets-uploads2018-05-03T06:45:03.000Ztraefik-configs2018-05-03T06:15:02.000Z\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"manually calculating attachment state\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656628 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"including volume\" attachmentState=attached host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656629 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"skipping response schema validation; disabled\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656629 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"task completed\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656629 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"http request\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378656631 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=schema-validator route=serviceInspect server=jewel-hugger-sc time=1525378656631 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"removing task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" removedAfter=0s route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 tasksLen=1 time=1525378656632 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"removed task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 tasksLen=0 time=1525378656633 tls=false txCR=1525378656 txID=516a34e8-cf3e-4888-7533-8a70ca4a36a1 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-svc-handler route=serviceInspect server=jewel-hugger-sc time=1525378656632 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=service-validator route=serviceInspect server=jewel-hugger-sc time=1525378656633 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=serviceInspect server=jewel-hugger-sc time=1525378656634 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=local-devices-handler route=serviceInspect server=jewel-hugger-sc time=1525378656635 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=instanceIDs-handler route=serviceInspect server=jewel-hugger-sc time=1525378656635 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-global-handler route=serviceInspect server=jewel-hugger-sc time=1525378656635 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=error-handler route=serviceInspect server=jewel-hugger-sc time=1525378656636 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=serviceInspect server=jewel-hugger-sc time=1525378656636 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=query-params-handler route=serviceInspect server=jewel-hugger-sc time=1525378656636 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=instance len(value)=1 route=serviceInspect server=jewel-hugger-sc time=1525378656636 tls=false value=[] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Tx=\"txID=5bec52cb-1a96-4479-6b7a-c3efa70f2023, txCR=1525378656\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378656637 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"skipping global auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378656637 tls=false txCR=1525378656 txID=5bec52cb-1a96-4479-6b7a-c3efa70f2023 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Instanceid=[s3fs=coreos_clamav01] host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378656637 tls=false txCR=1525378656 txID=5bec52cb-1a96-4479-6b7a-c3efa70f2023 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Localdevices=[] host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378656638 tls=false txCR=1525378656 txID=5bec52cb-1a96-4479-6b7a-c3efa70f2023 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting storage service\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc service=s3fs time=1525378656638 tls=false txCR=1525378656 txID=5bec52cb-1a96-4479-6b7a-c3efa70f2023 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"skipping svc auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=serviceInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656638 tls=false txCR=1525378656 txID=5bec52cb-1a96-4479-6b7a-c3efa70f2023 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"storage executor initialized\" cmd=s3fs driver=s3fs host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=[allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656649 txCR=1525378656 txID=66abda95-ed0f-4b2c-46dd-49c9dc3a6388 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"xli mounts success\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656650 txCR=1525378656 txID=66abda95-ed0f-4b2c-46dd-49c9dc3a6388 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"storage executor initialized\" cmd=s3fs driver=s3fs host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=[allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656664 txCR=1525378656 txID=94f7d530-9467-49ab-79f8-2dd2e1c02fc6 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"attempting s3fs mount\" args=[test /var/lib/rexray/volumes/test -oallow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] bucket=test cmd=s3fs host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux isAWSAuthEnvVars=true mountPoint=\"/var/lib/rexray/volumes/test\" osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656672 txCR=1525378656 txID=94f7d530-9467-49ab-79f8-2dd2e1c02fc6 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"xli mount success\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656686 txCR=1525378656 txID=94f7d530-9467-49ab-79f8-2dd2e1c02fc6 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"volume mounted\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux mntPath=\"/var/lib/rexray/volumes/test/data\" osDriver=linux service=s3fs storageDriver=libstorage time=1525378656811 vol=&{[0xc420144140] attached false 0 test 0 test map[]} " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"set count\" count=1 host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux service=s3fs storageDriver=libstorage time=1525378656811 volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"Entering go-plugins-helpers unmountPath\" time=1525378656945 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"unmounting volume\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=map[] osDriver=linux service=s3fs storageDriver=libstorage time=1525378656945 volumeID= volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"count reset\" count=1 host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux service=s3fs storageDriver=libstorage time=1525378656965 volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"init count\" count=0 host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux service=s3fs storageDriver=libstorage time=1525378656965 volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"unmounting volume\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=map[] osDriver=linux service=s3fs storageDriver=libstorage time=1525378656965 volumeID= volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"storage executor initialized\" cmd=s3fs driver=s3fs host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" integrationDriver=linux opts=[allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656977 txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"xli localdevices success\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" integrationDriver=linux osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378656978 txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"http request\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656979 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=schema-validator route=volumeInspect server=jewel-hugger-sc time=1525378656980 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=storage-session-handler route=volumeInspect server=jewel-hugger-sc time=1525378656980 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-svc-handler route=volumeInspect server=jewel-hugger-sc time=1525378656981 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=service-validator route=volumeInspect server=jewel-hugger-sc time=1525378656981 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=volumeInspect server=jewel-hugger-sc time=1525378656982 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=local-devices-handler route=volumeInspect server=jewel-hugger-sc time=1525378656982 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=instanceIDs-handler route=volumeInspect server=jewel-hugger-sc time=1525378656983 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-global-handler route=volumeInspect server=jewel-hugger-sc time=1525378656983 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=error-handler route=volumeInspect server=jewel-hugger-sc time=1525378656984 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=volumeInspect server=jewel-hugger-sc time=1525378656984 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=query-params-handler route=volumeInspect server=jewel-hugger-sc time=1525378656985 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=attachments len(value)=1 route=volumeInspect server=jewel-hugger-sc time=1525378656985 tls=false value=[15] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=byName len(value)=1 route=volumeInspect server=jewel-hugger-sc time=1525378656985 tls=false value=[] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Tx=\"txID=76334b98-b219-4aa8-5074-b65c70fd0244, txCR=1525378656\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656986 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"skipping global auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656986 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Instanceid=[s3fs=coreos_clamav01] host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656986 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"http header\" Libstorage-Localdevices=[s3fs=test::/var/lib/rexray/volumes/test] host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378656986 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting storage service\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc service=s3fs time=1525378656987 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"skipping svc auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656987 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"driver is not StorageDriverWithLogin\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656987 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting task service\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656988 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting task service\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378656989 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=info msg=\"executing task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656989 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"driver is not StorageDriverVolInspectByName\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656989 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"getting s3 service connection\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" region=us-east-1 route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656990 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"got existing s3 service connection\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" region=us-east-1 route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378656990 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:36 coreos_clamav01 env[815]: time="2018-05-03T17:17:36-03:00" level=error msg="time=\"2018-05-03T20:17:36Z\" level=debug msg=\"DEBUG: Request s3/ListBuckets Details:\n---[ REQUEST POST-SIGN ]-----------------------------\nGET / HTTP/1.1\r\nHost: 172.19.64.12:9000\r\nUser-Agent: aws-sdk-go/1.12.46 (go1.9.1; linux; amd64)\r\nAuthorization: AWS4-HMAC-SHA256 Credential=5A73SJ5G3AX6NJBLDDVP/20180503/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=c9b73fbe197c4e9bb3766765580e76cb806970ab925a7eede47316ce666e36f1\r\nX-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855\r\nX-Amz-Date: 20180503T201736Z\r\nAccept-Encoding: gzip\r\n\r\n\n-----------------------------------------------------\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"DEBUG: Response s3/ListBuckets Details:\n---[ RESPONSE ]--------------------------------------\nHTTP/1.1 200 OK\r\nTransfer-Encoding: chunked\r\nAccept-Ranges: bytes\r\nContent-Security-Policy: block-all-mixed-content\r\nContent-Type: application/xml\r\nDate: Thu, 03 May 2018 20:17:36 GMT\r\nServer: Minio/RELEASE.2018-04-19T22-54-58Z (linux; amd64)\r\nVary: Origin\r\nX-Amz-Request-Id: 152B3BCE85C5D0CB\r\nX-Xss-Protection: \\"1; mode=block\\"\r\n\r\n\n-----------------------------------------------------\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"\n02d6176db174dc93cb1b899f7c6078f08654445fe8cf1b6ce98d8855f66bdbf4backup2018-04-26T17:00:54.000Zinternos-db2018-04-24T14:12:38.000Zminio-volume2018-05-03T16:58:44.000Ztest2018-05-03T17:15:27.000Ztickets-uploads2018-05-03T06:45:03.000Ztraefik-configs2018-05-03T06:15:02.000Z\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"manually calculating attachment state\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657004 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"including volume\" attachmentState=attached host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657005 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping response schema validation; disabled\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657005 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"task completed\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657006 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=info msg=\"http request\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378657007 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=schema-validator route=serviceInspect server=jewel-hugger-sc time=1525378657008 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-svc-handler route=serviceInspect server=jewel-hugger-sc time=1525378657008 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"removing task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" removedAfter=0s route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 tasksLen=1 time=1525378657009 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=service-validator route=serviceInspect server=jewel-hugger-sc time=1525378657009 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=serviceInspect server=jewel-hugger-sc time=1525378657009 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=local-devices-handler route=serviceInspect server=jewel-hugger-sc time=1525378657009 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=instanceIDs-handler route=serviceInspect server=jewel-hugger-sc time=1525378657010 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-global-handler route=serviceInspect server=jewel-hugger-sc time=1525378657010 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=error-handler route=serviceInspect server=jewel-hugger-sc time=1525378657010 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=serviceInspect server=jewel-hugger-sc time=1525378657010 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=query-params-handler route=serviceInspect server=jewel-hugger-sc time=1525378657010 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=instance len(value)=1 route=serviceInspect server=jewel-hugger-sc time=1525378657011 tls=false value=[] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Tx=\"txID=2ec3d47e-280b-42b4-4250-0867b5429016, txCR=1525378657\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378657011 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping global auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378657011 tls=false txCR=1525378657 txID=2ec3d47e-280b-42b4-4250-0867b5429016 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Instanceid=[s3fs=coreos_clamav01] host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378657011 tls=false txCR=1525378657 txID=2ec3d47e-280b-42b4-4250-0867b5429016 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Localdevices=[] host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378657011 tls=false txCR=1525378657 txID=2ec3d47e-280b-42b4-4250-0867b5429016 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"getting storage service\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc service=s3fs time=1525378657013 tls=false txCR=1525378657 txID=2ec3d47e-280b-42b4-4250-0867b5429016 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping svc auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=serviceInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657013 tls=false txCR=1525378657 txID=2ec3d47e-280b-42b4-4250-0867b5429016 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"removed task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 tasksLen=0 time=1525378657009 tls=false txCR=1525378656 txID=76334b98-b219-4aa8-5074-b65c70fd0244 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"storage executor initialized\" cmd=s3fs driver=s3fs host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=[allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378657023 txCR=1525378657 txID=1e6ab4f0-98c5-446d-49bd-ed301065b9ba " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"xli mounts success\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378657024 txCR=1525378657 txID=1e6ab4f0-98c5-446d-49bd-ed301065b9ba " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"retrieved mount\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux mount=&{0 0 0 0 /var/lib/rexray/volumes/test test map[]} osDriver=linux service=s3fs storageDriver=libstorage time=1525378657024 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"unmounting mount point\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux mount=&{0 0 0 0 /var/lib/rexray/volumes/test test map[]} osDriver=linux service=s3fs storageDriver=libstorage time=1525378657024 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"storage executor initialized\" cmd=s3fs driver=s3fs host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" integrationDriver=linux opts=[allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378657045 txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"xli localdevices success\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" integrationDriver=linux osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378657046 txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=info msg=\"http request\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeDetach server=jewel-hugger-sc time=1525378657047 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=post-args-handler route=volumeDetach server=jewel-hugger-sc time=1525378657047 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=schema-validator route=volumeDetach server=jewel-hugger-sc time=1525378657047 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=storage-session-handler route=volumeDetach server=jewel-hugger-sc time=1525378657047 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-svc-handler route=volumeDetach server=jewel-hugger-sc time=1525378657047 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=service-validator route=volumeDetach server=jewel-hugger-sc time=1525378657047 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=volumeDetach server=jewel-hugger-sc time=1525378657047 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=local-devices-handler route=volumeDetach server=jewel-hugger-sc time=1525378657047 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=instanceIDs-handler route=volumeDetach server=jewel-hugger-sc time=1525378657048 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-global-handler route=volumeDetach server=jewel-hugger-sc time=1525378657048 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=error-handler route=volumeDetach server=jewel-hugger-sc time=1525378657048 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=volumeDetach server=jewel-hugger-sc time=1525378657048 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=query-params-handler route=volumeDetach server=jewel-hugger-sc time=1525378657048 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=detach len(value)=1 route=volumeDetach server=jewel-hugger-sc time=1525378657048 tls=false value=[] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Tx=\"txID=0e448e68-0d6e-4750-47f9-1228114077a7, txCR=1525378657\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeDetach server=jewel-hugger-sc time=1525378657048 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping global auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeDetach server=jewel-hugger-sc time=1525378657049 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Instanceid=[s3fs=coreos_clamav01] host=\"unix:///var/run/rexray/297453479.sock\" route=volumeDetach server=jewel-hugger-sc time=1525378657049 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Localdevices=[s3fs=] host=\"unix:///var/run/rexray/297453479.sock\" route=volumeDetach server=jewel-hugger-sc time=1525378657050 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"getting storage service\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeDetach server=jewel-hugger-sc service=s3fs time=1525378657050 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping svc auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657050 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"driver is not StorageDriverWithLogin\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657050 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"validating schema\" body=\"{}\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeDetach schema=\"{\n \\"$schema\\": \\"http://json-schema.org/draft-04/schema#md5-a446b6de9c5cf6d70845465aea9f976a\",\n \\"$ref\\": \\"https://github.com/rexray/libstorage#/definitions/volumeDetachRequestmd5-a446b6de9c5cf6d70845465aea9f976a\"\n}\" server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657050 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"getting task service\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657053 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"getting task service\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657054 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=info msg=\"executing task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657054 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"getting s3 service connection\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" region=us-east-1 route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657054 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"got existing s3 service connection\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" region=us-east-1 route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657055 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"DEBUG: Request s3/HeadBucket Details:\n---[ REQUEST POST-SIGN ]-----------------------------\nHEAD /test HTTP/1.1\r\nHost: 172.19.64.12:9000\r\nUser-Agent: aws-sdk-go/1.12.46 (go1.9.1; linux; amd64)\r\nAuthorization: AWS4-HMAC-SHA256 Credential=5A73SJ5G3AX6NJBLDDVP/20180503/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=4a17a72647b726e89e835515711169075ddde58a38b1e784da9ca59064b5595f\r\nX-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855\r\nX-Amz-Date: 20180503T201737Z\r\n\r\n\n-----------------------------------------------------\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"DEBUG: Response s3/HeadBucket Details:\n---[ RESPONSE ]--------------------------------------\nHTTP/1.1 200 OK\r\nConnection: close\r\nAccept-Ranges: bytes\r\nContent-Security-Policy: block-all-mixed-content\r\nDate: Thu, 03 May 2018 20:17:37 GMT\r\nServer: Minio/RELEASE.2018-04-19T22-54-58Z (linux; amd64)\r\nVary: Origin\r\nX-Amz-Request-Id: 152B3BCE899C989C\r\nX-Xss-Protection: \\"1; mode=block\\"\r\n\r\n\n-----------------------------------------------------\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping response schema validation; schema == nil\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657067 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"task completed\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657068 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=info msg=\"unmounted and detached volume\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux service=s3fs storageDriver=libstorage time=1525378657069 vol=&{[0xc420145540] available false 0 test 0 test map[]} " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"removing task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" removedAfter=0s route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 tasksLen=1 time=1525378657070 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"removed task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeDetach server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 tasksLen=0 time=1525378657077 tls=false txCR=1525378657 txID=0e448e68-0d6e-4750-47f9-1228114077a7 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 systemd-udevd[19465]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
May 03 17:17:37 coreos_clamav01 kernel: docker0: port 1(veth632b8b8) entered blocking state
May 03 17:17:37 coreos_clamav01 kernel: docker0: port 1(veth632b8b8) entered disabled state
May 03 17:17:37 coreos_clamav01 systemd-udevd[19465]: Could not generate persistent MAC address for veth21a31a9: No such file or directory
May 03 17:17:37 coreos_clamav01 kernel: device veth632b8b8 entered promiscuous mode
May 03 17:17:37 coreos_clamav01 kernel: IPv6: ADDRCONF(NETDEV_UP): veth632b8b8: link is not ready
May 03 17:17:37 coreos_clamav01 systemd-timesyncd[594]: Network configuration changed, trying to establish connection.
May 03 17:17:37 coreos_clamav01 systemd-timesyncd[594]: Synchronized to time server 190.228.30.178:123 (2.coreos.pool.ntp.org).
May 03 17:17:37 coreos_clamav01 systemd-udevd[19466]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
May 03 17:17:37 coreos_clamav01 systemd-udevd[19466]: Could not generate persistent MAC address for veth632b8b8: No such file or directory
May 03 17:17:37 coreos_clamav01 systemd-timesyncd[594]: Network configuration changed, trying to establish connection.
May 03 17:17:37 coreos_clamav01 systemd-timesyncd[594]: Synchronized to time server 190.228.30.178:123 (2.coreos.pool.ntp.org).
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=info msg=\"Entering go-plugins-helpers mountPath\" time=1525378657939 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"mounting volume\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=&{false false } osDriver=linux service=s3fs storageDriver=libstorage time=1525378657950 volumeID= volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=info msg=\"mounting volume\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=&{false false } osDriver=linux service=s3fs storageDriver=libstorage time=1525378657950 volumeID= volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"storage executor initialized\" cmd=s3fs driver=s3fs host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" integrationDriver=linux opts=[allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378657957 txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"xli localdevices success\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" integrationDriver=linux osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378657958 txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=info msg=\"http request\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378657959 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=schema-validator route=volumeInspect server=jewel-hugger-sc time=1525378657959 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=storage-session-handler route=volumeInspect server=jewel-hugger-sc time=1525378657959 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-svc-handler route=volumeInspect server=jewel-hugger-sc time=1525378657960 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=service-validator route=volumeInspect server=jewel-hugger-sc time=1525378657960 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=volumeInspect server=jewel-hugger-sc time=1525378657960 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=local-devices-handler route=volumeInspect server=jewel-hugger-sc time=1525378657960 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=instanceIDs-handler route=volumeInspect server=jewel-hugger-sc time=1525378657961 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-global-handler route=volumeInspect server=jewel-hugger-sc time=1525378657961 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=error-handler route=volumeInspect server=jewel-hugger-sc time=1525378657961 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=volumeInspect server=jewel-hugger-sc time=1525378657961 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=query-params-handler route=volumeInspect server=jewel-hugger-sc time=1525378657962 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=attachments len(value)=1 route=volumeInspect server=jewel-hugger-sc time=1525378657962 tls=false value=[31] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=byName len(value)=1 route=volumeInspect server=jewel-hugger-sc time=1525378657962 tls=false value=[] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Tx=\"txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266, txCR=1525378657\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378657962 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping global auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378657963 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Instanceid=[s3fs=coreos_clamav01] host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378657963 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Localdevices=[s3fs=] host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc time=1525378657963 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"getting storage service\" host=\"unix:///var/run/rexray/297453479.sock\" route=volumeInspect server=jewel-hugger-sc service=s3fs time=1525378657963 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping svc auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657964 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"driver is not StorageDriverWithLogin\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657964 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"getting task service\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657964 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=info msg=\"executing task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657964 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"driver is not StorageDriverVolInspectByName\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657965 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"getting s3 service connection\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" region=us-east-1 route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657965 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"got existing s3 service connection\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" region=us-east-1 route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657965 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"DEBUG: Request s3/ListBuckets Details:\n---[ REQUEST POST-SIGN ]-----------------------------\nGET / HTTP/1.1\r\nHost: 172.19.64.12:9000\r\nUser-Agent: aws-sdk-go/1.12.46 (go1.9.1; linux; amd64)\r\nAuthorization: AWS4-HMAC-SHA256 Credential=5A73SJ5G3AX6NJBLDDVP/20180503/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=4c7f5c73b5ea89306b91f77a40f9b6af87256ecad66a9cd82f716e4e03424f8a\r\nX-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855\r\nX-Amz-Date: 20180503T201737Z\r\nAccept-Encoding: gzip\r\n\r\n\n-----------------------------------------------------\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"getting task service\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657967 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"DEBUG: Response s3/ListBuckets Details:\n---[ RESPONSE ]--------------------------------------\nHTTP/1.1 200 OK\r\nTransfer-Encoding: chunked\r\nAccept-Ranges: bytes\r\nContent-Security-Policy: block-all-mixed-content\r\nContent-Type: application/xml\r\nDate: Thu, 03 May 2018 20:17:37 GMT\r\nServer: Minio/RELEASE.2018-04-19T22-54-58Z (linux; amd64)\r\nVary: Origin\r\nX-Amz-Request-Id: 152B3BCEBFE6CFE4\r\nX-Xss-Protection: \\"1; mode=block\\"\r\n\r\n\n-----------------------------------------------------\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"\n02d6176db174dc93cb1b899f7c6078f08654445fe8cf1b6ce98d8855f66bdbf4backup2018-04-26T17:00:54.000Zinternos-db2018-04-24T14:12:38.000Zminio-volume2018-05-03T16:58:44.000Ztest2018-05-03T17:15:27.000Ztickets-uploads2018-05-03T06:45:03.000Ztraefik-configs2018-05-03T06:15:02.000Z\" " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"manually calculating attachment state\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657979 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"including volume\" attachmentState=attached host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657979 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping response schema validation; disabled\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657980 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"task completed\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 time=1525378657980 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=info msg=\"http request\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378657983 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=schema-validator route=serviceInspect server=jewel-hugger-sc time=1525378657983 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-svc-handler route=serviceInspect server=jewel-hugger-sc time=1525378657983 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added route middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=service-validator route=serviceInspect server=jewel-hugger-sc time=1525378657984 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=serviceInspect server=jewel-hugger-sc time=1525378657984 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=local-devices-handler route=serviceInspect server=jewel-hugger-sc time=1525378657984 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=instanceIDs-handler route=serviceInspect server=jewel-hugger-sc time=1525378657984 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=auth-global-handler route=serviceInspect server=jewel-hugger-sc time=1525378657985 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=error-handler route=serviceInspect server=jewel-hugger-sc time=1525378657985 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"removing task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" removedAfter=0s route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 tasksLen=1 time=1525378657981 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"removed task\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=volumeInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs task=0 tasksLen=0 time=1525378657986 tls=false txCR=1525378657 txID=c7bd24d9-ddf8-4b15-41cc-044c2d067266 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=transaction-handler route=serviceInspect server=jewel-hugger-sc time=1525378657986 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"added global middleware\" host=\"unix:///var/run/rexray/297453479.sock\" middleware=query-params-handler route=serviceInspect server=jewel-hugger-sc time=1525378657986 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"query param\" host=\"unix:///var/run/rexray/297453479.sock\" key=instance len(value)=1 route=serviceInspect server=jewel-hugger-sc time=1525378657986 tls=false value=[] " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Tx=\"txID=d4e37c63-20aa-4e08-6816-9bb00a74942d, txCR=1525378657\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378657987 tls=false " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping global auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378657987 tls=false txCR=1525378657 txID=d4e37c63-20aa-4e08-6816-9bb00a74942d " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Instanceid=[s3fs=coreos_clamav01] host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378657987 tls=false txCR=1525378657 txID=d4e37c63-20aa-4e08-6816-9bb00a74942d " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"http header\" Libstorage-Localdevices=[] host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc time=1525378657988 tls=false txCR=1525378657 txID=d4e37c63-20aa-4e08-6816-9bb00a74942d " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"getting storage service\" host=\"unix:///var/run/rexray/297453479.sock\" route=serviceInspect server=jewel-hugger-sc service=s3fs time=1525378657988 tls=false txCR=1525378657 txID=d4e37c63-20aa-4e08-6816-9bb00a74942d " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:37 coreos_clamav01 env[815]: time="2018-05-03T17:17:37-03:00" level=error msg="time=\"2018-05-03T20:17:37Z\" level=debug msg=\"skipping svc auth handler; empty allow & deny lists\" host=\"unix:///var/run/rexray/297453479.sock\" instanceID=\"s3fs=coreos_clamav01\" route=serviceInspect server=jewel-hugger-sc service=s3fs storageDriver=s3fs time=1525378657989 tls=false txCR=1525378657 txID=d4e37c63-20aa-4e08-6816-9bb00a74942d " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:38 coreos_clamav01 env[815]: time="2018-05-03T17:17:38-03:00" level=error msg="time=\"2018-05-03T20:17:38Z\" level=debug msg=\"storage executor initialized\" cmd=s3fs driver=s3fs host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=[allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378658001 txCR=1525378657 txID=728e0fce-08e6-45dd-6c6d-1b96a8896e41 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:38 coreos_clamav01 env[815]: time="2018-05-03T17:17:38-03:00" level=error msg="time=\"2018-05-03T20:17:38Z\" level=debug msg=\"xli mounts success\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378658002 txCR=1525378657 txID=728e0fce-08e6-45dd-6c6d-1b96a8896e41 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:38 coreos_clamav01 env[815]: time="2018-05-03T17:17:38-03:00" level=error msg="time=\"2018-05-03T20:17:38Z\" level=debug msg=\"storage executor initialized\" cmd=s3fs driver=s3fs host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux opts=[allow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378658025 txCR=1525378658 txID=49f7a832-2422-49d0-4b28-589ee8ec4069 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:38 coreos_clamav01 env[815]: time="2018-05-03T17:17:38-03:00" level=error msg="time=\"2018-05-03T20:17:38Z\" level=debug msg=\"attempting s3fs mount\" args=[test /var/lib/rexray/volumes/test -oallow_other,use_path_request_style,nonempty,url=http://172.19.64.12:9000] bucket=test cmd=s3fs host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux isAWSAuthEnvVars=true mountPoint=\"/var/lib/rexray/volumes/test\" osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378658038 txCR=1525378658 txID=49f7a832-2422-49d0-4b28-589ee8ec4069 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:38 coreos_clamav01 env[815]: time="2018-05-03T17:17:38-03:00" level=error msg="time=\"2018-05-03T20:17:38Z\" level=debug msg=\"xli mount success\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux server=jewel-hugger-sc service=s3fs storageDriver=libstorage time=1525378658055 txCR=1525378658 txID=49f7a832-2422-49d0-4b28-589ee8ec4069 " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:38 coreos_clamav01 env[815]: time="2018-05-03T17:17:38-03:00" level=error msg="time=\"2018-05-03T20:17:38Z\" level=info msg=\"volume mounted\" host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux mntPath=\"/var/lib/rexray/volumes/test/data\" osDriver=linux service=s3fs storageDriver=libstorage time=1525378658183 vol=&{[0xc42037ac80] attached false 0 test 0 test map[]} " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:38 coreos_clamav01 env[815]: time="2018-05-03T17:17:38-03:00" level=error msg="time=\"2018-05-03T20:17:38Z\" level=debug msg=\"set count\" count=1 host=\"unix:///var/run/rexray/297453479.sock\" integrationDriver=linux osDriver=linux service=s3fs storageDriver=libstorage time=1525378658185 volumeName=test " plugin=edbc7cdee3ecae3b90a6a9059455461c9e8dd88f1958a89bfcf62c7889d6c80f
May 03 17:17:38 coreos_clamav01 env[805]: time="2018-05-03T17:17:38-03:00" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/38282d32b95b6935f52b160fa56a19266b5b09deef97231f82b01935826c7019/shim.sock" debug=true module="containerd/tasks" pid=19489
May 03 17:17:38 coreos_clamav01 env[805]: time="2018-05-03T17:17:38-03:00" level=debug msg="registering ttrpc server"
May 03 17:17:38 coreos_clamav01 env[805]: time="2018-05-03T17:17:38-03:00" level=debug msg="serving api on unix socket" socket="[inherited from parent]"
May 03 17:17:38 coreos_clamav01 systemd-timesyncd[594]: Network configuration changed, trying to establish connection.
May 03 17:17:38 coreos_clamav01 kernel: eth0: renamed from veth21a31a9
May 03 17:17:38 coreos_clamav01 systemd-timesyncd[594]: Synchronized to time server 190.228.30.178:123 (2.coreos.pool.ntp.org).
May 03 17:17:38 coreos_clamav01 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth632b8b8: link becomes ready
May 03 17:17:38 coreos_clamav01 kernel: docker0: port 1(veth632b8b8) entered blocking state
May 03 17:17:38 coreos_clamav01 kernel: docker0: port 1(veth632b8b8) entered forwarding state
May 03 17:17:38 coreos_clamav01 systemd-networkd[540]: veth632b8b8: Gained carrier
May 03 17:17:38 coreos_clamav01 systemd-timesyncd[594]: Network configuration changed, trying to establish connection.
May 03 17:17:38 coreos_clamav01 systemd-timesyncd[594]: Synchronized to time server 190.228.30.178:123 (2.coreos.pool.ntp.org).
May 03 17:17:39 coreos_clamav01 systemd-networkd[540]: veth632b8b8: Gained IPv6LL
May 03 17:17:39 coreos_clamav01 systemd-timesyncd[594]: Network configuration changed, trying to establish connection.
May 03 17:17:39 coreos_clamav01 systemd-timesyncd[594]: Synchronized to time server 190.228.30.178:123 (2.coreos.pool.ntp.org).

This logs are when I start de containr, I don't see any logs when I run curl

Source

diegowein

👍3 🎉1

Most helpful comment

Try adding umask=000 to S3FS_OPTIONS. It would be
"S3FS_OPTIONS=allow_other,nonempty, umask=000".

Em qui, 9 de ago de 2018 14:58, snguyen-ith notifications@github.com
escreveu:

Huh. Redeployed my stack, but now it seems I'm back to permissions issues..
{ "Type": "volume", "Name": "jenkins-devops-data", "Source":
"/var/lib/docker/plugins/4bcadc0012024a91858e67be1e031e8da7625fe23068416882b8094190a82d42/propagated-mount/volumes/jenkins-devops-data/data",
"Destination": "/var/jenkins_home", "Driver": "rexray/s3fs:latest", "Mode":
"", "RW": true, "Propagation": "" },

"Env": [ "REXRAY_LOGLEVEL=warn",
"LIBSTORAGE_INTEGRATION_VOLUME_OPERATIONS_MOUNT_ROOTPATH=",
"LINUX_VOLUME_ROOTPATH=", "LINUX_VOLUME_FILEMODE=0777", "HTTP_PROXY=",
"S3FS_ENDPOINT=", "S3FS_ACCESSKEY=XXXX", "S3FS_DISABLEPATHSTYLE=",
"S3FS_MAXRETRIES=", "S3FS_OPTIONS=allow_other,nonempty",
"S3FS_REGION=us-west-2", "S3FS_SECRETKEY=XXXX", "CSI_ENDPOINT=",
"X_CSI_DRIVER=", "X_CSI_NATIVE=false" ],

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/rexray/rexray/issues/1217#issuecomment-411843957, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABVm1zU9Mau0QOpb9FblQDjxAlZpemfSks5uPHgvgaJpZM4TxvHd
.

brunosavyofs on 18 Aug 2018

👍4

All 10 comments

I found the if I set options in S3FS_OPTIONS, it works, for example:

docker plugin set rexray/s3fs S3FS_OPTIONS="allow_other,use_path_request_style,nonempty,url=http://192.168.0.208:9000,uid=33,gid=33,umask=022"

The thing is the I want to use the driver with multiple containers, and not all of them have the same uid or umask. Is it possible to set those options thru the docker run command?

I tried this examples but without success:

docker run -d -p 80:80 \
--mount 'type=volume,volume-driver=rexray/s3fs,src=test3,target=/var/www/html/uploads,"volume-opt=S3FS_OPTIONS=uid=33"' \
test

docker run -d -p 80:80 \
--mount type=volume,volume-driver=rexray/s3fs,src=test3,target=/var/www/html/uploads,volume-opt=uid=33 \
test

docker run -d -p 80:80 \
--mount type=volume,volume-driver=rexray/s3fs,src=test3,target=/var/www/html/uploads,volume-opt=o=uid=33 \
test

diegowein on 4 May 2018

👍2

I'm interested in this also. I guess one other approach to work around these issues would be to allow a mount option to only mount a specific bucket, rather than all buckets on the server as currently works. This would mean you could have a volume plugin alias and options for buckets or servers that require e.g. a particular UID. Would also be nice in this case to be able to map a bucket to a docker volume name, or provide a prefix for the volume names, which I don't think you can currently do (everything maps directly based on bucket name). Mapping directly causes issues with existing docker volumes with similar names.

gjonespf on 24 May 2018

I'm experiencing the same issue as setting LINUX_VOLUME_FILEMODE=0755 doesn't help at all.
Version: rexray/s3fs:0.11.3

Does anyone have an idea where the manually changed permissions are stored ?
I assume somewhere in local cache ... as S3 buckets have no such attributes ?
Will they persist after local volume re-creation ?

ConstantinElse on 26 Jun 2018

I used minifs and it workd like this:

volumes:
  my-test-store:
    driver: rexray/s3fs
    name: test
    driver_opts:
      endpoint: http://localhost:9000
      access-key: admin
      secret-key: Password
      opts: cache=/tmp/my-test-store
      opts: "uid=33,gid=33"

docker plugin install --grant-all-permissions rexray/s3fs \
  S3FS_OPTIONS="allow_other,use_path_request_style,nonempty,url=http://localhost:9000" \
  S3FS_ENDPOINT="http://localhost:9000" \
  S3FS_ACCESSKEY="admin" \
  S3FS_SECRETKEY="Password"
  S3FS_OPTIONS=use_cache=/tmp

Blaiserman on 27 Jun 2018

👍2

Any resolution to this? I set LINUX_VOLUME_FILEMODE to 0777 on plugin install and now the container start and supposedly mount correctly, but none of my files are being written to S3

snguyen-ith on 9 Aug 2018

Check the docker volume ls list of volumes and make sure the volume you are targeting is owned by REX-Ray. It is likely the volume is local which means it wouldn't be saved to S3.

clintkitson on 9 Aug 2018

Try adding umask=000 to S3FS_OPTIONS. It would be
"S3FS_OPTIONS=allow_other,nonempty, umask=000".

Em qui, 9 de ago de 2018 14:58, snguyen-ith notifications@github.com
escreveu:

Huh. Redeployed my stack, but now it seems I'm back to permissions issues..
{ "Type": "volume", "Name": "jenkins-devops-data", "Source":
"/var/lib/docker/plugins/4bcadc0012024a91858e67be1e031e8da7625fe23068416882b8094190a82d42/propagated-mount/volumes/jenkins-devops-data/data",
"Destination": "/var/jenkins_home", "Driver": "rexray/s3fs:latest", "Mode":
"", "RW": true, "Propagation": "" },

"Env": [ "REXRAY_LOGLEVEL=warn",
"LIBSTORAGE_INTEGRATION_VOLUME_OPERATIONS_MOUNT_ROOTPATH=",
"LINUX_VOLUME_ROOTPATH=", "LINUX_VOLUME_FILEMODE=0777", "HTTP_PROXY=",
"S3FS_ENDPOINT=", "S3FS_ACCESSKEY=XXXX", "S3FS_DISABLEPATHSTYLE=",
"S3FS_MAXRETRIES=", "S3FS_OPTIONS=allow_other,nonempty",
"S3FS_REGION=us-west-2", "S3FS_SECRETKEY=XXXX", "CSI_ENDPOINT=",
"X_CSI_DRIVER=", "X_CSI_NATIVE=false" ],

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/rexray/rexray/issues/1217#issuecomment-411843957, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABVm1zU9Mau0QOpb9FblQDjxAlZpemfSks5uPHgvgaJpZM4TxvHd
.

brunosavyofs on 18 Aug 2018

👍4

I have been looking for a solution for over 3 months ... until I came to this umask=000 option.
Thanks brunosavyofs.
This driver is quite slow though, but for none time-critical application, this will do.
thanks, again.

lionux2 on 30 Dec 2019

😕1

Doesn't seem to be that much activity here, but I'll try anyway.

I have the same problem that the directory I mount get set as root:root even if the directory before mount was postgres:postgres

I ONLY get this problem when I run it in docker swarm!

When I just run :

docker run --rm  -it -v pg-primary-vol:/pgdata/test -e PGHOST=/tmp -e MAX_CONNECTIONS=100 -e MAX_WAL_SENDERS=5 -e PG_MODE=primary -e PG_PRIMARY_USER=primaryuser -e PG_PRIMARY_PASSWORD=password -e PG_DATABASE=testdb -e PG_USER=testuser -e PG_PASSWORD=password -e PG_PRIMARY_PORT=5432 -e PG_ROOT_PASSWORD=password crunchydata/crunchy-postgres:centos7-11.8-4.4.0

It sets the correct permissions.
I make sure that the service in swarm runs on the correct machine by setting the node.id

My settings are like this

plugin

"REXRAY_LOGLEVEL=warn",
"LIBSTORAGE_INTEGRATION_VOLUME_OPERATIONS_MOUNT_ROOTPATH=",
"LINUX_VOLUME_ROOTPATH=",
"LINUX_VOLUME_FILEMODE=0777",
"HTTP_PROXY=",
"S3FS_ENDPOINT=http://ip:port",
"S3FS_ACCESSKEY=key",
"S3FS_DISABLEPATHSTYLE=",
"S3FS_MAXRETRIES=",
"S3FS_OPTIONS=allow_other,use_path_request_style,nonempty,umask=000,url=http://ip:port",
"S3FS_REGION=eu-central-1",
"S3FS_SECRETKEY=secret",
"CSI_ENDPOINT=",
"X_CSI_DRIVER=",
"X_CSI_NATIVE=false"

docker-compose.yml

version: "3.7"

services:
  primary:
    hostname: 'primary'
    image: crunchydata/crunchy-postgres:centos7-11.8-4.4.0
    environment:
    - PGHOST=/tmp
    - MAX_CONNECTIONS=100
    - MAX_WAL_SENDERS=5
    - PG_MODE=primary
    - PG_PRIMARY_USER=primaryuser
    - PG_PRIMARY_PASSWORD=password
    - PG_DATABASE=testdb
    - PG_USER=testuser
    - PG_PASSWORD=password
    - PG_ROOT_PASSWORD=password
    - PG_PRIMARY_PORT=5432
    volumes:
    - pg-primary-vol:/pgdata/test
    networks:
    - mynet
    deploy:
      replicas: 1
      placement:
        constraints:
        - node.id == <mynodeid>

networks:
  mynet:
    external:
      name: mynet

volumes:
  pg-primary-vol:
    driver: rexray/s3fs:latest
    name: postgres-primary
    driver_opts:
      size: 1
      opts: "uid=26,gid=26"

@akutz

Maybe @brunosavyofs have any ideas?

we4sz on 29 Jul 2020

Seems to be a _little_ buggy in handling the configuration of umask, mp_mask and uid/gid fuse and fuse.s3fs options.
Here the allow_other option doesn't do anything, it is always mounted with 0700.
Although there should be a mp_umask from fuse.s3fs for the mountpoint only, this doesn't work also.
The only thing is the umask which changes every dir and file the same way. But as workaround you can run a script in the container after each start, which fixes the permissions of the mounts.

Anyone would like to pay a bounty to get some more quality and flexibility in this stuff?! :wink: