Would I be able to use this to move a file _directly_ from FTP server to S3 without storing at disk at any point? Thanks.
question
lbrent2k
>All comments
There is already a component to write to S3. It writes on the fly, and does not require you to store data locally. However, the data doesn't move from FTP _directly_ to S3: it goes through the machine running smart_open first.
The other hurdle is that currently smart_open does not read from FTP (see issue #33).
mpenkov
on 24 Nov 2017
👍2
Was this page helpful?
0 / 5 - 0 ratings
Related issues
ivan-yankovyi
路
4Comments
gelioz
路
5Comments
dmcguire81
路
5Comments
menshikh-iv
路
5Comments
michelazzo
路
3Comments
Most helpful comment
There is already a component to write to S3. It writes on the fly, and does not require you to store data locally. However, the data doesn't move from FTP _directly_ to S3: it goes through the machine running smart_open first.
The other hurdle is that currently smart_open does not read from FTP (see issue #33).