Rocket.chat: [BUG] download/export of my data not sending email with link

[jaytat0]

Description:

Neither DOWNLOAD MY DATA nor EXPORT MY DATA under MY DATA in user's account/preferences are sending the email with link to download data file.

Steps to reproduce:

1. go to MY DATA section of account/preferences
2. click DOWNLOAD MY DATA or EXPORT MY DATA
3. at "Your data file will be generated. A link to download it will be sent to your email address when ready." click send.

Expected behavior:

email arrives with the link to download data file

Actual behavior:

no email arrives with the link to download data file

Server Setup Information:

Version of Rocket.Chat Server: 0.69.0 & repros on open.rocket.chat

[localguru]

Same here, no email arrives. EMail configuration itself is working (I get notification emails).

Logfiles on log level 2:

Download my data

Sep 25 07:28:31 testrocket testrocket[4690]: rocketchat_logger rocketchat_logger.js:278 #033[34mMeteor ➔ method#033[39m requestDataDownload -> userId: zTjbWHia5zCkPqF8f , arguments:  [ { fullExport: false } ]

export my data

Sep 25 07:28:59 testrocket testrocket[4690]: rocketchat_logger rocketchat_logger.js:278 #033[34mMeteor ➔ method#033[39m requestDataDownload -> userId: zTjbWHia5zCkPqF8f , arguments:  [ { fullExport: true } ]

Server Setup Information:

• Version of Rocket.Chat Server: 0.69.2
• Operating System: Ubuntu 16.04 LTS
• Deployment Method: bundle self build
• Number of Running Instances: 1
• DB Replicaset Oplog: yes
• NodeJS Version: v8.11.3
• MongoDB Version: 3.4.17

[localguru]

Update: email was set 4 hours later, okay, but the I can't download the file: file not found.

The URL looks like this:

https://domain.de/ufs/GridFS:UserDataFiles/k5oD6yhBrbFdBaw4g/2018-09-25-Local%2520Admin.zip

RC is running behind a Nginx reverse proxy.

[jthomae1]

+1

No email was send. Even not after a couple of hours.

Server Setup Information:

• Version of Rocket.Chat Server: 0.69.2
• Operating System: Ubuntu 14.04.5 LTS
• Number of Running Instances: 1
• NodeJS Version: v8.11.3
• MongoDB Version: 3.4

[sampaiodiego]

@localguru just to make sure, were you using GridFS as your storage provider?

also, this process is indeed done in a very pace way, to not harm the server.. it's split in many different steps, done one-by-one on 15 minutes (by default) interval and only 100 messages (by default) batches..

[localguru]

@sampaiodiego Diego, I'm running RC from tar ball, all data is located in local mongodb. Both RC and mongo are running on the same box.

[sampaiodiego]

thanks @localguru but what I meant was the setting on the Admin panel under File Upload section, what is the value for Storage Type? I'm asking this because the link you sent is for a GridFS storage type, so I wanted to make sure the link was generated correctly.

[localguru]

@sampaiodiego I understand. These are my settings:

[protist]

My storage type is FileSystem, but I'm not getting the email either. All other emails are working.

If I set Administration > User Data Download > System Path (Exported Files) and System Path (Compressed File) to, say, /tmp, then should I be able to get the files from there, even if I don't receive the email notification? I don't see anything obvious in /tmp, so presumably the initial export stage isn't working either.

I do see the following directory structure, but apart from the sockets, it's only empty directories.

$ sudo tree /tmp/snap.rocketchat-server
/tmp/snap.rocketchat-server
└── tmp
    ├── mongodb-27017.sock
    ├── rocketchat-importer
    ├── ufs
    └── wHq2mJ9qY7obmGmvH
        ├── full
        │   └── assets
        └── partial
            └── assets

8 directories, 1 file

My File Upload location at /var/snap/rocketchat-server/common/upload also contains nothing relevant.

[geekgonecrazy]

Does this still happen? Do you see any logs to indicate the export has actually ever finished?

[sampaiodiego]

the process can take a long time to export like many thousands of messages as it is done in chunks, so keep that in mind.

the size of the chunks and frequency it runs can be tweaked on menu User Data Download of the Admin

[protist]

the process can take a long time to export like many thousands of messages as it is done in chunks, so keep that in mind.

I tested exporting almost immediately after installing Rocket.chat, with only ~6 messages present, and it still failed.

[github-actions[bot]]

This issue has been marked as stale because there has been no further activity in the last 10 days. If the issue remains stale for the next 4 days (a total of two weeks with no activity), then it will be assumed that the question has been resolved and the issue will be automatically closed.

[protist]

Mandatory spam to feed the bot. (I replied almost immediately, so the tag(s) can be removed.)

[github-actions[bot]]

This issue has been marked as stale because there has been no further activity in the last 10 days. If the issue remains stale for the next 4 days (a total of two weeks with no activity), then it will be assumed that the question has been resolved and the issue will be automatically closed.

[protist]

More spam to feed the bot 😕

[sampaiodiego]

sorry about that @protist .. but we really need more details on this to be able to work on a fix..

it definitely works for me in a clean installation when I try it.

maybe you can give full details of your setup and the actions you make to test the feature so we can to reproduce? like all the commands you do to install the server application, then describe the actions you do on the UI to start the export, then feed us with as most logs as you can.

[github-actions[bot]]

This issue has been marked as stale because there has been no further activity in the last 10 days. If the issue remains stale for the next 4 days (a total of two weeks with no activity), then it will be assumed that the question has been resolved and the issue will be automatically closed.

[jthomae1]

I can only repeat my comment from 1. October 2018:

No email was sent. Even not after a couple of hours. On three different servers!
In between I tested it with a lot of earlier versions. The export never worked.

Server Setup Information:

Version of Rocket.Chat Server: 3.7.1
Operating System: Ubuntu 16.04.7 LTS
Number of Running Instances: 1 (4 and 18 on 2 other servers)
NodeJS Version: v12.18.4
MongoDB Version: 4.0.13 (3.6.14 and 3.6.16 on 2 other servers)

[github-actions[bot]]

This issue has been marked as stale because there has been no further activity in the last 10 days. If the issue remains stale for the next 4 days (a total of two weeks with no activity), then it will be assumed that the question has been resolved and the issue will be automatically closed.

[protist]

sorry about that @protist .. but we really need more details on this to be able to work on a fix..

it definitely works for me in a clean installation when I try it.

maybe you can give full details of your setup and the actions you make to test the feature so we can to reproduce? like all the commands you do to install the server application, then describe the actions you do on the UI to start the export, then feed us with as most logs as you can.

@sampaiodiego I realised that because I'm running a 32-bit server, I'm stuck on an old version of Rocket.chat (1.3.2) so I'm not sure how useful troubleshooting will be. Nevertheless, it was a pretty standard install via snap. I can give you more details and logs if my version isn't too old for you to comment on.

[sampaiodiego]

hi @protist .. version 1.3.2 is definitely too old now, a lot of work have been done on this feature since then.

I didn't know we had different version for 32 and 64 bits of the snaps.. is that still a thing @LuluGO @geekgonecrazy ? @protist can you maybe try using a different snap channel? see https://forums.rocket.chat/t/introducing-snap-tracks/5890
if doing anything with sensitive data, please don't forget to backup https://docs.rocket.chat/installation/snaps#how-do-i-backup-my-snap-data

[protist]

I didn't know we had different version for 32 and 64 bits of the snaps.. is that still a thing

Yep, unfortunately 32-bit is stuck at 1.3.2: https://github.com/RocketChat/Rocket.Chat.Embedded.armhf

[sampaiodiego]

oh, you're running on arm 🤔 @Sing-Li is there anything you help us here?

[github-actions[bot]]

This issue has been marked as stale because there has been no further activity in the last 10 days. If the issue remains stale for the next 4 days (a total of two weeks with no activity), then it will be assumed that the question has been resolved and the issue will be automatically closed.

[jthomae1]

The issue still exists as I mentioned in my last comment

[geekgonecrazy]

Yeah the issue isn't actually Rocket.Chat on 32bit. Mongo dropped support for 32bit architecture and no longer build 32bit copies.

So while on 32 bit you are stuck on 1.3.2 the next version of Rocket.Chat drops support for the last working version of mongo for 32bit. This is for a couple of reasons. We can't support versions of mongo that mongo doesn't. Also we started using features only in the newer versions of mongo.

How many of you experience this on latest version of Rocket.Chat? 3.8.1? If so do you have installation method and steps to reproduce?

[jthomae1]

I will test it on 3.8.2 soon. We are using docker-compose setups on all three systems. But they are somewhat different from each other. The simplest has only one RC instance with a mongo db container.

[github-actions[bot]]

This issue has been marked as stale because there has been no further activity in the last 10 days. If the issue remains stale for the next 4 days (a total of two weeks with no activity), then it will be assumed that the question has been resolved and the issue will be automatically closed.

[jthomae1]

Please reopen this issue, we are testing version 3.8.2 now and the issue still exists.

[sampaiodiego]

I've reopened and remove the labels causing it to be automatically closed.

@jthomae1 please give us more details as soon as you have. thx