Vector: New `mongodb` sink

[jogster]

Hi are there any plans to support mongo as a sink? This will also work for AWS DocumentDB as it uses the same driver.

[LucioFranco]

Hey, @saghm any ideas of what we should do here? :)

[saghm]

Hello! I'm not super familiar with how it would need to be implemented, but my guess is that you'd want to wrap the Rust driver that we'll be releasing really soon.

That being said, MongoDB drivers don't officially support being used with DocumentDB; the claim of them working is on Amazon's end, so we can't guarantee anything about whether it will work or not. I can definitely help with any questions you have about the driver once it's released or using MongoDB proper though!

[LucioFranco]

@saghm perfect! I assume we can just wrap the driver's sync calls in a blocking annotation. And we can wait for the new "official" driver to come out. Thanks for the advice!

[jogster]

Thanks guys, great news I look forward to this.

Just some background...
I currently use MongoDB for local development (fundamental to the Meteor javascript framework I am using) and AWS DocumentDB for production.

They work interchangeably because the 3.6 version of the API is OpenSource. It does not however work with the 4.0+ version as this is proprietary - in a nutshell, MongoDB implemented ACID transactions and other features to complete with Enterprise DB's such as Oracle.

[stennie]

@jogster To be clear, AWS DocumentDB is an independent implementation and does not share any underlying server code with MongoDB. DocumentDB's implementation differs in terms of features and compatibility from actual MongoDB (including 3.6): https://www.isdocumentdbreallymongodb.com. DocumentDB's 3.6 API support is only an indication of their wire protocol support; they do not implement the complete MongoDB server API.

The source for DocumentDB is currently not available. MongoDB did change the license from AGPL to SSP for all server versions released on or after Oct 16, 2018 but the community server source (including transactions) is still available on https://github.com/mongodb/mongo. The SSPL FAQ addresses common questions/concerns about the licensing change.

It is great if the MongoDB driver works with DocumentDB for your use cases, I just wanted to flag that DocumentDB is not a compatible replacement for MongoDB.

[jogster]

Actually I had not realised that there was an incomparability, between the two implementations as my applications just worked and I did not need to investigate any further.

Good to know as I develop my apps.