Community: Access to CNCF AWS account

[iNikem]

Java Instrumentation SIG wants to use AWS S3 service as part of their build infrastructure (see open-telemetry/opentelemetry-java-instrumentation#490 for technical reasons). I wonder if CNCF already has an AWS account and if Otel can have access to it?

In addition, @anuraaga mentioned this:

AWS has a system for providing promotional credits to open source projects
https://aws.amazon.com/blogs/opensource/aws-promotional-credits-open-source-projects/

We're currently wondering whether CNCF's credits can be used to fund an S3 build cache. @alolita has been involved in these efforts to support OSS projects and will help check on whether that's possible. We're interested in making this happen one way or another :)

It would be awesome if Otel project could use promotional AWS credits for using AWS services. Either directly or through CNCF.

[anuraaga]

From what I understand, @mtwo is currently checking in on how to make this happen. Stay tuned :)

[mtwo]

Chatted with @alolita during the maintainers meeting. She'll get in touch with Amye at the CNCF so that we can get access to these credits.

[trask]

Hey @alolita, any update on this issue? we are keen to start using this in the Java Instrumentation project 😄, thx!

[tigrannajaryan]

Collector can also benefit from this. We need an EC2 dedicated to running performance tests.

[iNikem]

@mtwo @alolita Any updates on this?

[anuraaga]

Heard from @alolita that she is following up on this, tracking down the stakeholders on the Linux Foundation side. Hope to hear more soon, sorry it's taking so long.

[caniszczyk]

you can always reach out via the https://github.com/cncf/servicedesk in
CNCF or ping Ihor on the CNCF Slack

On Sat, Jul 11, 2020 at 1:38 AM Anuraag Agrawal [e-mail]
wrote:

Heard from @alolita https://github.com/alolita that she is following up
on this, tracking down the stakeholders on the Linux Foundation side. Hope
to hear more soon, sorry it's taking so long.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/open-telemetry/community/issues/392#issuecomment-657002058,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAPSINNYAZ6NE6JBZWUEB3R3ACH3ANCNFSM4OB7CUHA
.

--
Cheers,

Chris Aniszczyk
http://aniszczyk.org
[phone]

[trask]

Thanks @caniszczyk, that's a great resource to know about!

@iNikem, I just updated the members page in the community repo to add the Java Instrumentation project (#411), so we should be able to open Service Desk tickets for the project. Can you try to create a Service Desk account and file a ticket to request AWS access for the project?

[trask]

I heard back from Ihor that only OpenTelemetry governance committee members can file tickets with the CNCF Service Desk.

@iNikem can you check with @bogdandrutu or @ccaraman (since they are also at Splunk) to file a ticket? Or we can also ask for help in tomorrow's maintainers meeting from available governance committee members.

[iNikem]

From timezone perspective maintainer meeting will probably happen around the same time I have a chance to ask Bogdan.

[mtwo]

I'm filing a ticket on the service desk

[mtwo]

Ticket filed (not sure if everyone can get access): https://cncfservicedesk.atlassian.net/servicedesk/customer/portal/1/CNCFSD-455

[idvoretskyi]

cc @idvoretskyi

[alolita]

Thanks for filing the ticket @mtwo Will follow up on our end.

[mtwo]

Chris pointed me to the existing CNCF infrastructure lab, which runs on packet.net. Does this meet our needs?

[iNikem]

Currently I think that using S3 as a service is much easier to us than having just hardware available and then spinning Gradle cache nodes on it. Cheaper as well.

Thus I still prefer having access to AWS account/credits.

[idvoretskyi]

@iNikem can you please describe your AWS infrastructure needs with more details?

I'm a bit confused if you need the computing power (ec2), storage (s3) or both, or anything else.

Once it's done, @mtwo may submit the pricing estimate to the already opened ticket.

[iNikem]

The immediate need of java instrumentation project is S3.

[mtwo]

@tigrannajaryan @trask can you also describe your needs to @idvoretskyi ?

[trask]

@iNikem and I have the same need (for the same SIG)

[tigrannajaryan]

@idvoretskyi we need ec2's to run performance tests on. Two m5.large or m5.xlarge instances should be sufficient. Spot instances are likely OK too although it will complicate our build process if we want to make it resilient to elimination of instances.

[idvoretskyi]

@tigrannajaryan great. So please estimate the total rough AWS budget using https://calculator.aws/ and @mtwo can submit the result via the ServiceDesk.

[iNikem]

I have made a ballpark estimate for java instrumentation sig https://calculator.aws/#/estimate?id=330c7d304beb6f70d3d0ebda28930d0d53900ccc

The reality probably will be 2 times lower, but to be safe...

[tigrannajaryan]

@idvoretskyi @mtwo here is the estimation for Collector: https://calculator.aws/#/estimate?id=ae46595a2f81be82d2bb051ae2b088f4fa3aed62
This is the top of the range estimation. We may be able to save cost by using spot instance or by only keeping the instances for the duration of the tests instead of continuously or by using reserved instances.

[mtwo]

Perfect, thanks! I’ll submit this on the service desk ticket tomorrow

---

From: Tigran Najaryan [e-mail]
Sent: Wednesday, July 15, 2020 11:15:38 AM
To: open-telemetry/community [e-mail]
Cc: Morgan McLean [e-mail]; Mention [e-mail]
Subject: Re: [open-telemetry/community] Access to CNCF AWS account (#392)

@idvoretskyihttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fidvoretskyi&data=02%7C01%7C%7Cd6c2bbd8d77345b0810308d828eb13b4%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637304337389313908&sdata=z2pzuJiVcDvLoVX8CZDeDCLMnmBiiASBpDIMOy%2F%2Bvok%3D&reserved=0 @mtwohttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmtwo&data=02%7C01%7C%7Cd6c2bbd8d77345b0810308d828eb13b4%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637304337389323902&sdata=v90LkzbY7cPEG2ddRz%2BcBLIh1kIBEgCew%2BA0AI1FfMw%3D&reserved=0 here is the estimation for Collector: https://calculator.aws/#/estimate?id=ae46595a2f81be82d2bb051ae2b088f4fa3aed62https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcalculator.aws%2F%23%2Festimate%3Fid%3Dae46595a2f81be82d2bb051ae2b088f4fa3aed62&data=02%7C01%7C%7Cd6c2bbd8d77345b0810308d828eb13b4%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637304337389323902&sdata=TjWH%2B7gdqBL%2FXg7uMnNRuf1z2WWZvV9bl6FgIZW%2FL%2B0%3D&reserved=0
This is the top of the range estimation. We may be able to save cost by using spot instance or by only keeping the instances for the duration of the tests instead of continuously or by using reserved instances.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fopen-telemetry%2Fcommunity%2Fissues%2F392%23issuecomment-658923109&data=02%7C01%7C%7Cd6c2bbd8d77345b0810308d828eb13b4%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637304337389333897&sdata=cogmhTQ6j8wU1nAujkam6%2FTsxd6a1Evu2D%2Bq6IV515o%3D&reserved=0, or unsubscribehttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAAIXLK66C2LUDVXV6YZQUBTR3XW4VANCNFSM4OB7CUHA&data=02%7C01%7C%7Cd6c2bbd8d77345b0810308d828eb13b4%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637304337389333897&sdata=1nGpOENObtcvcz14uxZakHyFPKro%2BfMA4g0ICzMtzLk%3D&reserved=0.

[mtwo]

Ticket has been updated with Nikita and Tigran's estimates

[mtwo]

Update on the ticket from Ihor: they are setting this up and we should hear back in one to two weeks

[trask]

@mtwo @idvoretskyi it hasn't been quite two weeks yet, but just checking in case any update, thx!

[idvoretskyi]

@trask nothing yet, unfortunately :(

[iNikem]

@idvoretskyi @mtwo gentle ping about news

[idvoretskyi]

@iNikem still pending, but should be resolved soon. I'll keep Trask updated on the ServiceDesk ticket.

[idvoretskyi]

Update: we are unblocked on this - in touch with @mtwo via the ServiceDesk ticket on the next actions.

[mtwo]

@trask @tigrannajaryan can you share the the email addresses (email them to me) and AWS services that you want to use to access AWS? EC2 and S3 were mentioned, but I want to confirm.

[iNikem]

Just in case, @trask do you want to deal with this yourself? I in general like dealing with infra and tooling issues, so I can take over that burden from you in java-instrumentation repo. If @mtwo is comfortable with giving me the access to AWS, of course :)

[trask]

Thanks @mtwo! Please give access to @iNikem (we need S3).

[mtwo]

@iNikem what's the email address / AWS account that you'd like to use? Feel free to post it here or send it to me over gitter or email

[iNikem]

@mtwo sent an email

[mtwo]

Thanks! I'll forward this to the CNCF folks once I get account details from @tigrannajaryan's coworker

[mtwo]

I've the two account email addresses and desired AWS services to the CNCF via the ticket that I have open with them

[iNikem]

All existing requests were satisfied, thank you :)