Frameworkbenchmarks: Hacktoberfest-Friendly Issues

[cjnething]

For all of our Hacktoberfest contributors looking for a great way to get started with the Framework Benchmarks project, this issue is going to be a thread to discuss beginner-friendly tasks in the project.

If you're a beginner contributor: Please feel free to ask any questions you may have on this thread. These can be about the project as a whole, how to find issues, how to create well-organized merge requests, etc.

If you're a veteran contributor: Please comment any issues you think would be a good project for beginners!

Thanks everyone, and Happy Hacktoberfest!

[cjnething]

Some ideas:

• Pick the language/framework of your choice, find a dependency that can be upgraded, and upgrade its version
• Find a part of the project that is unclear or undocumented, and add some clarity to our documentation

[Iqlaas]

Thank you @cjnething . Me a beginner contributor.

[wotta]

@cjnething I see that you use laravel 4.2 to compare but shouldn't it be better to use the latest version ?
If so should I make a new folder named laraver55 or update the existing ?

[nbrady-techempower]

@concept-core Updating the existing test would be preferable. Feel free to open a pull request with changes and ask questions there if you need any help. Thanks!

[wotta]

@nbrady-techempower I will check it out when I am home. Thanks for the answer !

[rafavinnce]

@cjnething Hi im a beginner contributor to.

[aaron-hall-7]

Submitted PR #2992 to upgrade CakePHP to 2.10.3

[garg000dhruv]

@cjnething _First-time contributor_ "to-be" over here. I'd love to help out and will take a look if I can find something.

[eliascolares]

Thanks

[nbrady-techempower]

Thanks @cjnething for hosting this and thanks everyone for contributing! Take your coats off and stay a while! :)

[flip111]

Why are languages such as C++ Rust C haskell Go sometimes much slower in the benchmarks than PHP JS Ruby Python? This is so counter intuitive that i don't get these benchmarks at all ...

What about requests/sec, latency, concurrent connections?

[msmith-techempower]

Why are languages such as C++ Rust C haskell Go sometimes much slower in the benchmarks than PHP JS Ruby Python? This is so counter intuitive that i don't get these benchmarks at all ...

I can write you a poorly performing application in any language.

[flip111]

I can write you a poorly performing application in any language.

Sure, i just expected the language to matter more than it does now .. are these frameworks really so poorly written ???

[msmith-techempower]

Sure, i just expected the language to matter more than it does now .. are these frameworks really so poorly written ???

I don't know to which tests, in particular, you refer, but the latest benchmarks (and the next round of previews as well as most of the previous runs) have C/C++/Java as the top performers. Go often does well in several tests also.

Rust is a fairly new language and so I would not expect the frameworks to have had the same amount of time to iterate their designs to increase performance, but Tokio seems to be doing very well.

I cannot speak to Haskell; it is Martian to me.

[flip111]

For example in json serialization there is api star on 6 and falcon on 12. Both python frameworks. Out perform:

• revel (GO)
• rouille (rust)
• wt (C++)
• cutelyst-pf (C++)
• play2-scala-anorm-li (Scala)
• scruffy (Scala)
• http4s (Scala)
• octopus (lua) -- did you try luaJIT by the way?
• akka-http (Scala)
• echo (Go)
• libreactor (C)
• duda i/o (C)
• nickel (Rust)
• lapus (lua)
• iron (rust)
• cpoll_cppsp (C++)

Similar things going on for other types of benchmarks

[RX14]

@flip111 Those python frameworks probably actually execute extremely little python for each request, they will essentially be benchmarking C code which does the HTTP parsing, network, and JSON. And a tiny amount of plumbing code for all those pieces written in python.

[ohsayan]

Have we tried benching against easyjson for Go? I think it might be a good performer. Thoughts?

[cjnething]

Hi @sntdevco, here is the list of the frameworks that are currently being benchmarked for Go. The project relies on community contributions for new frameworks, so feel free to open a pull request!

[pgjones]

Are there any HTTP/2 benchmarks? If not do you have any plans to add HTTP/2 benchmarking?

[bhauer]

@pgjones Not presently. I just added HTTP/2 to our list of future test types for consideration.

[MatheusRV]

This script runs on python2 or python3?

[joeyleeeeeee97]

Hi, I am trying to run some java benchmarks and found that the environment is pretty heavy to configure.
As this list showed, it goes very LONG....

I just want to run some java tests, are all these required?
Can I do something to only pick up what I need to run java benchmark?