Freqtrade: Hyperopt and Backtesting not even close results.

Created on 19 Mar 2020  Â·  3Comments  Â·  Source: freqtrade/freqtrade

Step 1: Have you search for this issue before posting it?

Yes

Step 2: Describe your environment

  • Operating system: Ubuntu 18.04 Bionic Beaver
  • Python Version: 3.6.9
  • CCXT version: ccxt==1.21.91
  • Branch: Develop
  • Last Commit ID: _____ (git log --format="%H" -n 1)

Step 3: Describe the problem:

Using Hyperopt to optimize the BBandRSI strategy, I plug all the numbers into my strategy and make sure the config.json and my strategy file are exact to the hyperopt results, but Backtesting shows very diferent results, sometimes in the negative

Steps to reproduce:

1.Run Hyperopt on strategy BBandRSI

  1. Plug hyperopt results into strategy
  2. Run Backtest

Observed Results:

  • What happened?
    Backtest results always differ from Hyperopt results.
  • What did you expect to happen?
    Backtest results to be somewhat similar

    Relevant code exceptions or logs:

Question

All 3 comments

I've done this several times before (with other strategies) - the last time last week and results are 100% aligned when done correctly - so the error must be in the transfer of the numbers / conditions.

A few things to ensure:

  • is the direction of comparison correct (< vs. >) when comparing
  • are ALL conditions the same (volume is in most backtesting examples, but hasn't been considered for hyperopt until recently - it will also not show up in results)
  • Are you using the same pairs, same timerange, timeframe and same configuration
  • assuming you optimized only one space (only buy, for example) - are ROI / stoploss / sell-method identical between hyperopt and strategy (best remove this from hyperopt and reuse it from the strategy to avoid problems)

Assuming the above won't help - We'll need the following information to discover the mistake you made:

  • Full hyperopt file
  • Hyperopt results you used
  • resulting strategy file
  • Parameters used to run both hyperopt and backtesting
  • timeframe used
  • timerange used

Feel free to provide this in private to either myself or @hroff-1902 here or via Slack if you don't want to share it publicly.

@psionyx2311 has it been resolved after my review of the files you send to me at Slack?

Yes, thanks again! The solution was put a # infront of the RSI part of the
buy trend as HyperOpt said to disable it.

On Thu, Mar 19, 2020, 4:58 PM hroff-1902 notifications@github.com wrote:

@psionyx2311 https://github.com/psionyx2311 has it been resolved after
my review of the files you send to me at Slack?

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/freqtrade/freqtrade/issues/3082#issuecomment-601413354,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKG4I2M7XDY5VSD36O7AO6DRIKBOFANCNFSM4LO5B2PA
.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

King-Techno picture King-Techno  Â·  3Comments

Axel-CH picture Axel-CH  Â·  3Comments

yazeed picture yazeed  Â·  3Comments

shusso picture shusso  Â·  4Comments

hroff-1902 picture hroff-1902  Â·  4Comments