General Topics
Technical Topics
Brokerage Firms
Community Lounge
Site Support

# System Performance Statistics & Evaluation

Discussion in 'Strategy Development' started by CPTrader, Sep 10, 2007.

Iâm curious as to what system performance statistics (profit factor, net profit, net profit/DD, Mar , Sharpe ratios, Win/Loss%, etc) are most important to systematic traders.

Also what are the most important factors in your system evaluation and in determining that a system is viable for live trading?

Please letâs open this to debate and general discussion.

Thank you.

2. ### Anekdoten

Largest drawdown

Longest losing periods

Ratio of winners vs losers

Consecutive losers

Slippage

Commission

How far back is the backtest

That's pretty much what matters to me.

Anek

For Net profit, Net profit/Drawdown, win/Loss% , Avg Win/Avg Loss, MAR & Sharpe what are the preferred threshold levels?

4. ### Mathemagician

Average Return over Average Drawdown

M

5. ### rcanfiel

These cannot be answered. Everyone has their own parameters.

It is like asking "what flavor of ice cream do you like?" You are going to get 30+ answers.

Agreed - also depends on the time-frame you are trading in. For example, intra-day in ES I might look for 1pt av profit after slippage. Multi-day it might be 5pts av profit. etc etc

Trade frquency and profit factor are two key stats for profit consistency (look up prior comments from acrary).

Mr. Mathemagician,

This is quite similar to the MAR ratio. What is your preferred MAR - 1, 1.5, 2.0???

8. ### Mathemagician

It is, in fact, very much different. I don't have much use for the MAR.

M

How do you measure average drawdown - using daily data or using monthly data? Do you calculate the average of all drawdowns or just the top 5/top x drawdowns?

Hw do you measure Average Return?

Many Thanks.

10. ### Mathemagician

You can use periodic data or trade-by-trade data, and should include all drawdowns no matter how large or small. The maximum drawdown of any system over any period is (perhaps surprisingly) extremely random and is not a reliable way to evaluate a system. Take a look at the drawdown paper and spreadsheet at http://www.nextdsystems.com/research/research.htm. I think you'll be very surprised.

For Average Return I just use average annual return.

M

#10     Sep 10, 2007
ET IS FREE BECAUSE OF THE FINANCIAL SUPPORT FROM THESE COMPANIES: