I have developed a ranking system and have been running simulated strategies using that system. I was testing the performance of this strategy by changing the backtest period, running MAX, 10y, 5y, etc. with the latest date as the end date. The strategy sells all positions at each rebalance using the Sell rule "Rank < 101". I'm just testing something out so have not yet defined an in-sample and out of sample timeframe.
To my surprise, the statistics for the most recent periods are different when I look back MAX vs 10 yr vs 5 yr. In particular, the DD is actually worse when I look at 10yr or 5 year vs MAX. How is this possible when I am running these time periods to "today"? What would cause this and cause the yearly returns to also differ? The only variable I am changing is the lookback period. I would have expected the stats for the years in common to be the same (e.g., 10 yr vs 5yr, I would expect the last 5 years of returns to be the same since I am selling all positions at each rebalance).
Thanks for any thoughts on this!