"Out of memory. This worker has a limit of 16GB of memory. Please choose a worker with higher memory resources."?

General
1

I have encountered the following error in AI-factor: "Out of memory. This worker has a limit of 16GB of memory. Please choose a worker with higher memory resources." However, I am unsure why I am experiencing a memory peak, given that I ran the same algorithm on the same universe two days ago, albeit with slightly fewer features. Are there any known issues with AI-factor?

Additionally, is there a way to determine in advance how much memory an algorithm will require?

And what happens when I choose Basic and Premium? Will it first try to run the task on the Basic Worker, and if that's not enough, will it try the premium?

image
image717×536 9.98 KB

2

Work is dispatched according to load alone. So if you choose Basic and Premium, least expensive, and there are available slots on Basic, it will always start the work on Basic and will not retry elsewhere. We haven't implemented anything to estimate peak memory usage given an arbitrary algorithm/parameters combination.

In this particular case, your new AI Factor using a different universe, and the dataset is 190% larger. You'll have to train on Premium, as the message suggests.

Hope this helps!

1 Like
3

If you are on the limit of 16GB, you can tip over above 16GB if you change hyperparamters (bigger trees).

1 Like