Hacker News Reader

If I understand you, this is indeed possible and has been recently implemented in Python. Take a look at dask: http://dask.pydata.org/en/latest/

> Users interact with dask either by making graphs directly or through the dask collections which provide larger-than-memory counterparts to existing popular libraries:

View on HN

Just to clarify, OP statement of "out of the core" means concurrent processes?

I think he means operating on data that doesn't fit in memory, and as mentioned I think R and Python both have packages for that.

Dask looks quite interesting. Though I am running into some issues with merges and such.

My temporary fix is to use the chunking functionality of Pandas.

Reply on news.ycombinator.com