Pandas: Any plans to support PyPy?

Created on 20 Feb 2015  路  9Comments  路  Source: pandas-dev/pandas

I couldn't find any official statement about PyPy support.

Most helpful comment

PyPy2 (not PyPy3 yet) now passes 99% of the tests of the upstream numpy. Mattip of the PyPy team is actively working towards bringing pandas to PyPy.

All 9 comments

It will be a while I'd guess. I'm not following the PyPy project too closely, but last I read they're working on NumPy support. And from what I recall (could be wrong) C extensions are slow in PyPy (I think they use CFFI for faster calling of C stuff, but that would require work).

In addition to NumPy, Pandas also makes extensive use of Cython to speed up slow calculations. It looks like it's theoretically possible to run Cython extensions with PyPy, but the result may not work well: http://stackoverflow.com/questions/14201555/does-pypy-support-cython-extension

So, at this point, I would say we have no plans to support PyPy. I'm not opposed to it in principle, but it would take quite a lot of work to make this feasible.

Any update here?

Maciej Fijalkowski (on the PyPy team) mentioned recently that they'd have updates on numpypy to share soon.

PyPy2 (not PyPy3 yet) now passes 99% of the tests of the upstream numpy. Mattip of the PyPy team is actively working towards bringing pandas to PyPy.

In addition to pypy/rpython there is an implementation of a subset of pandas and a subset of numpy for the Stanford weld runtime named "Grizzly" https://github.com/weld-project/weld#grizzly

pandas2 will encompass much of this workflow
e.g. lazy evaluation, high perf with multi cores and out of core evaluation

coming soon

Anyone who wants to know more about the exact progress on this issue can read this wiki.

PyPy has made quite some efforts with pandas is fairly well supported

cc @mattip

Was this page helpful?
0 / 5 - 0 ratings

Related issues

simonjayhawkins picture simonjayhawkins  路  53Comments

jorisvandenbossche picture jorisvandenbossche  路  50Comments

J-Postma picture J-Postma  路  52Comments

rvernica picture rvernica  路  46Comments

maxgrenderjones picture maxgrenderjones  路  48Comments