Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory Error with any functionality #189

Open
ScriptPup opened this issue Feb 2, 2021 · 0 comments
Open

Memory Error with any functionality #189

ScriptPup opened this issue Feb 2, 2021 · 0 comments

Comments

@ScriptPup
Copy link

Hi! This seems like a really awesome and useful magic pack, but I'm getting a "Memory Error" even going the most simple tests.

Version info:
python 3.7.3
ipython 7.20.0 (originally I had 7.10.2, but I upgraded as part of troubleshooting)
ipython-sql 0.4.0

cell 1

%load_ext sql
%sql mssql+pyodbc://GRONKSMASH.AMER.DELL.COM/SDS_COMMERCIAL_GSA?trusted_connection=yes&driver=ODBC+Driver+13+for+SQL+Server

cell 2

%%sql 
a <<
SELECT 1 FROM table

Cell 3

a.DataFrame()

Results in

---------------------------------------------------------------------------
MemoryError                               Traceback (most recent call last)
<ipython-input-3-c5a46a0b5683> in <module>
----> 1 b.DataFrame()

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\sql\run.py in DataFrame(self)
    172         import pandas as pd
    173 
--> 174         frame = pd.DataFrame(self, columns=(self and self.keys) or [])
    175         return frame
    176 

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\frame.py in __init__(self, data, index, columns, dtype, copy)
    448                     if is_named_tuple(data[0]) and columns is None:
    449                         columns = data[0]._fields
--> 450                     arrays, columns = to_arrays(data, columns, dtype=dtype)
    451                     columns = ensure_index(columns)
    452 

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\internals\construction.py in to_arrays(data, columns, coerce_float, dtype)
    486         # last ditch effort
    487         data = [tuple(x) for x in data]
--> 488         return _list_to_arrays(data, columns, coerce_float=coerce_float, dtype=dtype)
    489 
    490 

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\internals\construction.py in _list_to_arrays(data, columns, coerce_float, dtype)
    498     try:
    499         result = _convert_object_array(
--> 500             content, columns, dtype=dtype, coerce_float=coerce_float
    501         )
    502     except AssertionError as e:

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\internals\construction.py in _convert_object_array(content, columns, coerce_float, dtype)
    591         return arr
    592 
--> 593     arrays = [convert(arr) for arr in content]
    594 
    595     return arrays, columns

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\internals\construction.py in <listcomp>(.0)
    591         return arr
    592 
--> 593     arrays = [convert(arr) for arr in content]
    594 
    595     return arrays, columns

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\internals\construction.py in convert(arr)
    587     def convert(arr):
    588         if dtype != object and dtype != np.object:
--> 589             arr = lib.maybe_convert_objects(arr, try_float=coerce_float)
    590             arr = maybe_cast_to_datetime(arr, dtype)
    591         return arr

pandas/_libs/lib.pyx in pandas._libs.lib.maybe_convert_objects()

MemoryError: Unable to allocate array with shape (10737222,) and data type complex128

I tried running inline commands as well but that produces the same error.

pmfischer pushed a commit to pmfischer/ipython-sql that referenced this issue Sep 8, 2023
…#171) (catherinedevlin#189)

* Add: test

* Fix: pytest

* Revert

* Revert

* Move: _get_curr_connection_info to classmethod level

* Move: pytest fixture cleanup

* pins jupyter-book<0.14 (catherinedevlin#181)

* ci

* pins jupyter book

* Add: f-string fix

* Fix: arg self -> cls

* Fix: arg self -> cls

---------

Co-authored-by: Eduardo Blancas <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant