It appears that resource.strlimit is unable to set the stack resource limit to RLIM_INFINITY in macOS Sonoma 14.1 build 23B74.
It looks like by running sudo ulimit -s unlimited would allow this to be set, but it seems bad to have to escalate to super admin in order to achieve the outcome. Not sure what the expected outcome is here. Commenting those lines out lets scripts using bigframes using pandas run, but not sure where the limitation would be hit.
Environment details
- OS type and version: macOS Sonoma version 14.1 build 23B74
- Shell: zsh
- Python version:
Python: 3.10.13 (main, Aug 24 2023, 22:36:46) [Clang 14.0.3 (clang-1403.0.22.14.1)]
- pip version:
pip 23.2.1 from <path omitted>/.venv/lib/python3.10/site-packages/pip (python 3.10)
bigframes version: bigframes==1.0.0
Python: 3.10.13 (main, Aug 24 2023, 22:36:46) [Clang 14.0.3 (clang-1403.0.22.14.1)]
bigframes==1.0.0
google-cloud-bigquery==3.19.0
ibis==8.0.0
pandas==2.2.1
pyarrow==15.0.1
sqlglot==20.11.0
Steps to reproduce
- pip install bigframes
- open a python repl eg.
python3
- import bigframes.pandas as bpd
Code example
around L717 of bigframes/pandas/__init__.py:
resource.setrlimit(
resource.RLIMIT_STACK, (resource.RLIM_INFINITY, resource.RLIM_INFINITY)
)
(.venv) $ python3
Python 3.10.13 (main, Aug 24 2023, 22:36:46) [Clang 14.0.3 (clang-1403.0.22.14.1)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import bigframes.pandas as bpd
Stack trace
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "<path-omitted>/.venv/lib/python3.10/site-packages/bigframes/pandas/__init__.py", line 717, in <module>
resource.setrlimit(
ValueError: not allowed to raise maximum limit
It appears that
resource.strlimitis unable to set the stack resource limit toRLIM_INFINITYin macOS Sonoma 14.1 build 23B74.It looks like by running
sudo ulimit -s unlimitedwould allow this to be set, but it seems bad to have to escalate to super admin in order to achieve the outcome. Not sure what the expected outcome is here. Commenting those lines out lets scripts using bigframes using pandas run, but not sure where the limitation would be hit.Environment details
Python: 3.10.13 (main, Aug 24 2023, 22:36:46) [Clang 14.0.3 (clang-1403.0.22.14.1)]pip 23.2.1 from <path omitted>/.venv/lib/python3.10/site-packages/pip (python 3.10)bigframesversion:bigframes==1.0.0Steps to reproduce
python3Code example
around L717 of
bigframes/pandas/__init__.py:Stack trace