Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-10466

Python package installation issue related to CMake swig_wt_target setting

    • Type: Icon: Bug Bug
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • WT11.2.0, 7.2.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • 2
    • Asparagus-StorEng - 2023-10-31

      When attempting to release WiredTiger 11.0.0 and 11.1.0 Python packages on PyPi, I ran into the below error while testing package installation locally (running Python 3.9.5, CMake 3.25.0, SWIG 4.0.1):

      $ pip install ~/work/wiredtiger-changes/lang/python/dist/wiredtiger-11.1.0.tar.gz
      
      (...)
      
          Running setup.py install for wiredtiger ... error
          ERROR: Command errored out with exit status 1:
           command: /home/lchen/pytest/venv-11.1.0/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-f6n1i5rx/setup.py'"'"'; __file__='"'"'/tmp/pip-req-build-f6n1i5rx/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-74bohd_o/install-record.txt --single-version-externally-managed --compile --install-headers /home/lchen/pytest/venv-11.1.0/include/site/python3.9/wiredtiger
               cwd: /tmp/pip-req-build-f6n1i5rx/
          Complete output (15 lines):
          running install
          running build_ext
          building '_wiredtiger' extension
          creating build
          creating build/temp.linux-x86_64-3.9
          creating build/temp.linux-x86_64-3.9/cmake_pip_build
          creating build/temp.linux-x86_64-3.9/cmake_pip_build/lang
          creating build/temp.linux-x86_64-3.9/cmake_pip_build/lang/python
          creating build/temp.linux-x86_64-3.9/cmake_pip_build/lang/python/CMakeFiles
          creating build/temp.linux-x86_64-3.9/cmake_pip_build/lang/python/CMakeFiles/__wiredtiger.dir
          x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/tmp/pip-req-build-f6n1i5rx/cmake_pip_build/include -I/tmp/pip-req-build-f6n1i5rx/cmake_pip_build/config -I/tmp/pip-req-build-f6n1i5rx/cmake_pip_build -I. -I/usr/lib/include -I/usr/lib/include -I/usr/lib/include -I/home/lchen/pytest/venv-11.1.0/include -I/usr/include/python3.9 -c cmake_pip_build/lang/python/CMakeFiles/__wiredtiger.dir/wiredtigerPYTHON_wrap.c -o build/temp.linux-x86_64-3.9/cmake_pip_build/lang/python/CMakeFiles/__wiredtiger.dir/wiredtigerPYTHON_wrap.o -w -Wno-sign-conversion -std=c11 -I/tmp/pip-req-build-f6n1i5rx/cmake_pip_build/include -I/tmp/pip-req-build-f6n1i5rx/cmake_pip_build/config -I/tmp/pip-req-build-f6n1i5rx/cmake_pip_build -I. -I/usr/lib/include -I/usr/lib/include -I/usr/lib/include -DHAVE_CONFIG_H
          x86_64-linux-gnu-gcc: error: cmake_pip_build/lang/python/CMakeFiles/__wiredtiger.dir/wiredtigerPYTHON_wrap.c: No such file or directory
          x86_64-linux-gnu-gcc: fatal error: no input files
          compilation terminated.
          error: command '/usr/bin/x86_64-linux-gnu-gcc' failed with exit code 1 

      It turns out CMake attempted to find a file under the "__wiredtiger.dir" subdirectory, while a "wiredtiger_python.dir" subdirectory actually existed instead. (One can use the "--no-clean" option in the "pip install" command to retain the build directory.)

      WT-8633 touched the setting of swig_workgen_target (changing the target name from "_wiredtiger" to "wiredtiger_python") and seems to be related. It's confirmed after reverting WT-8633 the issue stopped appearing. 

            Assignee:
            luke.chen@mongodb.com Luke Chen
            Reporter:
            luke.chen@mongodb.com Luke Chen
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: