pip-installable version of package sage_conf - installs non-Python bits of the Sage distribution in ~/.sage/
Closed this issue · 227 comments
mkoeppe commented
As #30913 makes sage-conf both (a) a PEP517/518 build_system requires and (b) an install-requires of sagelib (sagemath-standard), also a version of sage-conf must be made available on PyPI.
This version of sage-conf includes a copy of SAGE_ROOT and SAGE_ROOT/build/** in its source distribution. On installation (or wheel building) it establishes a python-less SAGE_LOCAL hierarchy (#31362) in ~/.sage/ by running configure and make build-local; and then installs the configured sage_conf.py (#29038) as a Python module (and sage-config, sage-env-config).
There are no changes to how the Sage distribution is built. This ticket only provides an alternative and strictly optional way of installing (the non-Python bits of) Sage-the-distribution. It may be useful for some users who wish to use pip to install everything they need.
To test:
./bootstrap && (cd pkgs/sage-conf_pypi/ && tox -r -v -v -v)
This test using tox uses .sage in an isolated directory within .tox instead of in your home directory. At the end of the tox run, the installed sage-config script is executed; it prints the configuration variables:
[10639] /Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/pkgs/sage-conf_pypi$ /Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/pkgs/sage-conf-pypi/.tox/python/bin/sage-config
VERSION=9.3.beta7
MAXIMA=/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.beta7-cpython-39-darwin/local/bin/maxima
ARB_LIBRARY=arb
SAGE_NAUTY_BINS_PREFIX=
CBLAS_PC_MODULES=cblas
MATHJAX_DIR=/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.beta7-cpython-39-darwin/local/share/mathjax
THREEJS_DIR=/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.beta7-cpython-39-darwin/local/share/threejs
SAGE_LOCAL=/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.beta7-cpython-39-darwin/local
SAGE_ROOT=/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.beta7-cpython-39-darwin
python finish: run-test after 0.17 seconds
To build a source distribution:
./sage -sh -c build/pkgs/sage_conf/spkg-src
(The source distribution has been uploaded to https://pypi.org/project/sage-conf/)
Follow-up steps:
- Make SAGE_ROOT configurable by the user (by passing
--prefixtosetup.py). - Optionally, it would create a venv that is used for building wheels.
- #30036: Make the build more incremental: On installation of sage-conf, only run
configurebut do not install anything; rather, a Python entry point can be used by Python distribution packages such as sagemath-standard to install packages if present.
CC: @jhpalmieri @dimpase @kiwifb @vbraun
Component: build
Keywords: sd111
Author: Matthias Koeppe
Branch: 2a4a323
Reviewer: Dima Pasechnik, François Bissey
Issue created by migration from https://trac.sagemath.org/ticket/29039
mkoeppe commented
Description changed:
---
+++
@@ -2,5 +2,5 @@
It establishes a python-less SAGE_LOCAL hierarchy in the installed `package_data` of a new Python package `sage_local`.
-It also installs `sage_conf.py` (#29038) to enable installing a sagelib using that SAGE_LOCAL>
+It also installs `sage_conf.py` (#29038) to enable installing a sagelib using that SAGE_LOCAL.
mkoeppe commented
Description changed:
---
+++
@@ -1,6 +1,6 @@
This provides an alternative and strictly optional way of installing sage-the-distribution that may be useful for some users who wish to use `pip` to install everything they need.
-It establishes a python-less SAGE_LOCAL hierarchy in the installed `package_data` of a new Python package `sage_local`.
+It establishes a python-less SAGE_LOCAL hierarchy in the installed `package_data` of the Python package `sage_bootstrap`. The installed script `build/bin/sage-site` can be used by Python packages such as `sagelib` to install additional packages.
-It also installs `sage_conf.py` (#29038) to enable installing a sagelib using that SAGE_LOCAL.
+It also installs `build/sage_conf.py` (#29038) as a Python module to enable installing a sagelib using that SAGE_LOCAL.
mkoeppe commented
Description changed:
---
+++
@@ -4,3 +4,11 @@
It also installs `build/sage_conf.py` (#29038) as a Python module to enable installing a sagelib using that SAGE_LOCAL.
+Steps:
+- Move `configure.ac`, `m4`, `config` into `build/`.
+- Leave behind a symlink `configure -> build/configure`.
+- Split out `build/bootstrap` from `SAGE_ROOT/bootstrap`, call it from there.
+- Extend `build/MANIFEST.in` to include all files in `build`, including `build/pkgs` and `build/make`
+- An sdist of `sage_bootstrap` will contain `configure`, just as an sdist of `sage_doc` will contain the files generated by `src/doc/bootstrap`.
+- Exclude the symlinked `build/pkgs/sagelib/src/`, probably exclude all Python spkgs.
+mkoeppe commented
Description changed:
---
+++
@@ -5,9 +5,7 @@
It also installs `build/sage_conf.py` (#29038) as a Python module to enable installing a sagelib using that SAGE_LOCAL.
Steps:
-- Move `configure.ac`, `m4`, `config` into `build/`.
-- Leave behind a symlink `configure -> build/configure`.
-- Split out `build/bootstrap` from `SAGE_ROOT/bootstrap`, call it from there.
+- #30025: Clean up `SAGE_ROOT` directory by moving stuff into `SAGE_ROOT/build/`
- Extend `build/MANIFEST.in` to include all files in `build`, including `build/pkgs` and `build/make`
- An sdist of `sage_bootstrap` will contain `configure`, just as an sdist of `sage_doc` will contain the files generated by `src/doc/bootstrap`.
- Exclude the symlinked `build/pkgs/sagelib/src/`, probably exclude all Python spkgs. mkoeppe commented
mkoeppe commented
Description changed:
---
+++
@@ -1,8 +1,12 @@
This provides an alternative and strictly optional way of installing sage-the-distribution that may be useful for some users who wish to use `pip` to install everything they need.
-It establishes a python-less SAGE_LOCAL hierarchy in the installed `package_data` of the Python package `sage_bootstrap`. The installed script `build/bin/sage-site` can be used by Python packages such as `sagelib` to install additional packages.
+It establishes a python-less SAGE_LOCAL hierarchy either in the installed `package_data` of the Python package `sage_bootstrap`, or in `~/.sage/`, or something configured by the user (by passing `--prefix` to `setup.py`). On installation, it only runs `configure` but does not install anything. By default, instead of installing a copy of python3 or creating a venv, it would only run a python3 version check and would issue a warning if trying to install into a Python outside of the supported range.
-It also installs `build/sage_conf.py` (#29038) as a Python module to enable installing a sagelib using that SAGE_LOCAL.
+A Python entry point in `sage_bootstrap` can be used by Python packages such as `sagelib` to install packages if present.
+
+It also installs `sage_conf.py` (#29038) as a Python module to enable installing a sagelib using that SAGE_LOCAL. (Or there could be a different installed configuration module such as `sage_bootstrap.config`.)
+
+
Steps:
- #30025: Clean up `SAGE_ROOT` directory by moving stuff into `SAGE_ROOT/build/`sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
a6373b7 | build/setup.py: Add sage_root as package_data |
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
mkoeppe commented
Description changed:
---
+++
@@ -4,7 +4,7 @@
A Python entry point in `sage_bootstrap` can be used by Python packages such as `sagelib` to install packages if present.
-It also installs `sage_conf.py` (#29038) as a Python module to enable installing a sagelib using that SAGE_LOCAL. (Or there could be a different installed configuration module such as `sage_bootstrap.config`.)
+It also installs `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`) to enable installing a sagelib using that `SAGE_LOCAL`.
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
8006b6f | Add sage_bootstrap.build |
sagetrac-git commented
mkoeppe commented
Work Issues: sage-system-python in installed sage_bootstrap
mkoeppe commented
Author: Matthias Koeppe
mkoeppe commented
Description changed:
---
+++
@@ -1,6 +1,9 @@
This provides an alternative and strictly optional way of installing sage-the-distribution that may be useful for some users who wish to use `pip` to install everything they need.
-It establishes a python-less SAGE_LOCAL hierarchy either in the installed `package_data` of the Python package `sage_bootstrap`, or in `~/.sage/`, or something configured by the user (by passing `--prefix` to `setup.py`). On installation, it only runs `configure` but does not install anything. By default, instead of installing a copy of python3 or creating a venv, it would only run a python3 version check and would issue a warning if trying to install into a Python outside of the supported range.
+It establishes a python-less SAGE_LOCAL hierarchy either in the installed `package_data` of the Python package `sage_bootstrap`, or in `~/.sage/`, or something configured by the user (by passing `--prefix` to `setup.py`). On installation, it only runs `configure` but does not install anything.
+
+- By default, instead of installing a copy of python3 or creating a venv, it would only run a python3 version check and would issue a warning if trying to install into a Python outside of the supported range.
+- Optionally, it would create a venv that is used for building wheels (#30527).
A Python entry point in `sage_bootstrap` can be used by Python packages such as `sagelib` to install packages if present.
mkoeppe commented
Description changed:
---
+++
@@ -4,6 +4,7 @@
- By default, instead of installing a copy of python3 or creating a venv, it would only run a python3 version check and would issue a warning if trying to install into a Python outside of the supported range.
- Optionally, it would create a venv that is used for building wheels (#30527).
+- Using #29013, it could support several python versions
A Python entry point in `sage_bootstrap` can be used by Python packages such as `sagelib` to install packages if present.
mkoeppe commented
Description changed:
---
+++
@@ -13,7 +13,7 @@
Steps:
-- #30025: Clean up `SAGE_ROOT` directory by moving stuff into `SAGE_ROOT/build/`
+- Optional: #30025: Clean up `SAGE_ROOT` directory by moving stuff into `SAGE_ROOT/build/`
- Extend `build/MANIFEST.in` to include all files in `build`, including `build/pkgs` and `build/make`
- An sdist of `sage_bootstrap` will contain `configure`, just as an sdist of `sage_doc` will contain the files generated by `src/doc/bootstrap`.
- Exclude the symlinked `build/pkgs/sagelib/src/`, probably exclude all Python spkgs. sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:
a1ad0be | Add sage_root to sage_bootstrap |
8695368 | build/setup.py: Add sage_root as package_data |
cc93eca | Working sdist and install |
45c0ebe | Simplify directory structure |
62d4f6c | build/setup.py: Reuse configured sage root |
7d705e3 | Re-add build/sage_root |
44e3224 | build/setup.py: Install sage_conf.py, sage-env-config |
9293ae1 | Add sage_bootstrap.build |
sagetrac-git commented
sagetrac-git commented
mkoeppe commented
Changed keywords from none to sd111
mkoeppe commented
Description changed:
---
+++
@@ -8,8 +8,11 @@
A Python entry point in `sage_bootstrap` can be used by Python packages such as `sagelib` to install packages if present.
+
It also installs `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`) to enable installing a sagelib using that `SAGE_LOCAL`.
+
+As #30913 makes `sage_conf` a PEP517/518 `build_system` `requires`, also a version of `sage_conf` must be made available on PyPI.
Steps:mkoeppe commented
Changed work issues from sage-system-python in installed sage_bootstrap to sage-system-python in installed sage_bootstrap. Rework it so that sage_conf is the package running configure.
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. This was a forced push. Last 10 new commits:
7da13f4 | Add sage_root to sage_bootstrap |
9ea9d80 | build/setup.py: Add sage_root as package_data |
3f5c99c | Working sdist and install |
1f7647f | Simplify directory structure |
f59d077 | build/setup.py: Reuse configured sage root |
4a18b98 | Re-add build/sage_root |
8e44d28 | build/setup.py: Install sage_conf.py, sage-env-config |
86e21a1 | Add sage_bootstrap.build |
47f5e95 | build/sage_root: Remove outdated symlink |
b7cd894 | build/setup.py: Use configure --with-python=... |
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
mkoeppe commented
Description changed:
---
+++
@@ -1,23 +1,18 @@
-This provides an alternative and strictly optional way of installing sage-the-distribution that may be useful for some users who wish to use `pip` to install everything they need.
+As #30913 makes `sage_conf` a PEP517/518 `build_system` `requires` of sagelib (`sagemath-standard`), also a version of `sage_conf` must be made available on PyPI.
-It establishes a python-less SAGE_LOCAL hierarchy either in the installed `package_data` of the Python package `sage_bootstrap`, or in `~/.sage/`, or something configured by the user (by passing `--prefix` to `setup.py`). On installation, it only runs `configure` but does not install anything.
+This version of `sage_conf` runs includes a copy of `SAGE_ROOT` and `SAGE_ROOT/build/**`. On installation (or wheel building) it runs `configure` and then installs the configured `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`).
+
+There no changes to how the Sage distribution is built. This ticket only provides an alternative and strictly optional way of installing sage-the-distribution that may be useful for some users who wish to use `pip` to install everything they need.
+
+It establishes a python-less SAGE_LOCAL hierarchy (#31362) in `~/.sage/` or something configured by the user (by passing `--prefix` to `setup.py`).
- By default, instead of installing a copy of python3 or creating a venv, it would only run a python3 version check and would issue a warning if trying to install into a Python outside of the supported range.
- Optionally, it would create a venv that is used for building wheels (#30527).
- Using #29013, it could support several python versions
-A Python entry point in `sage_bootstrap` can be used by Python packages such as `sagelib` to install packages if present.
+Steps:
+- Optional: #30025: Clean up `SAGE_ROOT` directory by moving stuff into `SAGE_ROOT/build/`
+- Exclude the symlinked `build/pkgs/sagelib/src/` via `MANIFEST.in`
+- Make the build more incremental: On installation of `sage_conf`, only run `configure` but do not install anything; rather, a Python entry point can be used by Python packages such as `sagemath-standard` to install packages if present.
-It also installs `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`) to enable installing a sagelib using that `SAGE_LOCAL`.
-
-
-As #30913 makes `sage_conf` a PEP517/518 `build_system` `requires`, also a version of `sage_conf` must be made available on PyPI.
-
-
-Steps:
-- Optional: #30025: Clean up `SAGE_ROOT` directory by moving stuff into `SAGE_ROOT/build/`
-- Extend `build/MANIFEST.in` to include all files in `build`, including `build/pkgs` and `build/make`
-- An sdist of `sage_bootstrap` will contain `configure`, just as an sdist of `sage_doc` will contain the files generated by `src/doc/bootstrap`.
-- Exclude the symlinked `build/pkgs/sagelib/src/`, probably exclude all Python spkgs.
-sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:
8ee9087 | Put both versions of sage_conf sources into subdirectories of SAGE_ROOT/src/pkgs/ |
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:
47e182d | Put both versions of sage_conf sources into subdirectories of SAGE_ROOT/src/pkgs/ |
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
55bc2aa | m4/sage_spkg_collect.m4: Generate install tree information for build/make/Makefile |
d7dc9a2 | build/make/Makefile.in: New targets all-sage-local, all-sage-venv |
27b589b | Merge branch 't/30912/sagelib__update_metadata_for_pypi_deployment' into t/31362/make_all_sage_local__make_all_sage_venv |
8796008 | Put pynac into SAGE_LOCAL, sagelib into SAGE_VENV |
d6831b1 | build/make/Makefile.in: Add all-build-local, all-build-venv, which include dependency on toolchain |
61f6ba6 | Makefile: Add top-level targets build-local, build-venv |
b2b785b | Put both versions of sage_conf sources into subdirectories of SAGE_ROOT/src/pkgs/ |
mkoeppe commented
Description changed:
---
+++
@@ -1,18 +1,22 @@
As #30913 makes `sage_conf` a PEP517/518 `build_system` `requires` of sagelib (`sagemath-standard`), also a version of `sage_conf` must be made available on PyPI.
-This version of `sage_conf` runs includes a copy of `SAGE_ROOT` and `SAGE_ROOT/build/**`. On installation (or wheel building) it runs `configure` and then installs the configured `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`).
+This version of `sage_conf` runs includes a copy of `SAGE_ROOT` and `SAGE_ROOT/build/**`. On installation (or wheel building) it runs `configure` and `make build-local`; and then installs the configured `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`).
-There no changes to how the Sage distribution is built. This ticket only provides an alternative and strictly optional way of installing sage-the-distribution that may be useful for some users who wish to use `pip` to install everything they need.
+There are no changes to how the Sage distribution is built. This ticket only provides an alternative and strictly optional way of installing sage-the-distribution that may be useful for some users who wish to use `pip` to install everything they need.
-It establishes a python-less SAGE_LOCAL hierarchy (#31362) in `~/.sage/` or something configured by the user (by passing `--prefix` to `setup.py`).
+It establishes a python-less SAGE_LOCAL hierarchy (#31362) in `~/.sage/`.
-- By default, instead of installing a copy of python3 or creating a venv, it would only run a python3 version check and would issue a warning if trying to install into a Python outside of the supported range.
+To test:
+
+```
+./bootstrap && (cd src/pkgs/sage_conf-pypi/ && MAKE="make -j12" tox -v -v -v)
+```
+
+
+Follow-up steps:
+- Make SAGE_ROOT configurable by the user (by passing `--prefix` to `setup.py`).
- Optionally, it would create a venv that is used for building wheels (#30527).
- Using #29013, it could support several python versions
-
-Steps:
-- Optional: #30025: Clean up `SAGE_ROOT` directory by moving stuff into `SAGE_ROOT/build/`
-- Exclude the symlinked `build/pkgs/sagelib/src/` via `MANIFEST.in`
- Make the build more incremental: On installation of `sage_conf`, only run `configure` but do not install anything; rather, a Python entry point can be used by Python packages such as `sagemath-standard` to install packages if present.
mkoeppe commented
Changed work issues from sage-system-python in installed sage_bootstrap. Rework it so that sage_conf is the package running configure. to none
mkoeppe commented
Description changed:
---
+++
@@ -1,10 +1,8 @@
As #30913 makes `sage_conf` a PEP517/518 `build_system` `requires` of sagelib (`sagemath-standard`), also a version of `sage_conf` must be made available on PyPI.
-This version of `sage_conf` runs includes a copy of `SAGE_ROOT` and `SAGE_ROOT/build/**`. On installation (or wheel building) it runs `configure` and `make build-local`; and then installs the configured `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`).
+This version of `sage_conf` runs includes a copy of `SAGE_ROOT` and `SAGE_ROOT/build/**`. On installation (or wheel building) it establishes a python-less SAGE_LOCAL hierarchy (#31362) in `~/.sage/` by running `configure` and `make build-local`; and then installs the configured `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`).
There are no changes to how the Sage distribution is built. This ticket only provides an alternative and strictly optional way of installing sage-the-distribution that may be useful for some users who wish to use `pip` to install everything they need.
-
-It establishes a python-less SAGE_LOCAL hierarchy (#31362) in `~/.sage/`.
To test:
mkoeppe commented
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:
b8b8a06 | Put both versions of sage_conf sources into subdirectories of SAGE_ROOT/src/pkgs/ |
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
ff7f110 | build/pkgs/sage_conf/install-requires.txt: New |
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
072b522 | Determine SAGE_ROOT from sage version and python version |
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
fa4cbfa | Run .homebrew-build-env and set 'make -j...' automatically |
mkoeppe commented
Description changed:
---
+++
@@ -1,15 +1,19 @@
As #30913 makes `sage_conf` a PEP517/518 `build_system` `requires` of sagelib (`sagemath-standard`), also a version of `sage_conf` must be made available on PyPI.
-This version of `sage_conf` runs includes a copy of `SAGE_ROOT` and `SAGE_ROOT/build/**`. On installation (or wheel building) it establishes a python-less SAGE_LOCAL hierarchy (#31362) in `~/.sage/` by running `configure` and `make build-local`; and then installs the configured `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`).
+This version of `sage_conf` includes a copy of `SAGE_ROOT` and `SAGE_ROOT/build/**` in its source distribution. On installation (or wheel building) it establishes a python-less SAGE_LOCAL hierarchy (#31362) in `~/.sage/` by running `configure` and `make build-local`; and then installs the configured `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`).
There are no changes to how the Sage distribution is built. This ticket only provides an alternative and strictly optional way of installing sage-the-distribution that may be useful for some users who wish to use `pip` to install everything they need.
To test:
```
-./bootstrap && (cd src/pkgs/sage_conf-pypi/ && MAKE="make -j12" tox -v -v -v)
+./bootstrap && (cd src/pkgs/sage_conf-pypi/ && tox -v -v -v)
```
+To build a source distribution:
+```
+./sage -sh -c build/pkgs/sage_conf/spkg-src
+```
Follow-up steps:
- Make SAGE_ROOT configurable by the user (by passing `--prefix` to `setup.py`).mkoeppe commented
Description changed:
---
+++
@@ -2,13 +2,29 @@
This version of `sage_conf` includes a copy of `SAGE_ROOT` and `SAGE_ROOT/build/**` in its source distribution. On installation (or wheel building) it establishes a python-less SAGE_LOCAL hierarchy (#31362) in `~/.sage/` by running `configure` and `make build-local`; and then installs the configured `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`).
-There are no changes to how the Sage distribution is built. This ticket only provides an alternative and strictly optional way of installing sage-the-distribution that may be useful for some users who wish to use `pip` to install everything they need.
+There are no changes to how the Sage distribution is built. This ticket only provides an alternative and strictly optional way of installing (the non-Python bits of) Sage-the-distribution. It may be useful for some users who wish to use `pip` to install everything they need.
To test:
```
./bootstrap && (cd src/pkgs/sage_conf-pypi/ && tox -v -v -v)
```
+This test using `tox` uses `.sage` in an isolated directory within `.tox` instead of in your home directory. At the end of the tox run, the installed `sage-config` script is executed; it prints the configuration variables:
+
+```
+[10639] /Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi$ /Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/bin/sage-config
+VERSION=9.3.beta7
+MAXIMA=/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.beta7-cpython-39-darwin/local/bin/maxima
+ARB_LIBRARY=arb
+SAGE_NAUTY_BINS_PREFIX=
+CBLAS_PC_MODULES=cblas
+MATHJAX_DIR=/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.beta7-cpython-39-darwin/local/share/mathjax
+THREEJS_DIR=/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.beta7-cpython-39-darwin/local/share/threejs
+SAGE_LOCAL=/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.beta7-cpython-39-darwin/local
+SAGE_ROOT=/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.beta7-cpython-39-darwin
+python finish: run-test after 0.17 seconds
+```
+
To build a source distribution:
```sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
fa9485c | Remove sage_bootstrap.build (not needed for this ticket) |
sagetrac-git commented
mkoeppe commented
Description changed:
---
+++
@@ -35,6 +35,6 @@
- Make SAGE_ROOT configurable by the user (by passing `--prefix` to `setup.py`).
- Optionally, it would create a venv that is used for building wheels (#30527).
- Using #29013, it could support several python versions
-- Make the build more incremental: On installation of `sage_conf`, only run `configure` but do not install anything; rather, a Python entry point can be used by Python packages such as `sagemath-standard` to install packages if present.
+- #30036: Make the build more incremental: On installation of `sage_conf`, only run `configure` but do not install anything; rather, a Python entry point can be used by Python packages such as `sagemath-standard` to install packages if present.
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
7bdc524 | build/pkgs/sage_conf/src: Restore symlink |
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
76d151e | build/bin/write-dockerfile.sh: Fix up docker tests |
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
1a8cadc | src/pkgs/sage_conf-pypi/setup.cfg: Under version control, not gitignored |
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
31caddd | Merge tag '9.3.beta8' into t/29039/pip_installable_package_sage_bootstrap |
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. Last 10 new commits:
82d8030 | m4/sage_spkg_enable.m4: Cosmetic change to help strings |
3e92998 | configure --disable-notebook: Fix up what packages are disabled |
74a83fc | build/pkgs/matplotlib/dependencies: Undo removal of tornado |
93d31b9 | Remove use of unicode superscripts in configure --help |
18fbb85 | m4/sage_spkg_collect.m4: Fix description of SAGE_OPTIONAL_CLEANED_PACKAGES |
c3e4093 | Rename SAGE_OPTIONAL_CLEANED_PACKAGES to SAGE_OPTIONAL_UNINSTALLED_PACKAGES |
4916415 | Merge tag '9.3.beta9' into t/30383/new_package_type__optional_enabled_by_default |
a35428e | Merge #30383 |
e098133 | src/pkgs/sage_conf/sage_conf.py.in: Add SAGE_SPKG_WHEELS |
5dbd712 | src/pkgs/sage_conf-pypi/setup.py: Use 'configure --disable-notebook', run 'make build' so that wheels are built |
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
sagetrac-git commented
Branch pushed to git repo; I updated commit sha1. New commits:
66c2987 | build/pkgs/{sage_sws2rst,sage_docbuild}/install-requires.txt: New |
7f8ec6c | build/pkgs/sagelib/src/tox.ini: Add factor sitepackages |
0283da5 | build/make/Makefile.in: Add wheel, setuptools_wheel to PYTHON_TOOLCHAIN to make sure that PEP 517 packages have a complete build system |
f720722 | build/pkgs/sagelib/src/tox.ini: Add factor nobuildisolation |
c451b31 | src/setup.cfg.m4 (install_requires): Add sage_conf |
6700223 | Merge tag '9.3.rc0' into t/30913/sagelib__add_setup_cfg__install_requires_ |
ac0f563 | Merge branch 't/30913/sagelib__add_setup_cfg__install_requires_' into t/29039/pip_installable_package_sage_bootstrap |
mkoeppe commented
Description changed:
---
+++
@@ -30,6 +30,7 @@
```
./sage -sh -c build/pkgs/sage_conf/spkg-src
```
+(The source distribution has been uploaded to https://pypi.org/project/sage-conf/)
Follow-up steps:
- Make SAGE_ROOT configurable by the user (by passing `--prefix` to `setup.py`).mkoeppe commented
Description changed:
---
+++
@@ -1,4 +1,4 @@
-As #30913 makes `sage_conf` a PEP517/518 `build_system` `requires` of sagelib (`sagemath-standard`), also a version of `sage_conf` must be made available on PyPI.
+As #30913 makes `sage_conf` both (a) a PEP517/518 `build_system` `requires` and (b) an `install-requires` of sagelib (`sagemath-standard`), also a version of `sage_conf` must be made available on PyPI.
This version of `sage_conf` includes a copy of `SAGE_ROOT` and `SAGE_ROOT/build/**` in its source distribution. On installation (or wheel building) it establishes a python-less SAGE_LOCAL hierarchy (#31362) in `~/.sage/` by running `configure` and `make build-local`; and then installs the configured `sage_conf.py` (#29038) as a Python module (and `sage-config`, `sage-env-config`).
dimpase commented
comment:57
what does the change to build/pkgs/sagelib/src/MANIFEST.in mean? is it becoming a symbolic link?
dimpase commented
comment:58
after merging 9.3.rc2 in, I get an error (is it from sh: line 0: .: .homebrew-build-env: file not found, cf below ?):
$ ./bootstrap && (cd src/pkgs/sage_conf-pypi/ && tox -v -v -v)
...
warning: no previously-included files matching '__pycache__' found anywhere in distribution
warning: no previously-included files matching '*.pyc' found anywhere in distribution
writing manifest file '/home/scratch2/dimpase/tmp/pip-modern-metadata-27nf1gz1/sage_conf.egg-info/SOURCES.txt'
creating '/home/scratch2/dimpase/tmp/pip-modern-metadata-27nf1gz1/sage_conf.dist-info'
Preparing wheel metadata ... done
Source in /home/scratch2/dimpase/tmp/pip-req-build-0rrkid61 has version 9.3rc2, which satisfies requirement sage-conf==9.3rc2 from file:///home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/.tmp/package/1/sage_conf-9.3rc2.zip
Removed sage-conf==9.3rc2 from file:///home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/.tmp/package/1/sage_conf-9.3rc2.zip from build tracker '/home/scratch2/dimpase/tmp/pip-req-tracker-bla_u_md'
Created temporary directory: /home/scratch2/dimpase/tmp/pip-unpack-rwlm13mn
Building wheels for collected packages: sage-conf
Created temporary directory: /home/scratch2/dimpase/tmp/pip-wheel-k4duer3n
Destination directory: /home/scratch2/dimpase/tmp/pip-wheel-k4duer3n
Running command /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/bin/python /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py build_wheel /home/scratch2/dimpase/tmp/tmpdhib0roj
running bdist_wheel
running build
running build_py
sh: line 0: .: .homebrew-build-env: file not found
Running cd /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.rc2-cpython-37m-x86_64-linux-gnu && . .homebrew-build-env 2>&1; : && ./configure --prefix=/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.rc2-cpython-37m-x86_64-linux-gnu/local --with-python=/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/bin/python --with-system-python3=force --disable-notebook --disable-sagelib
error: configure failed
Building wheel for sage-conf (PEP 517) ... error
ERROR: Failed building wheel for sage-conf
Failed to build sage-conf
ERROR: Could not build wheels for sage-conf which use PEP 517 and cannot be installed directly
Exception information:
Traceback (most recent call last):
File "/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 189, in _main
status = self.run(options, args)
File "/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 178, in wrapper
return func(self, options, args)
File "/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 361, in run
", ".join(pep517_build_failure_names)
pip._internal.exceptions.InstallationError: Could not build wheels for sage-conf which use PEP 517 and cannot be installed directly
Removed build tracker: '/home/scratch2/dimpase/tmp/pip-req-tracker-bla_u_md'
python finish: installpkg after 3.39 seconds
python start: envreport
setting PATH=/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/bin:/users/dimpase/perl5/bin:/users/dimpase/bin:/usr/libexec/python3-sphinx:/usr/lib64/qt-3.3/bin:/usr/share/Modules/bin:/usr/lib64/ccache:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/users/dimpase/.cabal/bin:/auto/users/dimpase/bin
/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi$ /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/bin/python -m pip freeze >/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/log/python-3.log
python finish: envreport after 0.20 seconds
python installed:
_________________________________________________________________________________________________ summary __________________________________________________________________________________________________
ERROR: python: InvocationError for command '/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/bin/python -m pip install --no-deps -U -v /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/.tmp/package/1/sage_conf-9.3rc2.zip' (exited with code 1)
cleanup /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/.tmp/package/1/sage_conf-9.3rc2.zip
dimpase commented
comment:59
this is on Fedora 30, in case it matters
dimpase commented
Reviewer: Dima Pasechnik
mkoeppe commented
comment:60
Replying to @dimpase:
what does the change to
build/pkgs/sagelib/src/MANIFEST.inmean? is it becoming a symbolic link?
Yes, it was duplicated with SAGE_ROOT/src/MANIFEST.in, and I replaced it with a symlink
sagetrac-git commented
sagetrac-git commented
mkoeppe commented
comment:62
Replying to @dimpase:
after merging 9.3.rc2 in, I get an error (is it from
sh: line 0: .: .homebrew-build-env: file not found, cf below ?):$ ./bootstrap && (cd src/pkgs/sage_conf-pypi/ && tox -v -v -v) ...
Thanks for testing! Is this running in a docker container? Not clear to me why the file would be missing. Anyway I have cherry-picked a related change from #31396 and made another change - please take a look if this gets farther
dimpase commented
comment:64
no, still the same error:
...
Created temporary directory: /home/scratch2/dimpase/tmp/pip-unpack-169y8koj
Building wheels for collected packages: sage-conf
Created temporary directory: /home/scratch2/dimpase/tmp/pip-wheel-exb6ynmx
Destination directory: /home/scratch2/dimpase/tmp/pip-wheel-exb6ynmx
Running command /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/bin/python /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py build_wheel /home/scratch2/dimpase/tmp/tmpvehv3h0s
running bdist_wheel
running build
running build_py
sh: line 0: .: .homebrew-build-env: file not found
Running cd /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.rc2-cpython-37m-x86_64-linux-gnu && (. .homebrew-build-env 2>&1 || :) && ./configure --prefix=/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.rc2-cpython-37m-x86_64-linux-gnu/local --with-python=/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/bin/python --with-system-python3=force --disable-notebook --disable-sagelib
error: configure failed
Building wheel for sage-conf (PEP 517) ... error
ERROR: Failed building wheel for sage-conf
Failed to build sage-conf
ERROR: Could not build wheels for sage-conf which use PEP 517 and cannot be installed directly
Exception information:
Traceback (most recent call last):
File "/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 189, in _main
status = self.run(options, args)
File "/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 178, in wrapper
return func(self, options, args)
File "/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 361, in run
", ".join(pep517_build_failure_names)
pip._internal.exceptions.InstallationError: Could not build wheels for sage-conf which use PEP 517 and cannot be installed directly
Removed build tracker: '/home/scratch2/dimpase/tmp/pip-req-tracker-_6q2pk49'
python finish: installpkg after 3.35 seconds
python start: envreport
setting PATH=/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/bin:/users/dimpase/perl5/bin:/users/dimpase/bin:/usr/libexec/python3-sphinx:/usr/lib64/qt-3.3/bin:/usr/share/Modules/bin:/usr/lib64/ccache:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/users/dimpase/.cabal/bin:/auto/users/dimpase/bin
/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi$ /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/bin/python -m pip freeze >/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/log/python-9.log
python finish: envreport after 0.20 seconds
python installed:
__________________________________________________________________________ summary ___________________________________________________________________________
ERROR: python: InvocationError for command '/home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/bin/python -m pip install --no-deps -U -v /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/.tmp/package/1/sage_conf-9.3rc2.zip' (exited with code 1)
mkoeppe commented
comment:66
Could you show what's in /home/scratch2/dimpase/sage/sage/src/pkgs/sage_conf-pypi/.tox/python/.sage/sage-9.3.rc2-cpython-37m-x86_64-linux-gnu?