Skip to content

[Bug] pip installs where TAMR is a dependency take a long time (20+ min) #177

Description

@CCorrado

Issue: pip install where tamr is a dependency takes a very long time due to pip dependency resolver issues.

Versions of TAMR targeted:
tamr-unify-client>=0.13.0
tamr_toolbox[all]>=1.1.1

Potential solution: set an explicit version of the GCP dependency in setup.py rather than setting >=2.0.0.

Stack trace of running pip install where tamr_toolbox[all]>=1.1.1 is included takes 20+ minutes to run:

**06:26:12  #12 15.67 Collecting grpcio-status<2.0.dev0,>=1.33.2 (from google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5->google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:12  #12 15.69   Downloading grpcio_status-1.65.5-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.70   Downloading grpcio_status-1.65.4-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.72   Downloading grpcio_status-1.65.2-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.74   Downloading grpcio_status-1.65.1-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.75   Downloading grpcio_status-1.64.3-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.77   Downloading grpcio_status-1.64.1-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.79   Downloading grpcio_status-1.64.0-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.79 INFO: pip is still looking at multiple versions of grpcio-status to determine which version is compatible with other requirements. This could take a while.
06:26:12  #12 15.80   Downloading grpcio_status-1.63.2-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.82   Downloading grpcio_status-1.63.0-py3-none-any.whl.metadata (1.1 kB)
06:26:12  #12 15.84   Downloading grpcio_status-1.62.3-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.87   Downloading grpcio_status-1.62.2-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.88   Downloading grpcio_status-1.62.1-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.89 INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
06:26:12  #12 15.90   Downloading grpcio_status-1.62.0-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.92   Downloading grpcio_status-1.61.3-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.93   Downloading grpcio_status-1.60.2-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.95   Downloading grpcio_status-1.60.1-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.97   Downloading grpcio_status-1.60.0-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 15.99   Downloading grpcio_status-1.59.5-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.00   Downloading grpcio_status-1.59.3-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.02   Downloading grpcio_status-1.59.2-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.04   Downloading grpcio_status-1.59.0-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.05   Downloading grpcio_status-1.58.3-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.07   Downloading grpcio_status-1.58.0-py3-none-any.whl.metadata (1.3 kB)
06:26:12  #12 16.08   Downloading grpcio_status-1.57.0-py3-none-any.whl.metadata (1.2 kB)
06:26:13  #12 16.10   Downloading grpcio_status-1.56.2-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.11   Downloading grpcio_status-1.56.0-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.13   Downloading grpcio_status-1.55.3-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.15   Downloading grpcio_status-1.54.3-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.16   Downloading grpcio_status-1.54.2-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.18   Downloading grpcio_status-1.54.0-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.20   Downloading grpcio_status-1.53.2-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.21   Downloading grpcio_status-1.53.1-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.23   Downloading grpcio_status-1.53.0-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.25   Downloading grpcio_status-1.51.3-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.26   Downloading grpcio_status-1.51.1-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.28   Downloading grpcio_status-1.50.0-py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 16.30   Downloading grpcio_status-1.49.1-py3-none-any.whl.metadata (1.3 kB)
**06:26:13  #12 16.31 Collecting googleapis-common-protos<2.0.dev0,>=1.56.2 (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5->google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5->google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:13  #12 16.32   Downloading googleapis_common_protos-1.64.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.36   Downloading googleapis_common_protos-1.63.2-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.40   Downloading googleapis_common_protos-1.63.1-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.50   Downloading googleapis_common_protos-1.63.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.62   Downloading googleapis_common_protos-1.62.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.66   Downloading googleapis_common_protos-1.61.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.70   Downloading googleapis_common_protos-1.60.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.73   Downloading googleapis_common_protos-1.59.1-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.77   Downloading googleapis_common_protos-1.59.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.81   Downloading googleapis_common_protos-1.58.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.85   Downloading googleapis_common_protos-1.57.1-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.89   Downloading googleapis_common_protos-1.57.0-py2.py3-none-any.whl.metadata (1.5 kB)
06:26:13  #12 16.93   Downloading googleapis_common_protos-1.56.4-py2.py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 17.03   Downloading googleapis_common_protos-1.56.3-py2.py3-none-any.whl.metadata (1.3 kB)
06:26:13  #12 17.06   Downloading googleapis_common_protos-1.56.2-py2.py3-none-any.whl.metadata (1.3 kB)
**06:26:13  #12 17.15 Collecting proto-plus<2.0.0dev,>=1.15.0 (from google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:14  #12 17.16   Downloading proto_plus-1.23.0-py3-none-any.whl.metadata (2.2 kB)
06:26:14  #12 17.60   Downloading proto_plus-1.22.3-py3-none-any.whl.metadata (2.2 kB)
**06:26:15  #12 18.11 Collecting google-cloud-core<3.0.0dev,>=1.3.0 (from google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:15  #12 18.12   Downloading google_cloud_core-2.4.0-py2.py3-none-any.whl.metadata (2.7 kB)
**06:26:16  #12 19.65 Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5 (from google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:16  #12 19.66   Downloading google_api_core-2.19.1-py3-none-any.whl.metadata (2.7 kB)
06:26:18  #12 21.14   Downloading google_api_core-2.19.0-py3-none-any.whl.metadata (2.7 kB)
06:26:19  #12 22.96   Downloading google_api_core-2.18.0-py3-none-any.whl.metadata (2.7 kB)
06:26:21  #12 24.68   Downloading google_api_core-2.17.1-py3-none-any.whl.metadata (2.7 kB)
**06:26:23  #12 26.36 Collecting proto-plus<2.0.0dev,>=1.15.0 (from google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:23  #12 26.37   Downloading proto_plus-1.22.2-py3-none-any.whl.metadata (2.2 kB)
06:26:23  #12 26.92   Downloading proto_plus-1.22.1-py3-none-any.whl.metadata (2.1 kB)
06:26:24  #12 27.47   Downloading proto_plus-1.22.0-py3-none-any.whl.metadata (2.1 kB)
06:26:24  #12 28.02   Downloading proto_plus-1.20.6-py3-none-any.whl.metadata (2.1 kB)
06:26:25  #12 28.57   Downloading proto_plus-1.20.5-py3-none-any.whl.metadata (2.1 kB)
06:26:25  #12 29.10   Downloading proto_plus-1.20.4-py3-none-any.whl.metadata (2.1 kB)
06:26:26  #12 29.64   Downloading proto_plus-1.20.3-py3-none-any.whl.metadata (2.3 kB)
06:26:27  #12 30.19   Downloading proto_plus-1.20.2-py3-none-any.whl.metadata (2.3 kB)
06:26:27  #12 30.73   Downloading proto_plus-1.20.1-py3-none-any.whl.metadata (2.2 kB)
06:26:28  #12 31.27   Downloading proto_plus-1.20.0-py3-none-any.whl.metadata (2.2 kB)
06:26:28  #12 31.82   Downloading proto_plus-1.19.9-py3-none-any.whl.metadata (2.2 kB)
06:26:29  #12 32.37   Downloading proto_plus-1.19.8-py3-none-any.whl.metadata (2.2 kB)
06:26:29  #12 32.91   Downloading proto_plus-1.19.7-py3-none-any.whl.metadata (2.2 kB)
06:26:30  #12 33.45   Downloading proto_plus-1.19.6-py3-none-any.whl.metadata (2.2 kB)
06:26:31  #12 34.20   Downloading proto_plus-1.19.5-py3-none-any.whl.metadata (2.2 kB)
06:26:31  #12 34.67   Downloading proto_plus-1.19.4-py3-none-any.whl.metadata (2.2 kB)
06:26:32  #12 35.13   Downloading proto_plus-1.19.3-py3-none-any.whl.metadata (2.2 kB)
06:26:32  #12 35.60   Downloading proto_plus-1.19.2-py3-none-any.whl.metadata (2.2 kB)
06:26:32  #12 36.07   Downloading proto_plus-1.19.1-py3-none-any.whl.metadata (2.2 kB)
06:26:33  #12 36.54   Downloading proto_plus-1.19.0-py3-none-any.whl.metadata (2.2 kB)
06:26:34  #12 37.01   Downloading proto_plus-1.18.1-py3-none-any.whl.metadata (2.2 kB)
06:26:34  #12 37.48   Downloading proto_plus-1.18.0-py3-none-any.whl.metadata (2.2 kB)
06:26:34  #12 37.95   Downloading proto_plus-1.17.0-py3-none-any.whl.metadata (2.2 kB)
06:26:35  #12 38.42   Downloading proto_plus-1.16.0-py3-none-any.whl.metadata (2.2 kB)
06:26:35  #12 38.88   Downloading proto_plus-1.15.0-py3-none-any.whl.metadata (2.2 kB)
**06:26:36  #12 39.34 Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5 (from google-cloud-translate==3.7.4->tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:26:36  #12 39.35   Downloading google_api_core-2.17.0-py3-none-any.whl.metadata (2.7 kB)
06:26:51  #12 53.58   Downloading google_api_core-2.16.2-py3-none-any.whl.metadata (2.7 kB)
06:27:06  #12 67.75   Downloading google_api_core-2.16.1-py3-none-any.whl.metadata (2.7 kB)
06:27:21  #12 82.06   Downloading google_api_core-2.16.0-py3-none-any.whl.metadata (2.7 kB)
06:27:33  #12 96.18   Downloading google_api_core-2.15.0-py3-none-any.whl.metadata (2.7 kB)
06:27:47  #12 110.5 INFO: pip is looking at multiple versions of google-api-core[grpc] to determine which version is compatible with other requirements. This could take a while.
06:28:55  #12 172.1 INFO: pip is still looking at multiple versions of google-api-core[grpc] to determine which version is compatible with other requirements. This could take a while.
**06:29:17  #12 200.4 Collecting google-cloud-storage>=2.0.0 (from tamr_toolbox[all]>=1.1.1->-r requirements.txt (line 2))**
06:29:17  #12 200.5   Downloading google_cloud_storage-2.18.1-py2.py3-none-any.whl.metadata (9.1 kB)
06:31:23  #12 320.3 INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
06:33:15  #12 429.5   Downloading google_cloud_storage-2.18.0-py2.py3-none-any.whl.metadata (9.1 kB)
06:37:06  #12 659.1   Downloading google_cloud_storage-2.17.0-py2.py3-none-any.whl.metadata (6.6 kB)
06:40:58  #12 888.0   Downloading google_cloud_storage-2.16.0-py2.py3-none-any.whl.metadata (6.1 kB)
06:44:49  #12 1118.2   Downloading google_cloud_storage-2.15.0-py2.py3-none-any.whl.metadata (6.1 kB)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions