Build error - dependency conflict between awscli and botocore

[nilskelleter]

I've created my environment with make setup a week ago, today I got the following build error after a make clean:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
awscli 1.21.4 requires botocore==1.22.4, but you have botocore 1.22.9 which is incompatible.

The error is raised during installing the dependency from ecom.

I've fixed this issue by upgrading the awscli manually with pip3 install --upgrade awscli, below you can find the pip3 list outputs before and after the upgrade.

It seems that during the build the latest version of botocore is used if boto3 in /shared/ecom/requirements.txt is installed but not the latest version of awscli from /requirements.txt.

Maybe it is possible to fix the dependency versions to avoid this error. If this is not possible there should be hint in the documentation how to upgrade the awscli manually.

Before upgrade:

Package            Version
------------------ ---------
argcomplete        1.12.3
astroid            2.8.4
attrs              21.2.0
aws-requests-auth  0.4.3
aws-sam-translator 1.39.0
awscli             1.21.4
boto3              1.19.4
botocore           1.22.4
Brotli             1.0.9
certifi            2021.10.8
cfn-lint           0.54.3
charset-normalizer 2.0.7
click              8.0.3
colorama           0.4.3
ConfigArgParse     1.5.3
coverage           6.0.2
docutils           0.15.2
Flask              2.0.2
Flask-BasicAuth    0.2.0
gevent             21.8.0
geventhttpclient   1.5.3
greenlet           1.1.2
idna               3.3
isort              5.9.3
itsdangerous       2.0.1
Jinja2             3.0.2
jmespath           0.10.0
jsonpatch          1.32
jsonpointer        2.1
jsonschema         3.2.0
junit-xml          1.9
lazy-object-proxy  1.6.0
locust             1.0.3
MarkupSafe         2.0.1
mccabe             0.6.1
more-itertools     8.10.0
msgpack            1.0.2
networkx           2.6.3
packaging          21.0
pip                21.2.3
platformdirs       2.4.0
pluggy             0.13.1
psutil             5.8.0
py                 1.10.0
pyasn1             0.4.8
pylint             2.11.1
pyparsing          3.0.1
pyrsistent         0.18.0
pytest             5.4.3
pytest-cov         2.8.1
python-dateutil    2.8.2
PyYAML             5.4.1
pyzmq              22.3.0
requests           2.26.0
requests-mock      1.9.3
rsa                4.7.2
s3transfer         0.5.0
setuptools         57.4.0
six                1.16.0
toml               0.10.2
typing-extensions  3.10.0.2
urllib3            1.26.7
wcwidth            0.2.5
websockets         9.1
Werkzeug           2.0.2
wrapt              1.13.2
xmltodict          0.12.0
yq                 2.12.2
zope.event         4.5.0
zope.interface     5.4.0

After upgrade

Package            Version
------------------ ---------
argcomplete        1.12.3
astroid            2.8.4
attrs              21.2.0
aws-requests-auth  0.4.3
aws-sam-translator 1.39.0
awscli             1.21.9
boto3              1.19.4
botocore           1.22.9
Brotli             1.0.9
certifi            2021.10.8
cfn-lint           0.54.3
charset-normalizer 2.0.7
click              8.0.3
colorama           0.4.3
ConfigArgParse     1.5.3
coverage           6.0.2
docutils           0.15.2
Flask              2.0.2
Flask-BasicAuth    0.2.0
gevent             21.8.0
geventhttpclient   1.5.3
greenlet           1.1.2
idna               3.3
isort              5.9.3
itsdangerous       2.0.1
Jinja2             3.0.2
jmespath           0.10.0
jsonpatch          1.32
jsonpointer        2.1
jsonschema         3.2.0
junit-xml          1.9
lazy-object-proxy  1.6.0
locust             1.0.3
MarkupSafe         2.0.1
mccabe             0.6.1
more-itertools     8.10.0
msgpack            1.0.2
networkx           2.6.3
packaging          21.0
pip                21.2.3
platformdirs       2.4.0
pluggy             0.13.1
psutil             5.8.0
py                 1.10.0
pyasn1             0.4.8
pylint             2.11.1
pyparsing          3.0.1
pyrsistent         0.18.0
pytest             5.4.3
pytest-cov         2.8.1
python-dateutil    2.8.2
PyYAML             5.4.1
pyzmq              22.3.0
requests           2.26.0
requests-mock      1.9.3
rsa                4.7.2
s3transfer         0.5.0
setuptools         57.4.0
six                1.16.0
toml               0.10.2
typing-extensions  3.10.0.2
urllib3            1.26.7
wcwidth            0.2.5
websockets         9.1
Werkzeug           2.0.2
wrapt              1.13.2
xmltodict          0.12.0
yq                 2.12.2
zope.event         4.5.0
zope.interface     5.4.0