Dvc: libhdfs.dylib not found (pip); pyarrow missing (brew)
Bug Report
When running dvc pull in a freshly cloned repo (https://neemgit.informatik.uni-bremen.de/neems/ease-2020-pr2-setting-up-table) I get
ERROR: unexpected error - Unable to load libhdfs: dlopen(./libhdfs.dylib, 6): image not found
Having any troubles? Hit us up at https://dvc.org/support, we are always happy to help!
DVC version: 1.8.1 (pip)
---------------------------------
Platform: Python 3.8.5 on macOS-10.15.6-x86_64-i386-64bit
Supports: hdfs, http, https
Cache types: <https://error.dvc.org/no-dvc-cache>
Repo: dvc, git
I tried to install dvc using brew afterwards (was recommended by a colleague to use pip because of hdfs), but this mac version results in:
Everything is up to date.
ERROR: failed to pull data from the cloud - URL 'hdfs://[email protected]:9000/neems/ease-2020-pr2-setting-up-table' is supported but requires these missing dependencies: ['pyarrow']. If you have installed dvc using pip, choose one of these options to proceed:
1) Install specific missing dependencies:
pip install pyarrow
2) Install dvc package that includes those missing dependencies:
pip install 'dvc[hdfs]'
3) Install dvc package with all possible dependencies included:
pip install 'dvc[all]'
If you have installed dvc from a binary package and you are still seeing this message, please report it to us using https://github.com/iterative/dvc/issues. Thank you!
As I did not install it via pip but brew in that case, it makes no sense to follow those suggestions, thus I am here as it suggests.
Please provide information about your setup
Installed dvc via pipenv (pipenv install 'dvc[hdfs]') and then, because that didn't work, via brew (brew install dvc), also installed hadoop (brew install hadoop) (before installing dvc either way)
Output of dvc version:
pipenv install dvc[hdfs]:
$ dvc version
DVC version: 1.8.1 (pip)
---------------------------------
Platform: Python 3.8.5 on macOS-10.15.6-x86_64-i386-64bit
Supports: hdfs, http, https
Cache types: <https://error.dvc.org/no-dvc-cache>
Repo: dvc, git
brew install dvc:
$ dvc version
DVC version: 1.7.9 (brew)
---------------------------------
Platform: Python 3.8.5 on macOS-10.15.6-x86_64-i386-64bit
Supports: azure, gdrive, gs, http, https, s3, ssh, oss, webdav, webdavs
Cache types: <https://error.dvc.org/no-dvc-cache>
Repo: dvc, git
Additional Information (if any):
If applicable, please also provide a --verbose output of the command, eg: dvc add --verbose.
dvc pull --verbose
pip version:
$ dvc pull --verbose
2020-10-01 13:22:29,385 DEBUG: Check for update is enabled.
2020-10-01 13:22:29,388 DEBUG: fetched: [(3,)]
2020-10-01 13:22:29,726 DEBUG: Preparing to download data from 'hdfs://[email protected]:9000/neems/ease-2020-pr2-setting-up-table'
2020-10-01 13:22:29,726 DEBUG: Preparing to collect status from hdfs://[email protected]:9000/neems/ease-2020-pr2-setting-up-table
2020-10-01 13:22:29,727 DEBUG: Collecting information from local cache...
2020-10-01 13:22:29,727 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ba/3a27227ef9658bb4cd3c993e941553' expected 'HashInfo(name='md5', value='ba3a27227ef9658bb4cd3c993e941553', dir_info=None)' actual 'None'
2020-10-01 13:22:29,728 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/53/bd96ad032f7d8eb538497df312c5c4' expected 'HashInfo(name='md5', value='53bd96ad032f7d8eb538497df312c5c4', dir_info=None)' actual 'None'
2020-10-01 13:22:29,728 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/b7/c29eaf4387dd66bad6c1a1f75f8e8f' expected 'HashInfo(name='md5', value='b7c29eaf4387dd66bad6c1a1f75f8e8f', dir_info=None)' actual 'None'
2020-10-01 13:22:29,729 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/77/3f068998552dc597b6562d4bd4a9f6' expected 'HashInfo(name='md5', value='773f068998552dc597b6562d4bd4a9f6', dir_info=None)' actual 'None'
2020-10-01 13:22:29,729 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/7f/de2e54b33ac092e0f0d0b32f4d3e18' expected 'HashInfo(name='md5', value='7fde2e54b33ac092e0f0d0b32f4d3e18', dir_info=None)' actual 'None'
2020-10-01 13:22:29,729 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/94/e222968cc8569e4bbcd7b66e7af4d2' expected 'HashInfo(name='md5', value='94e222968cc8569e4bbcd7b66e7af4d2', dir_info=None)' actual 'None'
2020-10-01 13:22:29,730 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/13/f016fffea1163d4f795c89d3074082' expected 'HashInfo(name='md5', value='13f016fffea1163d4f795c89d3074082', dir_info=None)' actual 'None'
2020-10-01 13:22:29,730 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/45/957123731c9e56ba3261dfd7f87703' expected 'HashInfo(name='md5', value='45957123731c9e56ba3261dfd7f87703', dir_info=None)' actual 'None'
2020-10-01 13:22:29,731 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/12/4976b92663e294e36e1cc3e597012d' expected 'HashInfo(name='md5', value='124976b92663e294e36e1cc3e597012d', dir_info=None)' actual 'None'
2020-10-01 13:22:29,731 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/91/4730412ce116411d16f83d9218bae0' expected 'HashInfo(name='md5', value='914730412ce116411d16f83d9218bae0', dir_info=None)' actual 'None'
2020-10-01 13:22:29,732 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/44/7cfb32474179d170035fb8170c2751' expected 'HashInfo(name='md5', value='447cfb32474179d170035fb8170c2751', dir_info=None)' actual 'None'
2020-10-01 13:22:29,732 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/d5/97012f8db282bd682edcb88e05bf7f' expected 'HashInfo(name='md5', value='d597012f8db282bd682edcb88e05bf7f', dir_info=None)' actual 'None'
2020-10-01 13:22:29,732 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ea/7b2b484324631a3db4989e7b5b7e3f' expected 'HashInfo(name='md5', value='ea7b2b484324631a3db4989e7b5b7e3f', dir_info=None)' actual 'None'
2020-10-01 13:22:29,733 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/f0/7292c2251a97e2bbea2e593bc1d28b' expected 'HashInfo(name='md5', value='f07292c2251a97e2bbea2e593bc1d28b', dir_info=None)' actual 'None'
2020-10-01 13:22:29,733 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/33/a3e4f05cce089ccd7c8714e5536847' expected 'HashInfo(name='md5', value='33a3e4f05cce089ccd7c8714e5536847', dir_info=None)' actual 'None'
2020-10-01 13:22:29,734 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/1a/ea1cc76d86b5028eaefce00e0d3dc6' expected 'HashInfo(name='md5', value='1aea1cc76d86b5028eaefce00e0d3dc6', dir_info=None)' actual 'None'
2020-10-01 13:22:29,734 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/a5/8a1537d99ab504ff42fd2adaeec761' expected 'HashInfo(name='md5', value='a58a1537d99ab504ff42fd2adaeec761', dir_info=None)' actual 'None'
2020-10-01 13:22:29,734 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/f7/fe5cfabb02f79424b6ff5dbc5ca2a2' expected 'HashInfo(name='md5', value='f7fe5cfabb02f79424b6ff5dbc5ca2a2', dir_info=None)' actual 'None'
2020-10-01 13:22:29,735 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/15/cf93c6075bb98edfaedb1f3d2cbed1' expected 'HashInfo(name='md5', value='15cf93c6075bb98edfaedb1f3d2cbed1', dir_info=None)' actual 'None'
2020-10-01 13:22:29,735 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/77/0dc681d33ef693cb81eb1eb5022d33' expected 'HashInfo(name='md5', value='770dc681d33ef693cb81eb1eb5022d33', dir_info=None)' actual 'None'
2020-10-01 13:22:29,736 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/74/01361e1a828043d402b5c62b4c095b' expected 'HashInfo(name='md5', value='7401361e1a828043d402b5c62b4c095b', dir_info=None)' actual 'None'
2020-10-01 13:22:29,736 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/3c/4c541bbe45ca91e6cd014768fa8e5c' expected 'HashInfo(name='md5', value='3c4c541bbe45ca91e6cd014768fa8e5c', dir_info=None)' actual 'None'
2020-10-01 13:22:29,736 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/f4/a9a5942ce4dd9c5bd9daa6be26d11a' expected 'HashInfo(name='md5', value='f4a9a5942ce4dd9c5bd9daa6be26d11a', dir_info=None)' actual 'None'
2020-10-01 13:22:29,737 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/66/fc5648a8c73a3f19c23c707d183af1' expected 'HashInfo(name='md5', value='66fc5648a8c73a3f19c23c707d183af1', dir_info=None)' actual 'None'
2020-10-01 13:22:29,737 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/c0/00a9bb7ac8ba325e42fffb20dbc9af' expected 'HashInfo(name='md5', value='c000a9bb7ac8ba325e42fffb20dbc9af', dir_info=None)' actual 'None'
2020-10-01 13:22:29,738 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/9d/77910e4153dbe66c7029985bff13ed' expected 'HashInfo(name='md5', value='9d77910e4153dbe66c7029985bff13ed', dir_info=None)' actual 'None'
2020-10-01 13:22:29,738 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/87/32a27407dfa88ad65d7f01d6a54c80' expected 'HashInfo(name='md5', value='8732a27407dfa88ad65d7f01d6a54c80', dir_info=None)' actual 'None'
2020-10-01 13:22:29,738 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/1f/2bc367fbabe1b1445754f351d8ee13' expected 'HashInfo(name='md5', value='1f2bc367fbabe1b1445754f351d8ee13', dir_info=None)' actual 'None'
2020-10-01 13:22:29,739 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/6e/23b65f6307167f45a4872a8ee3bf24' expected 'HashInfo(name='md5', value='6e23b65f6307167f45a4872a8ee3bf24', dir_info=None)' actual 'None'
2020-10-01 13:22:29,739 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/90/2860910eb886d761daf8dd8b47d6fe' expected 'HashInfo(name='md5', value='902860910eb886d761daf8dd8b47d6fe', dir_info=None)' actual 'None'
2020-10-01 13:22:29,740 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/69/ad073fdda7fa6452872a3619ef107b' expected 'HashInfo(name='md5', value='69ad073fdda7fa6452872a3619ef107b', dir_info=None)' actual 'None'
2020-10-01 13:22:29,740 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/10/bd425a041be3b7c8cbbde2c7b705d7' expected 'HashInfo(name='md5', value='10bd425a041be3b7c8cbbde2c7b705d7', dir_info=None)' actual 'None'
2020-10-01 13:22:29,740 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/90/357ae833385d510cf2bb8f86c171d2' expected 'HashInfo(name='md5', value='90357ae833385d510cf2bb8f86c171d2', dir_info=None)' actual 'None'
2020-10-01 13:22:29,741 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ce/ec39e25d3563a0a3d160c335fc490e' expected 'HashInfo(name='md5', value='ceec39e25d3563a0a3d160c335fc490e', dir_info=None)' actual 'None'
2020-10-01 13:22:29,741 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/f1/471d191614e4d027df601709a1145e' expected 'HashInfo(name='md5', value='f1471d191614e4d027df601709a1145e', dir_info=None)' actual 'None'
2020-10-01 13:22:29,742 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/25/251ee2fc69d0e491e5d169cd4625a4' expected 'HashInfo(name='md5', value='25251ee2fc69d0e491e5d169cd4625a4', dir_info=None)' actual 'None'
2020-10-01 13:22:29,742 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/f4/39edb81f5912f84d2c5923dd82410e' expected 'HashInfo(name='md5', value='f439edb81f5912f84d2c5923dd82410e', dir_info=None)' actual 'None'
2020-10-01 13:22:29,742 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/3f/a5075469d35c4d3d1ceb29068b0792' expected 'HashInfo(name='md5', value='3fa5075469d35c4d3d1ceb29068b0792', dir_info=None)' actual 'None'
2020-10-01 13:22:29,743 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/4e/35285a421425f9ae933f89ffcc58dc' expected 'HashInfo(name='md5', value='4e35285a421425f9ae933f89ffcc58dc', dir_info=None)' actual 'None'
2020-10-01 13:22:29,743 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/45/5a56edefe9cbb440e79f55a9155971' expected 'HashInfo(name='md5', value='455a56edefe9cbb440e79f55a9155971', dir_info=None)' actual 'None'
2020-10-01 13:22:29,744 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/38/4be10d18fa522486f7be02506911a5' expected 'HashInfo(name='md5', value='384be10d18fa522486f7be02506911a5', dir_info=None)' actual 'None'
2020-10-01 13:22:29,744 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/0e/dc2c21bda3f734fad52c94af3843a4' expected 'HashInfo(name='md5', value='0edc2c21bda3f734fad52c94af3843a4', dir_info=None)' actual 'None'
2020-10-01 13:22:29,745 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/05/cd80286e98a2cbd21b74e81e941554' expected 'HashInfo(name='md5', value='05cd80286e98a2cbd21b74e81e941554', dir_info=None)' actual 'None'
2020-10-01 13:22:29,745 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/53/cdc8350b0fb3197f9cdb6bc72e80e9' expected 'HashInfo(name='md5', value='53cdc8350b0fb3197f9cdb6bc72e80e9', dir_info=None)' actual 'None'
2020-10-01 13:22:29,745 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/5a/a4248cd68466d080a3adf5ea546d47' expected 'HashInfo(name='md5', value='5aa4248cd68466d080a3adf5ea546d47', dir_info=None)' actual 'None'
2020-10-01 13:22:29,746 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/e7/0220aebf94e91548ab0732ff6fceea' expected 'HashInfo(name='md5', value='e70220aebf94e91548ab0732ff6fceea', dir_info=None)' actual 'None'
2020-10-01 13:22:29,746 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/33/e9df280c0c4a43f616b823a8c871dd' expected 'HashInfo(name='md5', value='33e9df280c0c4a43f616b823a8c871dd', dir_info=None)' actual 'None'
2020-10-01 13:22:29,747 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/8a/0e957383f3e207761976d4fcaf5aad' expected 'HashInfo(name='md5', value='8a0e957383f3e207761976d4fcaf5aad', dir_info=None)' actual 'None'
2020-10-01 13:22:29,747 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/3b/316d03561cc6f244055c13fd2fae83' expected 'HashInfo(name='md5', value='3b316d03561cc6f244055c13fd2fae83', dir_info=None)' actual 'None'
2020-10-01 13:22:29,747 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/be/f4af027590b1525ef5ad5dc7416938' expected 'HashInfo(name='md5', value='bef4af027590b1525ef5ad5dc7416938', dir_info=None)' actual 'None'
2020-10-01 13:22:29,748 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/04/0530170ab64e1add21184e5c950aba' expected 'HashInfo(name='md5', value='040530170ab64e1add21184e5c950aba', dir_info=None)' actual 'None'
2020-10-01 13:22:29,748 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/74/050cb319708f4ad526d9b858a9bb33' expected 'HashInfo(name='md5', value='74050cb319708f4ad526d9b858a9bb33', dir_info=None)' actual 'None'
2020-10-01 13:22:29,749 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/b6/ac72c322f26d45dba7b0c6776487d6' expected 'HashInfo(name='md5', value='b6ac72c322f26d45dba7b0c6776487d6', dir_info=None)' actual 'None'
2020-10-01 13:22:29,749 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ca/59050a659a187f7915d7343ee2642b' expected 'HashInfo(name='md5', value='ca59050a659a187f7915d7343ee2642b', dir_info=None)' actual 'None'
2020-10-01 13:22:29,749 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/8b/cceebb0cdf7deffeb62f2aba711dd3' expected 'HashInfo(name='md5', value='8bcceebb0cdf7deffeb62f2aba711dd3', dir_info=None)' actual 'None'
2020-10-01 13:22:29,750 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/fe/257dd2749d8d8e93e81c1c5f7349f6' expected 'HashInfo(name='md5', value='fe257dd2749d8d8e93e81c1c5f7349f6', dir_info=None)' actual 'None'
2020-10-01 13:22:29,750 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/6c/13175a5f1d60a31a24a79ee9951a9a' expected 'HashInfo(name='md5', value='6c13175a5f1d60a31a24a79ee9951a9a', dir_info=None)' actual 'None'
2020-10-01 13:22:29,750 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/23/a71aa809dbb591246c06f500762377' expected 'HashInfo(name='md5', value='23a71aa809dbb591246c06f500762377', dir_info=None)' actual 'None'
2020-10-01 13:22:29,751 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/85/a05b9f0e9abdeb28b9a76aaa859c06' expected 'HashInfo(name='md5', value='85a05b9f0e9abdeb28b9a76aaa859c06', dir_info=None)' actual 'None'
2020-10-01 13:22:29,751 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/1d/3f1307da068db22aff6f7eb95cd6f3' expected 'HashInfo(name='md5', value='1d3f1307da068db22aff6f7eb95cd6f3', dir_info=None)' actual 'None'
2020-10-01 13:22:29,752 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/1f/b0f5d24ce095d8f38de30a3078ee74' expected 'HashInfo(name='md5', value='1fb0f5d24ce095d8f38de30a3078ee74', dir_info=None)' actual 'None'
2020-10-01 13:22:29,752 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/8e/061775b70fb10cbe69c25ecff8357f' expected 'HashInfo(name='md5', value='8e061775b70fb10cbe69c25ecff8357f', dir_info=None)' actual 'None'
2020-10-01 13:22:29,752 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/86/9a6f6bb9a7c04f8c3883f9cc27067e' expected 'HashInfo(name='md5', value='869a6f6bb9a7c04f8c3883f9cc27067e', dir_info=None)' actual 'None'
2020-10-01 13:22:29,753 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/34/ffc324d0729f8b1e4f4a03b34fe8eb' expected 'HashInfo(name='md5', value='34ffc324d0729f8b1e4f4a03b34fe8eb', dir_info=None)' actual 'None'
2020-10-01 13:22:29,753 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/16/4728c3f03174ad75471ce5c243579e' expected 'HashInfo(name='md5', value='164728c3f03174ad75471ce5c243579e', dir_info=None)' actual 'None'
2020-10-01 13:22:29,753 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/23/bafc6d6f98ecd53df2a8e15c90d7e2' expected 'HashInfo(name='md5', value='23bafc6d6f98ecd53df2a8e15c90d7e2', dir_info=None)' actual 'None'
2020-10-01 13:22:29,754 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/9a/0b60f2888ccb0900a77eb937129fb0' expected 'HashInfo(name='md5', value='9a0b60f2888ccb0900a77eb937129fb0', dir_info=None)' actual 'None'
2020-10-01 13:22:29,754 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/3f/060aecee69775504b6413dad9ee42d' expected 'HashInfo(name='md5', value='3f060aecee69775504b6413dad9ee42d', dir_info=None)' actual 'None'
2020-10-01 13:22:29,755 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/50/8386ae198c49a98b735518da15edd8' expected 'HashInfo(name='md5', value='508386ae198c49a98b735518da15edd8', dir_info=None)' actual 'None'
2020-10-01 13:22:29,755 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ec/87927da9cedd6d4fec8d09ea65164a' expected 'HashInfo(name='md5', value='ec87927da9cedd6d4fec8d09ea65164a', dir_info=None)' actual 'None'
2020-10-01 13:22:29,755 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/f4/1620412a62101501264f10f3ec31ca' expected 'HashInfo(name='md5', value='f41620412a62101501264f10f3ec31ca', dir_info=None)' actual 'None'
2020-10-01 13:22:29,756 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/18/233a83828873f664b0fb621846bfeb' expected 'HashInfo(name='md5', value='18233a83828873f664b0fb621846bfeb', dir_info=None)' actual 'None'
2020-10-01 13:22:29,756 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/11/9f5655f3d222f6d66dbfb517d9cc61' expected 'HashInfo(name='md5', value='119f5655f3d222f6d66dbfb517d9cc61', dir_info=None)' actual 'None'
2020-10-01 13:22:29,756 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/87/3cc6e252d82f05557a6a7b073e1627' expected 'HashInfo(name='md5', value='873cc6e252d82f05557a6a7b073e1627', dir_info=None)' actual 'None'
2020-10-01 13:22:29,757 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/a9/6327ca1fc3f2e39784af93dc0f2998' expected 'HashInfo(name='md5', value='a96327ca1fc3f2e39784af93dc0f2998', dir_info=None)' actual 'None'
2020-10-01 13:22:29,757 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/92/1e4278d980b9fc8640a1aa12784248' expected 'HashInfo(name='md5', value='921e4278d980b9fc8640a1aa12784248', dir_info=None)' actual 'None'
2020-10-01 13:22:29,758 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/7a/8f86104eedc4abdb52165b1248acec' expected 'HashInfo(name='md5', value='7a8f86104eedc4abdb52165b1248acec', dir_info=None)' actual 'None'
2020-10-01 13:22:29,758 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/d7/ec8805f86045a0be659c7b0d1f084e' expected 'HashInfo(name='md5', value='d7ec8805f86045a0be659c7b0d1f084e', dir_info=None)' actual 'None'
2020-10-01 13:22:29,758 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/31/903fc5850948f8975a946341072446' expected 'HashInfo(name='md5', value='31903fc5850948f8975a946341072446', dir_info=None)' actual 'None'
2020-10-01 13:22:29,759 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/bc/0ed8c55f15a69acdcdf67d81e986f5' expected 'HashInfo(name='md5', value='bc0ed8c55f15a69acdcdf67d81e986f5', dir_info=None)' actual 'None'
2020-10-01 13:22:29,759 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/15/6a0dffa11e933dae3add61e622172c' expected 'HashInfo(name='md5', value='156a0dffa11e933dae3add61e622172c', dir_info=None)' actual 'None'
2020-10-01 13:22:29,759 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/50/fa0d4d79f42d0b7f74a79873149f69' expected 'HashInfo(name='md5', value='50fa0d4d79f42d0b7f74a79873149f69', dir_info=None)' actual 'None'
2020-10-01 13:22:29,760 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/b3/d80427d4c69afb5ec5d0bd26d9dd31' expected 'HashInfo(name='md5', value='b3d80427d4c69afb5ec5d0bd26d9dd31', dir_info=None)' actual 'None'
2020-10-01 13:22:29,760 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/96/96352cc04dcee6e6fef9a0a08fdf5f' expected 'HashInfo(name='md5', value='9696352cc04dcee6e6fef9a0a08fdf5f', dir_info=None)' actual 'None'
2020-10-01 13:22:29,761 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/e5/1de5881bb5ffc4144e62e6d56ccfb2' expected 'HashInfo(name='md5', value='e51de5881bb5ffc4144e62e6d56ccfb2', dir_info=None)' actual 'None'
2020-10-01 13:22:29,761 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/62/251b88690e1522975498bb7989ef92' expected 'HashInfo(name='md5', value='62251b88690e1522975498bb7989ef92', dir_info=None)' actual 'None'
2020-10-01 13:22:29,761 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/4b/081a9efa68d3ea22b9e66e7486b1f3' expected 'HashInfo(name='md5', value='4b081a9efa68d3ea22b9e66e7486b1f3', dir_info=None)' actual 'None'
2020-10-01 13:22:29,762 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ad/ceef4b9fbb35b3e50785d8579a28b2' expected 'HashInfo(name='md5', value='adceef4b9fbb35b3e50785d8579a28b2', dir_info=None)' actual 'None'
2020-10-01 13:22:29,763 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/0b/b45b480bcf9574ee77c6bf26216668' expected 'HashInfo(name='md5', value='0bb45b480bcf9574ee77c6bf26216668', dir_info=None)' actual 'None'
2020-10-01 13:22:29,763 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/0f/cdfb67ec01ea917aa3f6e3e7c67777' expected 'HashInfo(name='md5', value='0fcdfb67ec01ea917aa3f6e3e7c67777', dir_info=None)' actual 'None'
2020-10-01 13:22:29,763 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/d5/4083768230aaef76b3ca042453ab68' expected 'HashInfo(name='md5', value='d54083768230aaef76b3ca042453ab68', dir_info=None)' actual 'None'
2020-10-01 13:22:29,764 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/58/b6dbfc981ea68f8b4224f45489a298' expected 'HashInfo(name='md5', value='58b6dbfc981ea68f8b4224f45489a298', dir_info=None)' actual 'None'
2020-10-01 13:22:29,764 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/29/9e22446915c30cda2fa39a9ee73114' expected 'HashInfo(name='md5', value='299e22446915c30cda2fa39a9ee73114', dir_info=None)' actual 'None'
2020-10-01 13:22:29,765 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/7c/426db35f320cb10ec43b706b3e1ae4' expected 'HashInfo(name='md5', value='7c426db35f320cb10ec43b706b3e1ae4', dir_info=None)' actual 'None'
2020-10-01 13:22:29,765 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/cf/a4eb64a599f6376f09e7985248507c' expected 'HashInfo(name='md5', value='cfa4eb64a599f6376f09e7985248507c', dir_info=None)' actual 'None'
2020-10-01 13:22:29,766 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/83/036a2bf12b0a195f66791d461c50bb' expected 'HashInfo(name='md5', value='83036a2bf12b0a195f66791d461c50bb', dir_info=None)' actual 'None'
2020-10-01 13:22:29,766 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/43/17ea756a9814e587b6e7d1cc05c743' expected 'HashInfo(name='md5', value='4317ea756a9814e587b6e7d1cc05c743', dir_info=None)' actual 'None'
2020-10-01 13:22:29,767 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/7b/787cae758fcc423dca0aa41c91e3f7' expected 'HashInfo(name='md5', value='7b787cae758fcc423dca0aa41c91e3f7', dir_info=None)' actual 'None'
2020-10-01 13:22:29,767 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/1b/a4d43652e56cda1b77c4339884ef7a' expected 'HashInfo(name='md5', value='1ba4d43652e56cda1b77c4339884ef7a', dir_info=None)' actual 'None'
2020-10-01 13:22:29,768 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/3f/99b97afa64bf540a237fdf2a6a8180' expected 'HashInfo(name='md5', value='3f99b97afa64bf540a237fdf2a6a8180', dir_info=None)' actual 'None'
2020-10-01 13:22:29,769 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/8f/3cfc2c14853a4954570b1679914178' expected 'HashInfo(name='md5', value='8f3cfc2c14853a4954570b1679914178', dir_info=None)' actual 'None'
2020-10-01 13:22:29,769 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/10/3e44dcef998d458c8bc62dfc36865f' expected 'HashInfo(name='md5', value='103e44dcef998d458c8bc62dfc36865f', dir_info=None)' actual 'None'
2020-10-01 13:22:29,770 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/a4/731f9b4780ee1f8c110f5ea2c14d44' expected 'HashInfo(name='md5', value='a4731f9b4780ee1f8c110f5ea2c14d44', dir_info=None)' actual 'None'
2020-10-01 13:22:29,770 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/2c/f14f2d02d50839b93e74c8d19dc7f9' expected 'HashInfo(name='md5', value='2cf14f2d02d50839b93e74c8d19dc7f9', dir_info=None)' actual 'None'
2020-10-01 13:22:29,770 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/82/1b19d58753bb42ad2c4148919e523e' expected 'HashInfo(name='md5', value='821b19d58753bb42ad2c4148919e523e', dir_info=None)' actual 'None'
2020-10-01 13:22:29,771 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/3d/70fbffe66c20659e357a220169afb0' expected 'HashInfo(name='md5', value='3d70fbffe66c20659e357a220169afb0', dir_info=None)' actual 'None'
2020-10-01 13:22:29,771 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/78/7ce2d8d3f49068a08ca193326d78ba' expected 'HashInfo(name='md5', value='787ce2d8d3f49068a08ca193326d78ba', dir_info=None)' actual 'None'
2020-10-01 13:22:29,772 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/f2/041d6b6dfd6ba1da2914235b9e0acb' expected 'HashInfo(name='md5', value='f2041d6b6dfd6ba1da2914235b9e0acb', dir_info=None)' actual 'None'
2020-10-01 13:22:29,772 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/43/61573925c0d15963cb0d0d60ab3328' expected 'HashInfo(name='md5', value='4361573925c0d15963cb0d0d60ab3328', dir_info=None)' actual 'None'
2020-10-01 13:22:29,772 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/2d/205f14d25c03cdc6904f75610b5e94' expected 'HashInfo(name='md5', value='2d205f14d25c03cdc6904f75610b5e94', dir_info=None)' actual 'None'
2020-10-01 13:22:29,773 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/29/5f1cdd37e7736095512de4cec96eba' expected 'HashInfo(name='md5', value='295f1cdd37e7736095512de4cec96eba', dir_info=None)' actual 'None'
2020-10-01 13:22:29,773 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/af/3249043045fcd9d4c28d4b994af5d5' expected 'HashInfo(name='md5', value='af3249043045fcd9d4c28d4b994af5d5', dir_info=None)' actual 'None'
2020-10-01 13:22:29,774 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/a6/a653ebce8e6bd41928797996bfc624' expected 'HashInfo(name='md5', value='a6a653ebce8e6bd41928797996bfc624', dir_info=None)' actual 'None'
2020-10-01 13:22:29,774 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/28/ccc8d965d4aad8ffb1bcf752a88c55' expected 'HashInfo(name='md5', value='28ccc8d965d4aad8ffb1bcf752a88c55', dir_info=None)' actual 'None'
2020-10-01 13:22:29,775 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/73/9fd7bd782ef213d8fd7a5254720a9d' expected 'HashInfo(name='md5', value='739fd7bd782ef213d8fd7a5254720a9d', dir_info=None)' actual 'None'
2020-10-01 13:22:29,775 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/8c/1afbc8dc560eccc35fe47fb151c9f1' expected 'HashInfo(name='md5', value='8c1afbc8dc560eccc35fe47fb151c9f1', dir_info=None)' actual 'None'
2020-10-01 13:22:29,776 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/4d/37a23574253dfedaaacf3980e8d567' expected 'HashInfo(name='md5', value='4d37a23574253dfedaaacf3980e8d567', dir_info=None)' actual 'None'
2020-10-01 13:22:29,776 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/55/f8c6099669e6d5e2f478445a5352aa' expected 'HashInfo(name='md5', value='55f8c6099669e6d5e2f478445a5352aa', dir_info=None)' actual 'None'
2020-10-01 13:22:29,777 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/63/806fc6a7965e6aee79868d831728cb' expected 'HashInfo(name='md5', value='63806fc6a7965e6aee79868d831728cb', dir_info=None)' actual 'None'
2020-10-01 13:22:29,778 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/db/440a70ee3004a1db4729604f4b8026' expected 'HashInfo(name='md5', value='db440a70ee3004a1db4729604f4b8026', dir_info=None)' actual 'None'
2020-10-01 13:22:29,779 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ac/8aa3c6be53243d5b123866c04980d0' expected 'HashInfo(name='md5', value='ac8aa3c6be53243d5b123866c04980d0', dir_info=None)' actual 'None'
2020-10-01 13:22:29,780 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/99/cd88c5fca844191225c1642bea9d99' expected 'HashInfo(name='md5', value='99cd88c5fca844191225c1642bea9d99', dir_info=None)' actual 'None'
2020-10-01 13:22:29,780 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/7f/1f41806644df590535f951d1fe0097' expected 'HashInfo(name='md5', value='7f1f41806644df590535f951d1fe0097', dir_info=None)' actual 'None'
2020-10-01 13:22:29,781 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/40/234a5177f0bba6da1317aab23668ad' expected 'HashInfo(name='md5', value='40234a5177f0bba6da1317aab23668ad', dir_info=None)' actual 'None'
2020-10-01 13:22:29,782 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/f2/4efa52b5e6e93840551d04ded50abc' expected 'HashInfo(name='md5', value='f24efa52b5e6e93840551d04ded50abc', dir_info=None)' actual 'None'
2020-10-01 13:22:29,783 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/df/22e1536e2c166501bc8a5417dad01a' expected 'HashInfo(name='md5', value='df22e1536e2c166501bc8a5417dad01a', dir_info=None)' actual 'None'
2020-10-01 13:22:29,784 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/4c/5de5fd432b81f97cc7236d9bd194f8' expected 'HashInfo(name='md5', value='4c5de5fd432b81f97cc7236d9bd194f8', dir_info=None)' actual 'None'
2020-10-01 13:22:29,784 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ab/c9135077c735ec028e25c31fa90fbe' expected 'HashInfo(name='md5', value='abc9135077c735ec028e25c31fa90fbe', dir_info=None)' actual 'None'
2020-10-01 13:22:29,785 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ba/4cfc509e5bb09599489d993309b79b' expected 'HashInfo(name='md5', value='ba4cfc509e5bb09599489d993309b79b', dir_info=None)' actual 'None'
2020-10-01 13:22:29,785 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/07/0b94261592ff849c30e7c83e796226' expected 'HashInfo(name='md5', value='070b94261592ff849c30e7c83e796226', dir_info=None)' actual 'None'
2020-10-01 13:22:29,785 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/8a/50791565232ab5d96dcb57f675d4fd' expected 'HashInfo(name='md5', value='8a50791565232ab5d96dcb57f675d4fd', dir_info=None)' actual 'None'
2020-10-01 13:22:29,786 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/a3/4c2b9f7db9c4bc84736af58bad92d0' expected 'HashInfo(name='md5', value='a34c2b9f7db9c4bc84736af58bad92d0', dir_info=None)' actual 'None'
2020-10-01 13:22:29,786 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/d3/9e6d1f2b87a72535a8133e7b3ed603' expected 'HashInfo(name='md5', value='d39e6d1f2b87a72535a8133e7b3ed603', dir_info=None)' actual 'None'
2020-10-01 13:22:29,786 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/18/3df4095e92f258d6deb86570bb1120' expected 'HashInfo(name='md5', value='183df4095e92f258d6deb86570bb1120', dir_info=None)' actual 'None'
2020-10-01 13:22:29,787 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/3a/671ae88f7aca1d7ad9e5c2d24024a4' expected 'HashInfo(name='md5', value='3a671ae88f7aca1d7ad9e5c2d24024a4', dir_info=None)' actual 'None'
2020-10-01 13:22:29,787 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/fb/fc6aeac8463b69c2a47ff78f07973c' expected 'HashInfo(name='md5', value='fbfc6aeac8463b69c2a47ff78f07973c', dir_info=None)' actual 'None'
2020-10-01 13:22:29,788 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/e6/2d547074f02a694c797ad1e5f157d3' expected 'HashInfo(name='md5', value='e62d547074f02a694c797ad1e5f157d3', dir_info=None)' actual 'None'
2020-10-01 13:22:29,788 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/03/495e47ba850e9b656eb127ad0c63e3' expected 'HashInfo(name='md5', value='03495e47ba850e9b656eb127ad0c63e3', dir_info=None)' actual 'None'
2020-10-01 13:22:29,788 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/dc/eb502c9ee4242313e622dbbf3e764a' expected 'HashInfo(name='md5', value='dceb502c9ee4242313e622dbbf3e764a', dir_info=None)' actual 'None'
2020-10-01 13:22:29,789 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/01/9f87671ba98ac23529e06a77cc8023' expected 'HashInfo(name='md5', value='019f87671ba98ac23529e06a77cc8023', dir_info=None)' actual 'None'
2020-10-01 13:22:29,789 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/28/ecca7d09c07c3211ad46757db3d018' expected 'HashInfo(name='md5', value='28ecca7d09c07c3211ad46757db3d018', dir_info=None)' actual 'None'
2020-10-01 13:22:29,789 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/88/3dd77b8d2993c3984456854c64229b' expected 'HashInfo(name='md5', value='883dd77b8d2993c3984456854c64229b', dir_info=None)' actual 'None'
2020-10-01 13:22:29,790 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/e1/32fde729c9d11efb092b8ec6e86154' expected 'HashInfo(name='md5', value='e132fde729c9d11efb092b8ec6e86154', dir_info=None)' actual 'None'
2020-10-01 13:22:29,790 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/7f/1809c48542de0a6f2499864a82c3b5' expected 'HashInfo(name='md5', value='7f1809c48542de0a6f2499864a82c3b5', dir_info=None)' actual 'None'
2020-10-01 13:22:29,790 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/31/35682b97c8ad917fc23959f70f9422' expected 'HashInfo(name='md5', value='3135682b97c8ad917fc23959f70f9422', dir_info=None)' actual 'None'
2020-10-01 13:22:29,791 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/2e/3ae220b5fdd663679ccec16cef1486' expected 'HashInfo(name='md5', value='2e3ae220b5fdd663679ccec16cef1486', dir_info=None)' actual 'None'
2020-10-01 13:22:29,791 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/e4/aa555904cebb86d64e21a9c8050130' expected 'HashInfo(name='md5', value='e4aa555904cebb86d64e21a9c8050130', dir_info=None)' actual 'None'
2020-10-01 13:22:29,792 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/b1/829770213acd6a57fe322d4ec6539a' expected 'HashInfo(name='md5', value='b1829770213acd6a57fe322d4ec6539a', dir_info=None)' actual 'None'
2020-10-01 13:22:29,792 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/27/6062711e84985fd704a078a0b414e1' expected 'HashInfo(name='md5', value='276062711e84985fd704a078a0b414e1', dir_info=None)' actual 'None'
2020-10-01 13:22:29,792 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/07/b1f5ad082880097d1921aab9f20e5c' expected 'HashInfo(name='md5', value='07b1f5ad082880097d1921aab9f20e5c', dir_info=None)' actual 'None'
2020-10-01 13:22:29,793 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/aa/9b48733db2adfa3f5b503de9878206' expected 'HashInfo(name='md5', value='aa9b48733db2adfa3f5b503de9878206', dir_info=None)' actual 'None'
2020-10-01 13:22:29,793 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/19/ffd8b37b20fee03a0b9dbe72693ea7' expected 'HashInfo(name='md5', value='19ffd8b37b20fee03a0b9dbe72693ea7', dir_info=None)' actual 'None'
2020-10-01 13:22:29,793 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/c9/a86e63c2d826df4dc2560d78ebba0d' expected 'HashInfo(name='md5', value='c9a86e63c2d826df4dc2560d78ebba0d', dir_info=None)' actual 'None'
2020-10-01 13:22:29,794 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ca/8854ffcc461b78c6c7707e821349f3' expected 'HashInfo(name='md5', value='ca8854ffcc461b78c6c7707e821349f3', dir_info=None)' actual 'None'
2020-10-01 13:22:29,794 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/94/3e406ec3637e2ba8503e536fb58879' expected 'HashInfo(name='md5', value='943e406ec3637e2ba8503e536fb58879', dir_info=None)' actual 'None'
2020-10-01 13:22:29,794 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/4f/3afbdf40a986058b031ab466503e49' expected 'HashInfo(name='md5', value='4f3afbdf40a986058b031ab466503e49', dir_info=None)' actual 'None'
2020-10-01 13:22:29,795 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/44/89737fe5fbbe2da52013f90037d219' expected 'HashInfo(name='md5', value='4489737fe5fbbe2da52013f90037d219', dir_info=None)' actual 'None'
2020-10-01 13:22:29,795 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/45/48acf0968eee02e33cc4973c9303c4' expected 'HashInfo(name='md5', value='4548acf0968eee02e33cc4973c9303c4', dir_info=None)' actual 'None'
2020-10-01 13:22:29,796 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/dc/861b75286674e535901af55cbdf92a' expected 'HashInfo(name='md5', value='dc861b75286674e535901af55cbdf92a', dir_info=None)' actual 'None'
2020-10-01 13:22:29,796 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/3e/23490bd82545ea1e354f0364140d2f' expected 'HashInfo(name='md5', value='3e23490bd82545ea1e354f0364140d2f', dir_info=None)' actual 'None'
2020-10-01 13:22:29,796 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/b0/e17bc1f4b76ffe5f8f826dd2258fcc' expected 'HashInfo(name='md5', value='b0e17bc1f4b76ffe5f8f826dd2258fcc', dir_info=None)' actual 'None'
2020-10-01 13:22:29,797 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/df/11160bc0ec1d4a425fc7b8c5a99216' expected 'HashInfo(name='md5', value='df11160bc0ec1d4a425fc7b8c5a99216', dir_info=None)' actual 'None'
2020-10-01 13:22:29,797 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/a1/611a1d3f703d33b25522a2e403c54d' expected 'HashInfo(name='md5', value='a1611a1d3f703d33b25522a2e403c54d', dir_info=None)' actual 'None'
2020-10-01 13:22:29,798 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/05/4f3aecb2f7532e014a8247db7351f9' expected 'HashInfo(name='md5', value='054f3aecb2f7532e014a8247db7351f9', dir_info=None)' actual 'None'
2020-10-01 13:22:29,798 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/73/59b89ece98dfca2b9c4b654bcb7406' expected 'HashInfo(name='md5', value='7359b89ece98dfca2b9c4b654bcb7406', dir_info=None)' actual 'None'
2020-10-01 13:22:29,798 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/60/669aac6a454a15aabc3f8b810f43b0' expected 'HashInfo(name='md5', value='60669aac6a454a15aabc3f8b810f43b0', dir_info=None)' actual 'None'
2020-10-01 13:22:29,799 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/c3/cc12761288603c1cbd0b04b70a5ab6' expected 'HashInfo(name='md5', value='c3cc12761288603c1cbd0b04b70a5ab6', dir_info=None)' actual 'None'
2020-10-01 13:22:29,799 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/8f/6745ccc77205f5144dcf2745e22df5' expected 'HashInfo(name='md5', value='8f6745ccc77205f5144dcf2745e22df5', dir_info=None)' actual 'None'
2020-10-01 13:22:29,800 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/34/77f24a9b74404c628e406c02c57242' expected 'HashInfo(name='md5', value='3477f24a9b74404c628e406c02c57242', dir_info=None)' actual 'None'
2020-10-01 13:22:29,800 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/08/fa977839c03180559a6ff2aba2a4c3' expected 'HashInfo(name='md5', value='08fa977839c03180559a6ff2aba2a4c3', dir_info=None)' actual 'None'
2020-10-01 13:22:29,800 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/b0/14a134194d43babdf8023a278a80c8' expected 'HashInfo(name='md5', value='b014a134194d43babdf8023a278a80c8', dir_info=None)' actual 'None'
2020-10-01 13:22:29,801 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/cd/6b94f8939682baecdf07b1401f691f' expected 'HashInfo(name='md5', value='cd6b94f8939682baecdf07b1401f691f', dir_info=None)' actual 'None'
2020-10-01 13:22:29,801 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/46/d482ffea9d08642079e44f84088320' expected 'HashInfo(name='md5', value='46d482ffea9d08642079e44f84088320', dir_info=None)' actual 'None'
2020-10-01 13:22:29,802 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/5d/adfd5412fa015e29ff112ebddb3e45' expected 'HashInfo(name='md5', value='5dadfd5412fa015e29ff112ebddb3e45', dir_info=None)' actual 'None'
2020-10-01 13:22:29,802 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/da/50fd18fc3a206c9257eaadcde6e48d' expected 'HashInfo(name='md5', value='da50fd18fc3a206c9257eaadcde6e48d', dir_info=None)' actual 'None'
2020-10-01 13:22:29,803 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/c5/e0c63ba9f0f5760b78ba015298446e' expected 'HashInfo(name='md5', value='c5e0c63ba9f0f5760b78ba015298446e', dir_info=None)' actual 'None'
2020-10-01 13:22:29,803 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/9b/026e255fd31d68897aa61f81795d98' expected 'HashInfo(name='md5', value='9b026e255fd31d68897aa61f81795d98', dir_info=None)' actual 'None'
2020-10-01 13:22:29,803 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/b6/4f37895292d3ee837586a6b5e4265b' expected 'HashInfo(name='md5', value='b64f37895292d3ee837586a6b5e4265b', dir_info=None)' actual 'None'
2020-10-01 13:22:29,804 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/1a/c40e19a59fa1b3dffe433c8732c780' expected 'HashInfo(name='md5', value='1ac40e19a59fa1b3dffe433c8732c780', dir_info=None)' actual 'None'
2020-10-01 13:22:29,804 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/87/305f1ace1316b17afb92c713a935be' expected 'HashInfo(name='md5', value='87305f1ace1316b17afb92c713a935be', dir_info=None)' actual 'None'
2020-10-01 13:22:29,805 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/d0/a6110d6036ca82e29f47c49138bab4' expected 'HashInfo(name='md5', value='d0a6110d6036ca82e29f47c49138bab4', dir_info=None)' actual 'None'
2020-10-01 13:22:29,805 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/c6/53e25426bcee33e3e2bf8ca251676a' expected 'HashInfo(name='md5', value='c653e25426bcee33e3e2bf8ca251676a', dir_info=None)' actual 'None'
2020-10-01 13:22:29,805 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/e1/b4f5c864479ca55b48a6b668e595ef' expected 'HashInfo(name='md5', value='e1b4f5c864479ca55b48a6b668e595ef', dir_info=None)' actual 'None'
2020-10-01 13:22:29,806 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/7f/e36a1edf456a959d512eb5ebbdb061' expected 'HashInfo(name='md5', value='7fe36a1edf456a959d512eb5ebbdb061', dir_info=None)' actual 'None'
2020-10-01 13:22:29,806 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/fd/c71f0b2bfc1fc7820ea2bba0b449b1' expected 'HashInfo(name='md5', value='fdc71f0b2bfc1fc7820ea2bba0b449b1', dir_info=None)' actual 'None'
2020-10-01 13:22:29,806 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/fd/98194999ca87fc4622f4e01095bd32' expected 'HashInfo(name='md5', value='fd98194999ca87fc4622f4e01095bd32', dir_info=None)' actual 'None'
2020-10-01 13:22:29,807 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/fb/dbedc76d21e627a3cd68e934d12bae' expected 'HashInfo(name='md5', value='fbdbedc76d21e627a3cd68e934d12bae', dir_info=None)' actual 'None'
2020-10-01 13:22:29,807 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/91/12e17bca2763a676d34d353ad3f170' expected 'HashInfo(name='md5', value='9112e17bca2763a676d34d353ad3f170', dir_info=None)' actual 'None'
2020-10-01 13:22:29,807 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/1b/215c556a2852baf013c352c9beb57b' expected 'HashInfo(name='md5', value='1b215c556a2852baf013c352c9beb57b', dir_info=None)' actual 'None'
2020-10-01 13:22:29,808 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/f2/c7effe93065fb9bb3faf34d7b62908' expected 'HashInfo(name='md5', value='f2c7effe93065fb9bb3faf34d7b62908', dir_info=None)' actual 'None'
2020-10-01 13:22:29,808 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ed/4e3ca94a1c78c6013efc4b2d64d23b' expected 'HashInfo(name='md5', value='ed4e3ca94a1c78c6013efc4b2d64d23b', dir_info=None)' actual 'None'
2020-10-01 13:22:29,809 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/80/bc05126553b109b9869b02cc2e1d99' expected 'HashInfo(name='md5', value='80bc05126553b109b9869b02cc2e1d99', dir_info=None)' actual 'None'
2020-10-01 13:22:29,809 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/6d/82c93d032febb0c8a76bee1e3eb9e1' expected 'HashInfo(name='md5', value='6d82c93d032febb0c8a76bee1e3eb9e1', dir_info=None)' actual 'None'
2020-10-01 13:22:29,809 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/c2/249116d3706570eb48f69ff4926d88' expected 'HashInfo(name='md5', value='c2249116d3706570eb48f69ff4926d88', dir_info=None)' actual 'None'
2020-10-01 13:22:29,810 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/df/741366b9e3e299652d9f28be6edf05' expected 'HashInfo(name='md5', value='df741366b9e3e299652d9f28be6edf05', dir_info=None)' actual 'None'
2020-10-01 13:22:29,810 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/76/6c78ff9120fb4ebc153832fb4c8f40' expected 'HashInfo(name='md5', value='766c78ff9120fb4ebc153832fb4c8f40', dir_info=None)' actual 'None'
2020-10-01 13:22:29,811 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ac/e2571ce3d0487bff338c20896b8caa' expected 'HashInfo(name='md5', value='ace2571ce3d0487bff338c20896b8caa', dir_info=None)' actual 'None'
2020-10-01 13:22:29,811 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/5d/b4de401f178044b852e5c1c35dd019' expected 'HashInfo(name='md5', value='5db4de401f178044b852e5c1c35dd019', dir_info=None)' actual 'None'
2020-10-01 13:22:29,812 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/ad/de924e21e3a2797ea1390f09c8faee' expected 'HashInfo(name='md5', value='adde924e21e3a2797ea1390f09c8faee', dir_info=None)' actual 'None'
2020-10-01 13:22:29,813 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/29/eade8d42896fef8e7524874bac0227' expected 'HashInfo(name='md5', value='29eade8d42896fef8e7524874bac0227', dir_info=None)' actual 'None'
2020-10-01 13:22:29,814 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/b9/44a479d7c58cc085bb61e0c47066d9' expected 'HashInfo(name='md5', value='b944a479d7c58cc085bb61e0c47066d9', dir_info=None)' actual 'None'
2020-10-01 13:22:29,814 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/a3/7bd5b4ca60f4018a96228fdbd557df' expected 'HashInfo(name='md5', value='a37bd5b4ca60f4018a96228fdbd557df', dir_info=None)' actual 'None'
2020-10-01 13:22:29,815 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/c0/d78ee125dc51827866b4e6e34621b2' expected 'HashInfo(name='md5', value='c0d78ee125dc51827866b4e6e34621b2', dir_info=None)' actual 'None'
2020-10-01 13:22:29,815 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/af/3bcd797c1a7ee6a09ac77a4314da19' expected 'HashInfo(name='md5', value='af3bcd797c1a7ee6a09ac77a4314da19', dir_info=None)' actual 'None'
2020-10-01 13:22:29,815 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/b1/1e57abc9a087f6f5da9e3faf99a1bf' expected 'HashInfo(name='md5', value='b11e57abc9a087f6f5da9e3faf99a1bf', dir_info=None)' actual 'None'
2020-10-01 13:22:29,816 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/3f/6ed31dc928522b017ed318bf5f0f70' expected 'HashInfo(name='md5', value='3f6ed31dc928522b017ed318bf5f0f70', dir_info=None)' actual 'None'
2020-10-01 13:22:29,816 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/02/0574adc49849803d82da4d4c8c8b94' expected 'HashInfo(name='md5', value='020574adc49849803d82da4d4c8c8b94', dir_info=None)' actual 'None'
2020-10-01 13:22:29,817 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/55/c394d7241a7879660a2fc7d2ef4604' expected 'HashInfo(name='md5', value='55c394d7241a7879660a2fc7d2ef4604', dir_info=None)' actual 'None'
2020-10-01 13:22:29,817 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/c2/a1fb9fb5ead2f17f92651059479650' expected 'HashInfo(name='md5', value='c2a1fb9fb5ead2f17f92651059479650', dir_info=None)' actual 'None'
2020-10-01 13:22:29,817 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/66/cec8bfaef2bcb164c503ad64645e5e' expected 'HashInfo(name='md5', value='66cec8bfaef2bcb164c503ad64645e5e', dir_info=None)' actual 'None'
2020-10-01 13:22:29,818 DEBUG: cache '/Users/shoeffner/Projects/dlu_test/ease-2020-pr2-setting-up-table/.dvc/cache/42/9eaa979d7ec30d6a6f124a0fc1ae2e' expected 'HashInfo(name='md5', value='429eaa979d7ec30d6a6f124a0fc1ae2e', dir_info=None)' actual 'None'
2020-10-01 13:22:29,818 DEBUG: Collecting information from remote cache...
2020-10-01 13:22:29,819 DEBUG: Matched '0' indexed hashes
2020-10-01 13:22:30,065 DEBUG: fetched: [(0,)]
2020-10-01 13:22:30,066 ERROR: unexpected error - Unable to load libhdfs: dlopen(./libhdfs.dylib, 6): image not found
------------------------------------------------------------
Traceback (most recent call last):
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/tree/pool.py", line 51, in get_connection
return self._conns.popleft()
IndexError: pop from an empty deque
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/main.py", line 76, in main
ret = cmd.run()
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/command/data_sync.py", line 26, in run
stats = self.repo.pull(
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/repo/__init__.py", line 51, in wrapper
return f(repo, *args, **kwargs)
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/repo/pull.py", line 25, in pull
processed_files_count = self.fetch(
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/repo/__init__.py", line 51, in wrapper
return f(repo, *args, **kwargs)
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/repo/fetch.py", line 61, in fetch
downloaded += self.cloud.pull(
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/data_cloud.py", line 84, in pull
return self.repo.cache.local.pull(
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/remote/base.py", line 15, in wrapper
return f(obj, named_cache, remote, *args, **kwargs)
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/cache/local.py", line 436, in pull
ret = self._process(
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/cache/local.py", line 321, in _process
dir_status, file_status, dir_contents = self._status(
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/cache/local.py", line 169, in _status
remote.hashes_exist(
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/remote/base.py", line 103, in hashes_exist
remote_size, remote_hashes = self.tree.estimate_remote_size(
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/tree/base.py", line 543, in estimate_remote_size
remote_hashes = set(hashes)
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/tree/base.py", line 497, in _hashes_with_limit
for hash_ in self.list_hashes(prefix, progress_callback):
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/tree/base.py", line 467, in list_hashes
for path in self.list_paths(prefix, progress_callback):
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/tree/base.py", line 455, in list_paths
for file_info in self.walk_files(path_info, prefix=prefix):
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/tree/hdfs.py", line 84, in walk_files
if not self.exists(path_info):
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/tree/hdfs.py", line 80, in exists
with self.hdfs(path_info) as hdfs:
File "/usr/local/opt/[email protected]/Frameworks/Python.framework/Versions/3.8/lib/python3.8/contextlib.py", line 113, in __enter__
return next(self.gen)
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/tree/pool.py", line 11, in get_connection
conn = pool.get_connection()
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/dvc/tree/pool.py", line 53, in get_connection
return self._conn_func(*self._conn_args, **self._conn_kwargs)
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/pyarrow/hdfs.py", line 208, in connect
fs = HadoopFileSystem(host=host, port=port, user=user,
File "/Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages/pyarrow/hdfs.py", line 40, in __init__
self._connect(host, port, user, kerb_ticket, extra_conf)
File "pyarrow/io-hdfs.pxi", line 75, in pyarrow.lib.HadoopFileSystem._connect
File "pyarrow/error.pxi", line 99, in pyarrow.lib.check_status
OSError: Unable to load libhdfs: dlopen(./libhdfs.dylib, 6): image not found
------------------------------------------------------------
Having any troubles? Hit us up at https://dvc.org/support, we are always happy to help!
DVC version: 1.8.1 (pip)
---------------------------------
Platform: Python 3.8.5 on macOS-10.15.6-x86_64-i386-64bit
Supports: hdfs, http, https
Cache types: <https://error.dvc.org/no-dvc-cache>
Repo: dvc, git
2020-10-01 13:22:30,105 DEBUG: Analytics is enabled.
2020-10-01 13:22:30,227 DEBUG: Trying to spawn '['daemon', '-q', 'analytics', '/var/folders/mb/nwwt_8ps1g7_7ml5wcpzx_v80000gn/T/tmpjb_zlvr3']'
2020-10-01 13:22:30,228 DEBUG: Spawned '['daemon', '-q', 'analytics', '/var/folders/mb/nwwt_8ps1g7_7ml5wcpzx_v80000gn/T/tmpjb_zlvr3']'
brew version:
$ dvc pull --verbose
2020-10-01 13:19:54,782 DEBUG: Check for update is enabled.
2020-10-01 13:19:54,785 DEBUG: fetched: [(3,)]
2020-10-01 13:19:55,023 DEBUG: fetched: [(0,)]
Everything is up to date.
2020-10-01 13:19:55,025 ERROR: failed to pull data from the cloud - URL 'hdfs://[email protected]:9000/neems/ease-2020-pr2-setting-up-table' is supported but requires these missing dependencies: ['pyarrow']. If you have installed dvc using pip, choose one of these options to proceed:
1) Install specific missing dependencies:
pip install pyarrow
2) Install dvc package that includes those missing dependencies:
pip install 'dvc[hdfs]'
3) Install dvc package with all possible dependencies included:
pip install 'dvc[all]'
If you have installed dvc from a binary package and you are still seeing this message, please report it to us using https://github.com/iterative/dvc/issues. Thank you!
------------------------------------------------------------
Traceback (most recent call last):
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/command/data_sync.py", line 26, in run
stats = self.repo.pull(
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/repo/__init__.py", line 51, in wrapper
return f(repo, *args, **kwargs)
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/repo/pull.py", line 25, in pull
processed_files_count = self.fetch(
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/repo/__init__.py", line 51, in wrapper
return f(repo, *args, **kwargs)
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/repo/fetch.py", line 61, in fetch
downloaded += self.cloud.pull(
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/data_cloud.py", line 82, in pull
remote = self.get_remote(remote, "pull")
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/data_cloud.py", line 30, in get_remote
return self._init_remote(name)
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/data_cloud.py", line 48, in _init_remote
return get_remote(self.repo, name=name)
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/remote/__init__.py", line 8, in get_remote
tree = get_cloud_tree(repo, **kwargs)
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/tree/__init__.py", line 88, in get_cloud_tree
return _get_tree(remote_conf)(repo, remote_conf)
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/tree/hdfs.py", line 28, in __init__
super().__init__(repo, config)
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/tree/base.py", line 67, in __init__
self._check_requires(config)
File "/usr/local/Cellar/dvc/1.7.9/libexec/lib/python3.8/site-packages/dvc/tree/base.py", line 120, in _check_requires
raise RemoteMissingDepsError(msg)
dvc.tree.base.RemoteMissingDepsError: URL 'hdfs://[email protected]:9000/neems/ease-2020-pr2-setting-up-table' is supported but requires these missing dependencies: ['pyarrow']. If you have installed dvc using pip, choose one of these options to proceed:
1) Install specific missing dependencies:
pip install pyarrow
2) Install dvc package that includes those missing dependencies:
pip install 'dvc[hdfs]'
3) Install dvc package with all possible dependencies included:
pip install 'dvc[all]'
If you have installed dvc from a binary package and you are still seeing this message, please report it to us using https://github.com/iterative/dvc/issues. Thank you!
------------------------------------------------------------
2020-10-01 13:19:55,028 DEBUG: Analytics is enabled.
2020-10-01 13:19:55,156 DEBUG: Trying to spawn '['daemon', '-q', 'analytics', '/var/folders/mb/nwwt_8ps1g7_7ml5wcpzx_v80000gn/T/tmpqtteer4y']'
2020-10-01 13:19:55,157 DEBUG: Spawned '['daemon', '-q', 'analytics', '/var/folders/mb/nwwt_8ps1g7_7ml5wcpzx_v80000gn/T/tmpqtteer4y']'
Hadoop version info:
$ brew info hadoop
hadoop: stable 3.3.0
Framework for distributed processing of large data sets
https://hadoop.apache.org/
Conflicts with:
yarn (because both install `yarn` binaries)
/usr/local/Cellar/hadoop/3.3.0 (21,819 files, 954.7MB) *
Built from source on 2020-10-01 at 12:41:08
From: https://github.com/Homebrew/homebrew-core/blob/HEAD/Formula/hadoop.rb
License: Apache-2.0
==> Dependencies
Required: openjdk ✔
==> Analytics
install: 2,486 (30 days), 7,288 (90 days), 37,568 (365 days)
install-on-request: 2,209 (30 days), 6,301 (90 days), 31,838 (365 days)
build-error: 0 (30 days)
$ hadoop version
Hadoop 3.3.0
Source code repository https://gitbox.apache.org/repos/asf/hadoop.git -r aa96f1871bfd858f9bac59cf2a81ec470da649af
Compiled by brahma on 2020-07-06T18:44Z
Compiled with protoc 3.7.1
From source with checksum 5dc29b802d6ccd77b262ef9d04d19c4
This command was run using /usr/local/Cellar/hadoop/3.3.0/libexec/share/hadoop/common/hadoop-common-3.3.0.jar
edit: added commands before each output, added three missings lines for the pip log, added hadoop version info.
shoeffner
All 11 comments
Hi @shoeffner !
And if you install hadoop first and then pip install 'dvc[hdfs]', you get the same error, right?
efiop
on 1 Oct 2020
Unfortunately, yes. I installed hadoop first. Though I admit, I haven't phrased it well. To make sure it is that way, I uninstalled everything again (removing the pipenv environment, and uninstalling dvc as well as hadoop).
I now uninstalled dvc and hadoop, as well as removing the python package and ran the following:
$ cat Pipfile
$ brew update
$ brew cleanup
$ brew doctor
$ brew install hadoop
$ pipenv shell # to avoid pipenv doing some caching or whatever I use pip inside the pipenv shell now
$ pip install 'dvc[hdfs]'
$ dvc pull --verbose
Outputs:
$ cat Pipfile
[[source]]
name = "pypi"
url = "https://pypi.org/simple"
verify_ssl = true
[dev-packages]
[packages]
[requires]
python_version = "3.8"
$ brew update
Updated 2 taps (homebrew/core and homebrew/cask).
==> Updated Formulae
node ✔ awscli frps git-absorb pulumi solidity terragrunt
vala ✔ broot geogram grep semgrep starship
==> Updated Casks
rider rocket-chat
$ brew cleanup
Warning: Skipping asio: most recent version 1.18.0 not installed
Warning: Skipping cgal: most recent version 5.1 not installed
Warning: Skipping docker-completion: most recent version 19.03.13 not installed
Warning: Skipping docker-compose-completion: most recent version 1.27.4 not installed
Warning: Skipping exiftool: most recent version 12.00 not installed
Warning: Skipping fmt: most recent version 7.0.3 not installed
Warning: Skipping gnupg: most recent version 2.2.23 not installed
Warning: Skipping haskell-stack: most recent version 2.3.3 not installed
Warning: Skipping htop: most recent version 3.0.2 not installed
Warning: Skipping hugo: most recent version 0.75.1 not installed
Warning: Skipping libgpg-error: most recent version 1.39 not installed
Warning: Skipping libspectre: most recent version 0.2.9_1 not installed
Warning: Skipping llvm: most recent version 10.0.1_1 not installed
Warning: Skipping log4cxx: most recent version 0.11.0 not installed
Warning: Skipping node: most recent version 14.13.0 not installed
Warning: Skipping pandoc: most recent version 2.10.1 not installed
Warning: Skipping pandoc-citeproc: most recent version 0.17.0.2 not installed
Warning: Skipping pandoc-crossref: most recent version 0.3.8.1 not installed
Warning: Skipping proj: most recent version 7.1.1 not installed
Warning: Skipping qrencode: most recent version 4.1.1 not installed
Warning: Skipping spdlog: most recent version 1.8.0 not installed
Warning: Skipping vala: most recent version 0.48.11 not installed
Warning: Skipping youtube-dl: most recent version 2020.09.20 not installed
Warning: Skipping zeromq: most recent version 4.3.3 not installed
$ brew doctor
# only complains about some tcl/tk libs and headers (which I don't know how they ended up there, has to wait)
$ brew install hadoop
==> Downloading https://www.apache.org/dyn/closer.lua?path=hadoop/common/hadoop-3.3.0/hadoop-3.3.0.tar.gz
Already downloaded: /Users/shoeffner/Library/Caches/Homebrew/downloads/764c6a0ea7352bb8bb505989feee1b36dc628c2dcd6b93fef1ca829d191b4e1e--hadoop-3.3.0.tar.gz
🍺 /usr/local/Cellar/hadoop/3.3.0: 21,819 files, 954.7MB, built in 43 seconds
$ pipenv shell # to avoid pipenv doing some caching or whatever I use pip inside the pipenv shell now
Launching subshell in virtual environment…
. /Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/bin/activate
$ . /Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/bin/activate
$ pip install 'dvc[hdfs]'
Collecting dvc[hdfs]
Downloading dvc-1.8.1-py2.py3-none-any.whl (481 kB)
|████████████████████████████████| 481 kB 1.3 MB/s
Collecting grandalf==0.6
Downloading grandalf-0.6-py3-none-any.whl (31 kB)
Collecting flufl.lock<4,>=3.2
Downloading flufl.lock-3.2.tar.gz (19 kB)
Collecting distro>=1.3.0
Using cached distro-1.5.0-py2.py3-none-any.whl (18 kB)
Collecting funcy>=1.14
Downloading funcy-1.15-py2.py3-none-any.whl (32 kB)
Collecting appdirs>=1.4.3
Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
Collecting shortuuid>=0.5.0
Downloading shortuuid-1.0.1-py3-none-any.whl (7.5 kB)
Collecting jsonpath-ng>=1.5.1
Downloading jsonpath_ng-1.5.2-py3-none-any.whl (28 kB)
Collecting nanotime>=0.5.2
Downloading nanotime-0.5.2.tar.gz (3.2 kB)
Collecting configobj>=5.0.6
Downloading configobj-5.0.6.tar.gz (33 kB)
Collecting dpath<3,>=2.0.1
Downloading dpath-2.0.1.tar.gz (21 kB)
Collecting tqdm<5,>=4.45.0
Downloading tqdm-4.50.0-py2.py3-none-any.whl (70 kB)
|████████████████████████████████| 70 kB 16.6 MB/s
Collecting flatten-dict<1,>=0.3.0
Downloading flatten_dict-0.3.0-py2.py3-none-any.whl (8.2 kB)
Collecting ruamel.yaml>=0.16.1
Downloading ruamel.yaml-0.16.12-py2.py3-none-any.whl (111 kB)
|████████████████████████████████| 111 kB 7.5 MB/s
Collecting pydot>=1.2.4
Using cached pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting zc.lockfile>=1.2.1
Downloading zc.lockfile-2.0-py2.py3-none-any.whl (9.7 kB)
Collecting pygtrie==2.3.2
Downloading pygtrie-2.3.2.tar.gz (33 kB)
Requirement already satisfied: setuptools>=34.0.0 in /Users/shoeffner/.local/share/virtualenvs/dlu_test-DsGo8Fkl/lib/python3.8/site-packages (from dvc[hdfs]) (50.1.0)
Collecting pyasn1>=0.4.1
Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
|████████████████████████████████| 77 kB 13.5 MB/s
Collecting packaging>=19.0
Using cached packaging-20.4-py2.py3-none-any.whl (37 kB)
Collecting tabulate>=0.8.7
Using cached tabulate-0.8.7-py3-none-any.whl (24 kB)
Collecting dictdiffer>=0.8.1
Downloading dictdiffer-0.8.1-py2.py3-none-any.whl (16 kB)
Collecting requests>=2.22.0
Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB)
|████████████████████████████████| 61 kB 1.0 MB/s
Collecting rich>=3.0.5
Downloading rich-7.1.0-py3-none-any.whl (153 kB)
|████████████████████████████████| 153 kB 7.1 MB/s
Collecting voluptuous>=0.11.7
Downloading voluptuous-0.12.0-py3-none-any.whl (29 kB)
Collecting colorama>=0.3.9
Downloading colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting toml>=0.10.1
Using cached toml-0.10.1-py2.py3-none-any.whl (19 kB)
Collecting networkx<2.5,>=2.1
Downloading networkx-2.4-py3-none-any.whl (1.6 MB)
|████████████████████████████████| 1.6 MB 10.9 MB/s
Collecting gitpython>3
Downloading GitPython-3.1.9-py3-none-any.whl (159 kB)
|████████████████████████████████| 159 kB 6.8 MB/s
Collecting shtab<2,>=1.3.2
Downloading shtab-1.3.2-py2.py3-none-any.whl (12 kB)
Collecting ply>=3.9
Downloading ply-3.11-py2.py3-none-any.whl (49 kB)
|████████████████████████████████| 49 kB 11.2 MB/s
Collecting pathspec>=0.6.0
Downloading pathspec-0.8.0-py2.py3-none-any.whl (28 kB)
Collecting pyarrow>=0.17.0; python_version < "3.9" and extra == "hdfs"
Downloading pyarrow-1.0.1-cp38-cp38-macosx_10_9_x86_64.whl (11.0 MB)
|████████████████████████████████| 11.0 MB 5.7 MB/s
Collecting pyparsing
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting future
Using cached future-0.18.2.tar.gz (829 kB)
Collecting atpublic
Downloading atpublic-2.0.tar.gz (14 kB)
Collecting six
Downloading six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting decorator
Using cached decorator-4.4.2-py2.py3-none-any.whl (9.2 kB)
Collecting pathlib2<3.0,>=2.3
Downloading pathlib2-2.3.5-py2.py3-none-any.whl (18 kB)
Collecting ruamel.yaml.clib>=0.1.2; platform_python_implementation == "CPython" and python_version < "3.9"
Downloading ruamel.yaml.clib-0.2.2-cp38-cp38-macosx_10_9_x86_64.whl (149 kB)
|████████████████████████████████| 149 kB 9.1 MB/s
Collecting certifi>=2017.4.17
Downloading certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
|████████████████████████████████| 156 kB 10.7 MB/s
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Downloading urllib3-1.25.10-py2.py3-none-any.whl (127 kB)
|████████████████████████████████| 127 kB 7.3 MB/s
Collecting idna<3,>=2.5
Downloading idna-2.10-py2.py3-none-any.whl (58 kB)
|████████████████████████████████| 58 kB 14.2 MB/s
Collecting typing-extensions<4.0.0,>=3.7.4
Downloading typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting pygments<3.0.0,>=2.6.0
Downloading Pygments-2.7.1-py3-none-any.whl (944 kB)
|████████████████████████████████| 944 kB 6.8 MB/s
Collecting commonmark<0.10.0,>=0.9.0
Downloading commonmark-0.9.1-py2.py3-none-any.whl (51 kB)
|████████████████████████████████| 51 kB 12.1 MB/s
Collecting gitdb<5,>=4.0.1
Downloading gitdb-4.0.5-py3-none-any.whl (63 kB)
|████████████████████████████████| 63 kB 4.1 MB/s
Collecting numpy>=1.14
Downloading numpy-1.19.2-cp38-cp38-macosx_10_9_x86_64.whl (15.3 MB)
|████████████████████████████████| 15.3 MB 5.9 MB/s
Collecting smmap<4,>=3.0.1
Downloading smmap-3.0.4-py2.py3-none-any.whl (25 kB)
Building wheels for collected packages: flufl.lock, nanotime, configobj, dpath, pygtrie, future, atpublic
Building wheel for flufl.lock (setup.py) ... done
Created wheel for flufl.lock: filename=flufl.lock-3.2-py3-none-any.whl size=19929 sha256=90493d92746e722e2c936eb41da72bdb2be6da00d8f3bf53739a391b142a1898
Stored in directory: /Users/shoeffner/Library/Caches/pip/wheels/f4/f4/20/d7114a2d97a2e72ce7189a7f63a6fbd2a33ec6ae6010befca5
Building wheel for nanotime (setup.py) ... done
Created wheel for nanotime: filename=nanotime-0.5.2-py3-none-any.whl size=2442 sha256=e90307019ff1aa3c9c851a0410d7fee8fab0ea29a305c1492b917a3fb755eb92
Stored in directory: /Users/shoeffner/Library/Caches/pip/wheels/59/72/23/ea2daa0727a9f7824c0656b73c1f3d8d13f5327729eadb7084
Building wheel for configobj (setup.py) ... done
Created wheel for configobj: filename=configobj-5.0.6-py3-none-any.whl size=34545 sha256=7af58d00594d8ac6c6f4e047faf57461f8a688f62351aaf70b9840edc1f2d0bc
Stored in directory: /Users/shoeffner/Library/Caches/pip/wheels/34/2a/24/a490264ae9041fd48f778ff393526572c80bb498ddecb07ea5
Building wheel for dpath (setup.py) ... done
Created wheel for dpath: filename=dpath-2.0.1-py3-none-any.whl size=15139 sha256=b77e77c682cde28cd3094f4ca17606876d7ce0850bfb8deebba4ac88bfaaded3
Stored in directory: /Users/shoeffner/Library/Caches/pip/wheels/0f/1b/ca/6263a5227f886599039aee3eed13951a6d44a02ee989ed6eb6
Building wheel for pygtrie (setup.py) ... done
Created wheel for pygtrie: filename=pygtrie-2.3.2-py3-none-any.whl size=18866 sha256=211aa9045a52f9e7dd89da3cf78392bdc69879b208540f9237a669f969a6b5e2
Stored in directory: /Users/shoeffner/Library/Caches/pip/wheels/bc/7d/26/d3e5714967aa183b5c659493fa88daf270295948d0ac277686
Building wheel for future (setup.py) ... done
Created wheel for future: filename=future-0.18.2-py3-none-any.whl size=491059 sha256=61a3488c9b94126965a8e60945af9edbc1888f6d9bd3d614177fc511a8932ccc
Stored in directory: /Users/shoeffner/Library/Caches/pip/wheels/8e/70/28/3d6ccd6e315f65f245da085482a2e1c7d14b90b30f239e2cf4
Building wheel for atpublic (setup.py) ... done
Created wheel for atpublic: filename=atpublic-2.0-py3-none-any.whl size=14698 sha256=92448d64573cd9959407facec4b4123eb7c5d6a3d9414cfa422e1de3354ed76d
Stored in directory: /Users/shoeffner/Library/Caches/pip/wheels/64/0e/7a/db57ff68c335b45334dc7c64b1016fe2ba4cf23f64cb508d06
Successfully built flufl.lock nanotime configobj dpath pygtrie future atpublic
Installing collected packages: pyparsing, future, grandalf, atpublic, flufl.lock, distro, funcy, appdirs, shortuuid, ply, six, decorator, jsonpath-ng, nanotime, configobj, dpath, tqdm, pathlib2, flatten-dict, ruamel.yaml.clib, ruamel.yaml, pydot, zc.lockfile, pygtrie, pyasn1, packaging, tabulate, dictdiffer, certifi, chardet, urllib3, idna, requests, colorama, typing-extensions, pygments, commonmark, rich, voluptuous, toml, networkx, smmap, gitdb, gitpython, shtab, pathspec, numpy, pyarrow, dvc
Successfully installed appdirs-1.4.4 atpublic-2.0 certifi-2020.6.20 chardet-3.0.4 colorama-0.4.3 commonmark-0.9.1 configobj-5.0.6 decorator-4.4.2 dictdiffer-0.8.1 distro-1.5.0 dpath-2.0.1 dvc-1.8.1 flatten-dict-0.3.0 flufl.lock-3.2 funcy-1.15 future-0.18.2 gitdb-4.0.5 gitpython-3.1.9 grandalf-0.6 idna-2.10 jsonpath-ng-1.5.2 nanotime-0.5.2 networkx-2.4 numpy-1.19.2 packaging-20.4 pathlib2-2.3.5 pathspec-0.8.0 ply-3.11 pyarrow-1.0.1 pyasn1-0.4.8 pydot-1.4.1 pygments-2.7.1 pygtrie-2.3.2 pyparsing-2.4.7 requests-2.24.0 rich-7.1.0 ruamel.yaml-0.16.12 ruamel.yaml.clib-0.2.2 shortuuid-1.0.1 shtab-1.3.2 six-1.15.0 smmap-3.0.4 tabulate-0.8.7 toml-0.10.1 tqdm-4.50.0 typing-extensions-3.7.4.3 urllib3-1.25.10 voluptuous-0.12.0 zc.lockfile-2.0
$ dvc pull --verbose
# Seems to be exactly as above, libhdfs.dylib image not found
In fact, I simply can't find a libhdfs.dylib on my system:
$ find / -name "*libhdfs*" 2>/dev/null
# no output :-(
I couldn't yet find a way to install it properly, how should I get libhdfs?
edit:
Also I do not have a lib directory in hadoop's dir:
$ ls $(brew --prefix hadoop)
INSTALL_RECEIPT.json LICENSE.txt README.txt libexec
LICENSE-binary NOTICE.txt bin sbin
Looks like this is considered problematic on mac: https://medium.com/@natekupp/python-hdfs-on-macos-catalina-c59c62f2eccf :slightly_frowning_face: No brew formula for it too https://github.com/Homebrew/legacy-homebrew/pull/19681 :slightly_frowning_face: And brew's hadoop https://github.com/apache/arrow/blob/master/cpp/apidoc/HDFS.md doesn't come with it neither :slightly_frowning_face: Could you try that medium guide?
From our end looks like it will be pretty hard to improve this. We could start with resurrecting libhdfs formula for brew, but that is not trivial.
Another, simpler, approach, could be to add WebHDFS support to dvc. There are plenty of libs, IIRC, and they don't use any heavy dependencies like libhdfs. Do you have webhdfs enabled? Do you use it at all?
efiop
on 1 Oct 2020
Thanks, I didn't find those resources myself. I have a few days off now and am not sure how much time I will be able to spend on it during my free time, maybe a few hours tomorrow; otherwise I will definitely get back to it on October 8th. I will definitely report back with the results!
I have no idea about WebHDFS, nor do I manage the server myself, but I will read up on it and ask the admins about it. The last time I used hdfs was about four years ago on a remote server to check if some files existed, so I honestly don't even remember the basics. But if there is a way to build it, as described in the medium post, I will sure figure it out :)
shoeffner
on 1 Oct 2020
👍1
@shoeffner Sounds good, please let us know how it goes!
efiop
on 1 Oct 2020
_this is only me tracking what I did so far_
The first issue I found about this is BUILDING.txt#L413-415:
Note that building Hadoop 3.1.1/3.1.2/3.2.0 native code from source is broken
on macOS. For 3.1.1/3.1.2, you need to manually backport YARN-8622. For 3.2.0,
you need to backport both YARN-8622 and YARN-9487 in order to build native code.
The related tickets are HADOOP-16263, YARN-8622, and YARN-9487.
I tried moving back in time to the last version "known" to build, i.e. 3.1.0, but it requires libprotoc 2.5.0 – brew is at 3.13.0.
The issue is supposed to be fixed in 3.3.0, but that one can't build with a recent Java version (I have 14.0.1), because the javadocs use -html4, which is no longer supported. See HADOOP-17178 for details.
So I checked out the latest trunk, made sure YARN-8622 and YARN-9487 were fully applied, changed the hadoop-project/pom.xml and removed the flag -html4 using the patch below and built with the command mvn package -Pdist,native -DskipTests -e -Dmaven.javadoc.skip=true -Denforcer.skip=true -DskipShade -Dopenssl.lib=/usr/local/opt/openssl/lib/libcrypto.dylib -Dopenssl.include=/usr/local/opt/openssl/include provided in YARN-9487 (comment).
From 5c0050c84cb0165e56ef807973805640199b6ffd Mon Sep 17 00:00:00 2001
From: =?UTF-8?q?Sebastian=20H=C3=B6ffner?= <[email protected]>
Date: Sat, 3 Oct 2020 09:56:28 +0200
Subject: [PATCH 1/2] HADOOP-17178 Removing -html4 javadoc option.
---
hadoop-project/pom.xml | 4 ----
1 file changed, 4 deletions(-)
diff --git a/hadoop-project/pom.xml b/hadoop-project/pom.xml
index 4b7585ea5e6..066b6618d0d 100644
--- a/hadoop-project/pom.xml
+++ b/hadoop-project/pom.xml
@@ -2451,10 +2451,6 @@
<configuration>
<skip>${javadoc.skip.jdk11}</skip>
<detectJavaApiLink>false</detectJavaApiLink>
- <additionalOptions>
- <!-- TODO: remove -html4 option to generate html5 docs when we stop supporting JDK8 -->
- <additionalOption>-html4</additionalOption>
- </additionalOptions>
</configuration>
</plugin>
</plugins>
--
2.28.0
Unfortunately, building the submodule hadoop-hdfs-project alone does not work, it requires the hadoop-maven-plugins, hadoop-kms, and maybe other dependencies, so I tried building all of hadoop. This also fails because without the html4-compatibility, many javadoc comments are no longer valid and throw lint errors. I followed the instructions at Maven is not working in Java 8 when Javadoc tags are incomplete and added the configuration option <doclint>none</doclint> to the pom.xml (Did this in three different places, maybe one target would have been enough).
From 03a71d2eba98fca2ba62d717f5b1bb433bc8a416 Mon Sep 17 00:00:00 2001
From: =?UTF-8?q?Sebastian=20H=C3=B6ffner?= <[email protected]>
Date: Sat, 3 Oct 2020 10:36:13 +0200
Subject: [PATCH 2/2] HADOOP-17178 Disabling doclint.
---
hadoop-project/pom.xml | 5 +++++
1 file changed, 5 insertions(+)
diff --git a/hadoop-project/pom.xml b/hadoop-project/pom.xml
index 066b6618d0d..3d3dd0a465c 100644
--- a/hadoop-project/pom.xml
+++ b/hadoop-project/pom.xml
@@ -1866,6 +1866,7 @@
<artifactId>maven-javadoc-plugin</artifactId>
<version>${maven-javadoc-plugin.version}</version>
<configuration>
+ <doclint>none</doclint>
<additionalOptions>
<additionalOption>-Xmaxwarns 10000</additionalOption>
</additionalOptions>
@@ -2313,6 +2314,9 @@
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-javadoc-plugin</artifactId>
+ <configuration>
+ <doclint>none</doclint>
+ </configuration>
<executions>
<execution>
<!-- build javadoc jars per jar for publishing to maven -->
@@ -2451,6 +2455,7 @@
<configuration>
<skip>${javadoc.skip.jdk11}</skip>
<detectJavaApiLink>false</detectJavaApiLink>
+ <doclint>none</doclint>
</configuration>
</plugin>
</plugins>
--
2.28.0
So far this still fails, but I am looking into whether I am still missing some dependencies. Maybe I will also have to try to get exact versions as in the medium post you linked.
edit:
I followed the instruction to build Protocol Buffers 3.7.1 as mentioned in the BUILDING.txt, then tried again (still not using jdk 8 but 14 and the patches above), yet no success:
[WARNING] /Users/shoeffner/Projects/dlu_test/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/runc/runc_reap.c:24:10: fatal error: 'mntent.h' file not found
[WARNING] #include <mntent.h>
[WARNING] ^~~~~~~~~~
[WARNING] 1 error generated.
[WARNING] 1 error generated.
[WARNING] make[2]: *** [CMakeFiles/container.dir/main/native/container-executor/impl/runc/runc_reap.c.o] Error 1
mntent.h is part of Glibc, so that is another rabbit hole.
I will ask the hadoop mailing list and see if they can help.
edit2:
Maybe running dvc + hadoop inside a docker container and mounting the repository might help. I will have to try that after the weekend.
shoeffner
on 3 Oct 2020
👍1
I stopped pursuing getting it to compile, sorry!
In the meantime I solved my problem of "just getting the data" using Docker (well, dvc runs in a container now, so I kind of got it to run). Sorry I couldn't provide more help with the compilation, but for me the issue is now resolved.
Dockerfile:
FROM python:3.8.6-slim
WORKDIR /dep
RUN mkdir -p /usr/share/man/man1 \
&& apt-get update \
&& apt-get install -y \
git \
wget \
default-jre-headless \
&& wget https://downloads.apache.org/hadoop/common/hadoop-3.3.0/hadoop-3.3.0.tar.gz \
&& tar xf hadoop-3.3.0.tar.gz \
&& pip install 'dvc[hdfs]'
ENV PATH=/dep/hadoop-3.3.0/bin:${PATH}
ENV JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
ENV LD_LIBRARY_PATH=/dep/hadoop-3.3.0/lib/native:${LD_LIBRARY_PATH}
WORKDIR /data
ENTRYPOINT ["dvc"]
CMD ["version"]
Shell function:
function dvc() {
docker run -v $(pwd):/data dvc $@
}
Execution:
$ docker build -t dvc .
$ cd ~/Projects/my_data_project
$ dvc pull # docker run -v $(pwd):/data dvc pull
It also works with shell completions, to set them up I ran:
$ dvc completion -s zsh > ${HOME}/.zsh/completions/_dvc
👍1
@shoeffner Thanks for trying it out! Btw, what about WebHDFS, is it available with your hdfs setup?
efiop
on 4 Oct 2020
I haven't heard back from the admins yet.
shoeffner
on 5 Oct 2020
👍1
Closing for now in favor of https://github.com/iterative/dvc/issues/4687 . Let us know when you hear from admins :) Thanks!
efiop
on 14 Oct 2020
Was this page helpful?
0 / 5 - 0 ratings
Related issues
shcheklein
·
3Comments
mdscruggs
·
3Comments
GildedHonour
·
3Comments
siddygups
·
3Comments
shcheklein
·
3Comments