Catalyst ingest-exchange fails


#1

Hi,

I’m trying to run the following :

catalyst ingest-exchange -x binance -f minute -i ada_bnb,adx_bnb,ae_bnb,agi_bnb,aion_bnb,amb_bnb,appc_bnb,ardr_bnb,bat_bnb,bch_bnb,bcn_bnb,bcpt_bnb,blz_bnb,brd_bnb,bts_bnb,cmt_bnb,cnd_bnb,cvc_bnb,dlt_bnb,enj_bnb,eos_bnb,etc_bnb,gnt_bnb,go_bnb,gto_bnb,icx_bnb,iota_bnb,loom_bnb,lsk_bnb,ltc_bnb,mco_bnb,mft_bnb,nano_bnb,nas_bnb,nav_bnb,ncash_bnb,nebl_bnb,neo_bnb,nuls_bnb,nxs_bnb,ont_bnb,ost_bnb,pax_bnb,phx_bnb,pivx_bnb,poa_bnb,poly_bnb,powr_bnb,qlc_bnb,qsp_bnb,qtum_bnb,rcn_bnb,rdn_bnb,rep_bnb,rlc_bnb,rpx_bnb,sc_bnb,sky_bnb,steem_bnb,storm_bnb,sys_bnb,theta_bnb,trig_bnb,trx_bnb,tusd_bnb,ven_bnb,vet_bnb,via_bnb,wabi_bnb,wan_bnb,waves_bnb,wtc_bnb,xem_bnb,xlm_bnb,xrp_bnb,xzc_bnb,yoyow_bnb,zen_bnb,zil_bnb

this fails and gives back the following message :

Ingesting exchange bundle binance…
[=================== ] Ingesting minute price data on binance: 53% 0d 00:04:44
Traceback (most recent call last):
File “/home/a/catalyst-venv/bin/catalyst”, line 11, in
sys.exit(main())
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/click/core.py”, line 722, in call
return self.main(*args, **kwargs)
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/click/core.py”, line 697, in main
rv = self.invoke(ctx)
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/click/core.py”, line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/click/core.py”, line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/click/core.py”, line 535, in invoke
return callback(*args, **kwargs)
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/click/decorators.py”, line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/catalyst/main.py”, line 572, in ingest_exchange
csv=csv
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/catalyst/exchange/exchange_bundle.py”, line 823, in ingest
show_report=show_report
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/catalyst/exchange/exchange_bundle.py”, line 642, in ingest_assets
cleanup=True
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/catalyst/exchange/exchange_bundle.py”, line 365, in ingest_ctable
period=period
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/catalyst/exchange/utils/bundle_utils.py”, line 83, in get_bcolz_chunk
bytes = download_without_progress(url)
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/catalyst/data/bundles/core.py”, line 190, in download_without_progress
resp.raise_for_status()
File “/home/a/catalyst-venv/local/lib/python2.7/site-packages/requests/models.py”, line 935, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://s3.amazonaws.com/enigmaco/catalyst-bundles/exchange-binance/binance-minute-trx_bnb-2018-06.tar.gz

Any idea why?


#2

I’ve been getting the same error from TRXBNB as well.


#3

Also for the following symbols I cannot in fact get data for binance:

‘ardr_bnb’,‘go_bnb’,‘mft_bnb’,‘nano_bnb’,‘nas_bnb’,‘pax_bnb’,‘phx_bnb’,‘poa_bnb’,‘rpx_bnb’,‘trx_bnb’,‘tusd_bnb’,‘ven_bnb’,‘vet_bnb’,‘yoyow_bnb’,‘ardr_eth’,‘bqx_eth’,‘dent_eth’,‘hc_eth’,‘hsr_eth’,‘key_eth’,‘mft_eth’,‘nano_eth’,
‘nas_eth’,‘oax_eth’,‘omg_eth’,‘phx_eth’,‘poa_eth’,‘rpx_eth’,‘ven_eth’,‘vet_eth’,‘yoyow_eth’,‘ardr_btc’,‘bqx_btc’,‘dent_btc’,‘go_btc’,‘hc_btc’,‘hsr_btc’,‘key_btc’,‘mft_btc’,‘nano_btc’,‘nas_btc’,‘omg_btc’,‘phx_btc’,‘poa_btc’,‘rpx_btc’,’
‘ven_btc’,‘vet_btc’,‘yoyow_btc’

Thanks


#4

Hi @Papan, thanks for reporting.
Could you please open a Github issue to continue our investigation there?

Thanks, Embar