Problem: IB backfill 180days wipes out the saved intraday history

[smhhadima]

Hi,
I am using version 6.40.4 professional.
I have more than 2 years of intraday (15 min) history saved on the database.

When I do backfill less than 180days from IB everything works fine.
BUT when I used backfill 180days, the bacfill "wiped out" all the history and only kept 180 days!

What could be the problem?

Thank you

[smhhadima]

Hi,
Any help? the problem is very annoying now as the Interactive Brokers backfiller now is randumly deleting history of some stocks and keeps only few weeks (although my database settings is set for 4 years of history)

please advise

[Tomasz]

Unfortunately your question isn't clear enough and does not provide all necessary details to give you an answer. Please follow this advice: How to ask a good question

CRUCIAL part: Send a screenshot of File->Database Settings

[smhhadima]

Hi,
@Tomasz
this is a stock "AMC" for example as you can see in the first picture the history goes back to May, 2021

Now, I run the 180 backfill --> please check the below image , the history is all gone and only few weeks left up to March 2022 only!

[Tomasz]

Your settings are obviously different than one that are listed in the manual.

Instead of inventing your incorrect settings, follow the MANUAL and enter all values precisely as instructed in the manual. 15-minute interval is not correct as base time interval for IB.

https://www.amibroker.com/guide/h_ib.html

Also the screenshots are bad because you DID NOT INCLUDE DATE AXIS. No-one can guess from chart without date axis what dates are displayed.

Last but not least IB sends history in 5-day chunks at a time. For 180 days you have to WAIT several MINUTES for IB to respond with 36 5-day chunks.

[smhhadima]

Hi,
@Tomasz
I have made the changes then I downloaded a (1 min) history offline since 2020.
then I made the backfill 180 days but the problem still i.e. the plugin deleted all the history.

Please note: the problem does NOT happen with backfill of 1 day, 5 day ,15 day.

[Tomasz]

Again, your settings are still wrong. There is no 250K bars history on IB.
You are requesting much more data than IB supports/allows.

https://www.multicharts.com/trading-software/index.php/Interactive_Brokers_Pacing_Violation

[smhhadima]

@Tomasz ,

Kindly note that Interactive brokers has lifted all restrictions!

" At this time Historical Data Limitations for barSize = "1 mins" and greater have been lifted. However, please use caution when requesting large amounts of historical data or sending historical data requests too frequently. Though IB has lifted the "hard" limit, we still implement a "soft" slow to load-balance client requests vs. server response"

https://interactivebrokers.github.io/tws-api/historical_limitations.html

[Tomasz]

No they didn't. They say something but do something else. Limitations are ON.
IB is super-limited.

Every source has limitations, even IQFeed has albeit their limits are multi-year worth of data. So if you want something with long history use IQFeed.