set dld-time, split tick-files.csv and parallelize steps?
Posted: Fri Aug 02, 2013 8:47 pm
Hi
I am waiting now for the close of markets to start the tick-data download of Strategy Quant to download the dukas-data.
First suggestion:
I don't know whether it would be meaning full for Tickstory but it would be very nice to be able to tell the downloader to start the download at a specific time let's say 2 hours after the markets closed, either be start in (pls enter): 2 from now or by giving a specific start-time?
Startegy's. Quant-Dld-Prg. first downloads the missing recent data and then re-builds the whole csv-Tickdata-file.csv, market by market.
Second suggestion:
Separate the dld-process from the csv-creation process to enable us to run parallel - possible?
Third suggestion:
The csv-Tickdata-file is needed for a script to be run in MT4 to create the MT4-typival history-files.
Would it be possible to split the one and big (EURUSD.CSV has 8 GB, which is re-written every update!) Quant-csv-file into several files, let's say one for each year?
So that only the actual year has to be re-created? My Dukascopy's database has the size of ~165 GB and I put it on an external USB-Disk (not needed regularly) and that slows down my monthly update process. It needs for all available Dukascopy-markets more than 12h. It would be very nice if it were faster..
Regards
I am waiting now for the close of markets to start the tick-data download of Strategy Quant to download the dukas-data.
First suggestion:
I don't know whether it would be meaning full for Tickstory but it would be very nice to be able to tell the downloader to start the download at a specific time let's say 2 hours after the markets closed, either be start in (pls enter): 2 from now or by giving a specific start-time?
Startegy's. Quant-Dld-Prg. first downloads the missing recent data and then re-builds the whole csv-Tickdata-file.csv, market by market.
Second suggestion:
Separate the dld-process from the csv-creation process to enable us to run parallel - possible?
Third suggestion:
The csv-Tickdata-file is needed for a script to be run in MT4 to create the MT4-typival history-files.
Would it be possible to split the one and big (EURUSD.CSV has 8 GB, which is re-written every update!) Quant-csv-file into several files, let's say one for each year?
So that only the actual year has to be re-created? My Dukascopy's database has the size of ~165 GB and I put it on an external USB-Disk (not needed regularly) and that slows down my monthly update process. It needs for all available Dukascopy-markets more than 12h. It would be very nice if it were faster..
Regards