Page 1 of 1

Tick Data History Date is mess up !!!

Posted: Sun Feb 16, 2014 10:18 am
by Darren
Hi,

I have downloaded Tickstory v1.3, upgrade my MT4 version to builds 604, and download Birt’s CSV2FXT script v0.46 binaries (released 09.02.2014, compatible: MT4 build 545 or higher). And i have the same version of MT4 builds 403 and Birt’s patch script v0.21 (updated 21.02.2012, compatible: MT4 build 225 – 409). Before explain my issue is, i need to explain the progress that i did, so you can understand them.

1. Now i use Tckstory software v1.3 to export to file, i select example GBPUSD and just change the from date and to date (2012.01.01 to 2013.12.31) and leave those setting as default. It successfully done this operation. OK.
2. Now i use Birt’s CSV2FXT script v0.46 to do the tick data conversion in MT4 builds 604, all the setting i follow from Birt instruction. No issue and successfully done this operation. Now i have FXT and HST files. OK.
3. Now i use Birt’s patch script v0.21 in MT4 builds 403, to remove 2GB limit and run the backtesting in offline mode, since the Birt script only support old version. I encounter the issue with

Image

So i check the history data in MT4 >> FILE >> OPEN OFFLINE. Here it is...

Image

FYI. I have done the backtesting many times by using the old version TickStory, Birt script and MT4 version before. So no issue before, and i don't explain how i put those files (CSV, HST, FXT) into correct MT4 directory, i know where to put those files into new MT4 directory.
And i have done another experiment in order to prove whether is Birt Script or Tickstory new version error/bug/problem. In conclusion is the issue come from TickStory. Here is how i prove.

1. I erase all data in MT4 directory (CSV, HST & FXT)
2. I use TickStory v1.3. Change the MT4 setting, so it change to the new MT4 directory (C:\Users\Darren\AppData\Roaming\MetaQuotes\Terminal\DF5DE9547A0936C0E42C040D9AA40C5F) to put HST & FXT files.
3. I use "Export to Files" and select example GBPUSD and just change the from date and to date (2012.01.01 to 2013.12.31) and leave those setting as default. Now no issue for this operation and it successfully create the files. OK.
4. Now i cut those HST & FXT files into my MT4 builds 403 correct directory (Because need to remove 2 GB limit in backtesting)
5. I open up MT4 builds 403. Check the historical files at MT4>>FILE>>OPEN OFFLINE. Now it even show this...

Image

So please assist !!

Re: Tick Data History Date is mess up !!!

Posted: Tue Feb 18, 2014 12:51 am
by tickstory
Hi Darren,

A few questions/points to hopefully help you your issue:

- What is the reason for using such an old Build of MT4? The more recent builds (such as 509) reportedly allow up to 4GB of test data. In addition, we recommend you upgrade your MT4 as we don't typically test nor support Builds below 432.
- Why are you exporting CSV files instead of just using the Tickstory Éxport to MT4 function which by-passes the need to use scripts such as CSV2FXT?
- If you are still having problems with anomalous data showing in your MT4 History/Offline charts, it is possible this data is coming from your broker. As such, you may need to ensure that your terminal is not connected, otherwise the terminal may be trying to automatically back-fill data.

Hope this helps.

Re: Tick Data History Date is mess up !!!

Posted: Tue Feb 18, 2014 10:43 am
by Darren
tickstory wrote:Hi Darren,

A few questions/points to hopefully help you your issue:

- What is the reason for using such an old Build of MT4? The more recent builds (such as 509) reportedly allow up to 4GB of test data. In addition, we recommend you upgrade your MT4 as we don't typically test nor support Builds below 432.
- Why are you exporting CSV files instead of just using the Tickstory Éxport to MT4 function which by-passes the need to use scripts such as CSV2FXT?
- If you are still having problems with anomalous data showing in your MT4 History/Offline charts, it is possible this data is coming from your broker. As such, you may need to ensure that your terminal is not connected, otherwise the terminal may be trying to automatically back-fill data.

Hope this helps.
Thanks for your help.

- To remove 2GB limit. But now i just know recent builds could do so.
- Because I use this for very long time, quite stable, since last time earlier version ofTickstory was not stable.
- Nope from broker, as i assign the HST & FXT files into specific folders, not inside the history/demo/ & tester/history directory, it won't overwrite the files, after that i cut all files into the directory of old build MT4 (Remove 2GB) to run backtest in OFFLINE mode.

Now i roll back the Tickstory to v1.2. No issue at all, by using "Export to MT4" in order to prove the is not Birt scrips issue. Here is the history.
Maybe v1.3 is not stable yet since it is new. Please look into this issue.

Image

Re: Tick Data History Date is mess up !!!

Posted: Tue Feb 18, 2014 11:45 pm
by tickstory
Hi Darren,

To be able to assist you, you are going to have to move to at least Build 509. It is becoming very difficult to cater for all the various builds out there and 509 is the minimum we will test with.

Also, if you are exporting to CSV first, it should be relatively simple to check the CSV file to see if there is any data pertaining to 2004 (note that we have just tried this and there is no issue). If there is a problem with the export, then we can trouble-shoot further. If not, the only way this data can appear is from your broker or from the further processing you are doing.

Hope this helps.

Re: Tick Data History Date is mess up !!!

Posted: Fri Feb 21, 2014 8:29 am
by Darren
tickstory wrote:Hi Darren,

To be able to assist you, you are going to have to move to at least Build 509. It is becoming very difficult to cater for all the various builds out there and 509 is the minimum we will test with.

Also, if you are exporting to CSV first, it should be relatively simple to check the CSV file to see if there is any data pertaining to 2004 (note that we have just tried this and there is no issue). If there is a problem with the export, then we can trouble-shoot further. If not, the only way this data can appear is from your broker or from the further processing you are doing.

Hope this helps.
Thanks for the info.

1. Now i tried to use Tickstory v1.3, by using export to file. And i open up the CSV file to check the date, it is from past date to latest date (Top to bottom). I am not sure if this format is correct.
2. Now i tried to use Tickstory v1.3, by using export to MT4. And i open up MT4 builds 604 to check the historical date at FILE>>OPEN OFFLINE. It shows the correct date. So i assume that the CSV files format is correct.
3. Now i tried to use Tickstory v1.3 by using export to file, and i use this CSV to run tick data conversion by using Birt V0.46 in order to generate HST & FXT files. After it successfully generate the files, i open up MT4 Builds 604 to check the historical date at FILE>>OPEN OFFLINE. The date is correct as well.

Now i can see that it is not longer support MT4 builds less than 509. So i when i tried number 2 above, but to cut and paste the HST & FXT files into MT4 builds less than 509, then i check the date from FILE>>OPEN OFFLINE, the historical date is mess up.

Now i have question for number 2. After the backtesting is complete, i check the tester result, the model is N/A. FYI, i didn't open the MT4 platform by using Tickstory software, which mean i open up directly from MT4 application. Does it mean i have to purchase the Tick Data Suite in order to use this function, so model will be 99% ? What is the error/discrepancy if i just leave the model as N/A ?

Thanks.

Re: Tick Data History Date is mess up !!!

Posted: Sat Feb 22, 2014 10:30 am
by tickstory
Hi Darren,

Thanks for detailing the steps to took. To answer your question, you will need to launch MT4 via the Tickstory launcher by pressing F8 within the application. This will give you a modelling quality of 99%.

Regards.