Home Forums Free tick data available for Amibroker, Ninjatrader and more

Viewing 15 posts - 16 through 30 (of 40 total)
  • Author
    Posts
  • Mikhaly
    Participant
    Post count: 1

    @tickstory wrote:

    Hi,

    Exporting to Forex Tester is now supported in v0.9.2. We also added support for Forexsb (http://www.forexsb.com).

    Regards.

    Hi,
    Do you know why Forex Tester 2 freezed when I want to import a file *.csv from Tickstory v. 1.5.1 ?
    I tried to download in Forex Tester format or in generic bar format without success.

    Thank you in advance for replying,
    Regards,
    Mikhaly

    imported_tickstory
    Participant
    Post count: 1479

    Hi Mikhaly,

    Unfortunately we don’t know why Forex Tester might freeze – I assume that you have contacted the vendor for assistance? If it’s a large file you are trying to import it could just be that it’s taking some time.

    Hope this helps.

    ratsh
    Participant
    Post count: 4

    Longterm AmiBroker user speaking here:

    FYI AmiBroker is not dependent on any predefined fix format to get data imported to it. There is no such thing as “fix format”. AB works with any format defined. It also provides millisecond data which is not even covered in those two predefined formats. In short those two formats supposed to work with Amiquote are just two of thousands possibilities as there are in addition any other standard data file extensions supported also. Also you don’t need Amiquote to get data files imported since you can use any custom data plugin or OLE import script or the two manual file import options in File menu of AB. This is just meant to clarify to remove misunderstanding of how AB works. It’s not like MT or NT who only work with fix datafile formats. It is highly flexible. So saying this or that 3rd party software now supports Amibroker for data import sounds quite funny to insiders.

    Side note: aqi, aqd, aqh,aqfe other Amiquote file extensions are just standard comma separated ascii data files also and are readable with any texteditor. So there is no mystery about them and no hidden protection.

    Hope this clears up a few tings.

    ##################################################################################################################
    Here is one (out of many) examples showing how to import bid/ask price and volume with millisecond timestamp to AmiBroker at once.
    ##################################################################################################################

    In Tickstory choose:

    Timeframe: Tick
    Timezone: whatever you need
    Output format: Custom

    Check include header

    Header info:
    Timestamp,Bid price,Bid volume,Ask Price,Ask volume

    Data format (timestamp is again just one of many possiblities):
    {Timestamp:yyyyMMdd HH:mm:ss.fff},{BidPrice},{BidVolume},{AskPrice},{AskVolume}

    File name: for example use {Symbol}.csv

    and start downloading

    ##################################################################################################################
    With notepad++ create a file with following content (this is a “to be done just one time” procedure for each format you need):
    ##################################################################################################################

    $FORMAT Date_YMD,Time,Close,Volume,Aux1,Aux2
    $SKIPLINES 1
    $SEPARATOR ", "
    $CONT 1
    $GROUP 255
    $AUTOADD 1
    $DEBUG 1
    $TICKMODE 1
    $TIMESHIFT 0

    and save it with file extension .format (for example TickstoryBidAsk.format) and copy that file to …AmiBrokerFormats subfolder

    Note:
    Timshift line is set to zero but if you want to shift to other time zone during import then for example change to $TIMESHIFT 2 which would shift the time stamp by +two hours while $TIMESHIFT -4 would shift by 4 hours backwards (for example if you want import different timezone as the one you have set in tickstory download. Of course you need to take care of summer/winter time, so you would have to split data file if summer/winter time range is part of same file and need to adjust $TIMESHIFT line for summer and winter time import. Anyway $TIMESHIFT is not needed if you are happy with downloaded timezone. Just showing that it’s possible to change time zone after download also.)

    Go to same subfolder AmiBrokerFormats, open import.types file placed in there and add line (for example):
    TickstoryTickBidAsk (*.csv)|*.csv|TickstoryBidAsk.format
    (you can see that the format file info at the end of the line needs to have same file name as you have saved your format file to before)

    save that import.types file

    Now you are finished with preparations.
    Open AmiBroker, create a Tickstory database, go to File –> Import Ascii, choose file format “TickstoryTickBidAsk” in drop down menu and browse to your tickstory download folder to open your previously downloaded Bid/Ask data file(s) separated or all at once (by marking them).

    Of course you can use programmatic import too but that’s another short story.

    One thing to do while creating your Database and being related to upper example is setting data source to local database since it is off-line data and setting base time interval to tick there. In addition go to File –> Database settings –> Intraday settings of our database and set Aux1 to Last and Aux2 to Sum (since latter one is ask volume). Also set start minutes to “00” from “30” to start hourly TF at 00.
    see picture

    imported_tickstory
    Participant
    Post count: 1479

    Hi Ratsh,

    Many thanks for your comprehensive post. We are aware of the fact that Amibroker is very flexible and can handle different formats. In the future we hope to create a data provider that can feed Amibroker through its plug-in architecture. Until then, we are trying to “support” Amibroker by making it as simple as possible for users to import data with the minimal amount of effort (that is, using Amibroker’s default import definitions where possible). Of course, more advanced users will find your information highly invaluable.

    Thanks!

    ratsh
    Participant
    Post count: 4

    Hi,

    thank you too for providing your tool. Yeah, it was just directed to users who don’t know (and are possibly used to more limited softwares).

    @tickstory wrote:

    In the future we hope to create a data provider that can feed Amibroker through its plug-in architecture.

    Sounds interesting. thanks for providing that info.
    BTW, Mr. Janeczko of AmiBroker has recently posted a message to 3rd party data providers on the official AB forum.

    Hello,

    Attention developers of 3rd party data plugins.
    I know that dozens of 3rd party data plugins exist for AmiBroker, so I think it would
    be good idea to spread the word about 3rd party options.

    Please submit details about your plugins (data source supported, data intervals – daily?, 1-minute?, tick?,
    cost of data subscription and download links) to support at amibroker dot com
    We will use this information to prepare 3rd party data plugin page on http://www.amibroker.com web site,
    so the users would have easier way to find out about your data source/ data plugin.

    Best regards,
    Tomasz Janeczko
    amibroker.com

    imported_tickstory
    Participant
    Post count: 1479

    Hi Ratsh,

    Thanks for the heads up – we have contacted Tomasz and he has now listed us on the Amibroker website.

    Kind regards.

    meheustbruno
    Participant
    Post count: 1

    @tickstory wrote:

    Alternatively, if you are looking to import bar data into Ninjatrader (such as 1-minute bars), according to the Ninjatrader manual (http://www.ninjatrader.com/support/helpGuides/nt7/index.html?importing.htm), NT bar data supports the following format:

    yyyyMMdd HHmmss;open price;high price;low price;close price;volume

    To achieve this in Tickstory, you can export with the following settings:

    Timeframe: 1-Minute
    Include headers: No
    Custom Format: {BarBeginTime:yyyyMMdd} {BarBeginTime:HHmmss};{Open};{High};{Low};{Close};{Volume}

    Please let us know how you go – we can add this as a pre-defined option to make things easier in the future.

    Regards.

    Hi there, thank you for this great project and what was achieved

    Would you be kind enough to include this NinjaTrader Bar format (that works for minute based intervals) as a pre-defined setting on next release ? Thanks in advance

    imported_tickstory
    Participant
    Post count: 1479

    Hi meheustbruno,

    No problem – we’ve added this item to go into the next release.

    Kind regards.

    jollydragon
    Participant
    Post count: 25

    How about OANDA and ThinkForex?

    imported_tickstory
    Participant
    Post count: 1479

    General Questions

    Q. Tickstory does not start when launched. Error message displays “Tickstory has stopped working” and the application exits.
    A. Tickstory Lite requires Microsoft .NET v3.5SP1 be installed on the machine (any other version such as .NET v4.x will not suffice). You can download .NET v3.5 from here: http://www.microsoft.com/en-au/download/details.aspx?id=21

    Metatrader Questions

    Q. I am not getting 99.9% modelling quality on my back-tests or;
    My MT4 back-test reports that the modeling quality is “N/A” or;
    My MT4 back-test reports “TestGenerator: internal error because file not opened”

    A. This problem is typically due MT4 not utilising your exported data correctly. Check the following:

    • Ensure you have launched your MT4 terminal via the Tickstory ‘Launch MT4’ option (press F8 when in Tickstory to do this).
    • Ensure you have exported your MT4 database to the correct location (make sure you have selected the correct server if there are multiple selections). For example, if you have a “Demo” and “Real” account, make sure you are exporting to the same one you are using for back-testing, otherwise the data will not be visible to MT4.
    • If applicable, ensure you have correctly mapped the Tickstory symbol name (eg. EURUSD) to the MT4 equivalent symbol name (eg. EURUSDm, fcmEURUSD, etc). (See the manual or search the forum for more on this topic: search.php?keywords=maps+to&terms=all&author=&sc=1&sf=all).

    Q. Why isn’t TickstoryInfoExpert EA generating config file?
    A. Firstly, check you are checking the correct location. In MT4, go to File->Open Data Folder and then browse to the /MQL4/Files folder. A file should exist with a *.mt4config extension.
    If it does not, check the ‘Experts’ tab to see if any errors are being generated. This problem is sometimes caused by an invalid filename being generated (since it utilises your broker’s name). You can force a valid filename by going to the EA’s ‘ConfigFileName’ parameter to “Broker.mt4config”.

    Q. Why isn’t my EA working or;
    Q. Why isn’t my EA doing X
    A. EAs will perform differently when tested with tick data. We unfortunately can’t assist you with trouble-shooting specific EAs, however we have compiled a general FAQ which will hopefully help answer your question: viewtopic.php?f=2&t=794.

    Q. I am getting the error “Access to the path denied” when exporting.
    A. This is caused by Windows denying Tickstory access to the folder where it needs to store its downloaded tick data. To resolve this, go to File->Settings and specify a “Dukascopy Store Folder” that has general write permissions. For example, create a folder called “Tickdata” in your Documents and then specify C:UserDocumentsTickdata as the storage folder location.

    Q. My back-test doesn’t complete fully and stops at a certain date. What’s happening?
    A. This is usually caused by a limitation with MT4 which only supports a maximum of 4GB of data. If your back-test period is greater than 2 years, you are likely to come across this limitation. To check for sure, have a look at the size of your FXT files and ensure they are under 4GB. Further discussion on how to reduce your file sizes can be found here: http://www.tickstory.com/forum/viewtopic.php?f=4&t=176

    File Export Questions

    Q. I just exported a file but cannot find it.
    A. If you haven’t explicitly specified a pathname, TIckstory attempts to export the file in the program folder. It is possible to explicitly specify a pathname such as C:ExportedData{Symbol}.csv.

    imported_tickstory
    Participant
    Post count: 1479

    Hi Jollydragon,

    If you’re referring to acquiring data from these platforms, we’re investigating other sources for quality data. Ideally we would like to create a data import routine for MT4 which should cover all supporting brokers such as ThinkForex.

    Regards.

    ratsh
    Participant
    Post count: 4

    @tickstory wrote:

    Hi Ratsh,

    Many thanks for your comprehensive post. We are aware of the fact that Amibroker is very flexible and can handle different formats. In the future we hope to create a data provider that can feed Amibroker through its plug-in architecture. Until then, we are trying to “support” Amibroker by making it as simple as possible for users to import data with the minimal amount of effort (that is, using Amibroker’s default import definitions where possible). Of course, more advanced users will find your information highly invaluable.

    Thanks!

    Any news on the bold one?

    imported_tickstory
    Participant
    Post count: 1479

    Hi Ratsh,

    Unfortunately no news on this one yet. We will know more once we release our next major version of Tickstory. Thanks for staying tuned!

    Regards.

    imported_tickstory
    Participant
    Post count: 1479

    (Please note, there is a selection box in the top-right to translate this text into your native language)
    (Пожалуйста, обратите внимание, что это окно выбора в правом верхнем углу, чтобы перевести этот текст на ваш родной язык)
    (Si prega di notare, c’è una casella di selezione in alto a destra per tradurre questo testo nella tua lingua)
    (Bitte beachten Sie, gibt es eine Auswahlliste in der oberen rechten Ecke, um diesen Text in Ihre Muttersprache zu übersetzen)
    (Felhívjuk figyelmét, van egy válogatás doboz jobb felső lefordítani ezt a szöveget a saját anyanyelvén)
    (Por favor, tenga en cuenta, hay un cuadro de selección en la parte superior derecha de traducir este texto a su lengua materna)
    (S’il vous plaît noter, il ya une boîte de sélection dans le coin supérieur droit de traduire ce texte dans votre langue maternelle)
    (请注意,有一个选择框的右上角,以这段文字翻译成自己的母语)
    (選択ボックスは、あなたの母国語にこのテキストを翻訳するための右上にありますが、注意してください)
    (يرجى ملاحظة، هناك مربع التحديد في أعلى اليمين لترجمة هذا النص إلى لغتك الأصلية)

    Hi all,

    The latest release of Tickstory v1.6 that supports up to MT4 Build 830+ (including 840) is now ready. With much consideration, we have opted to go down the path of requesting a fee for users who wish to have “early” access to this update. This payment has been designed to be nominal so all those who have found value with the software over the years can participate in supporting Tickstory.

    Below are some answers to questions you may have:

    Why are we requesting a fee for accessing Tickstory?

    Development and support of Tickstory has been a costly undertaking and has required significant financial backing. Over the last two and a half years of developing and supporting Tickstory, we have endeavoured to offer the software for free while hoping we would be supported by our user community through donations and also from advertising revenue. Unfortunately this has not been the case. Since the first release in 2012, we have received exactly 10 donations from our users. Of those donations, 6 amounted to a sum total of around US$15. It is essentially our advertising revenue that allows us cover our server costs that provide you access to the support forums and the latest software downloads. As for the many thousands of hours we’ve invested developing and supporting Tickstory, this has been entirely unpaid and given to the community for free. For the benefit of you and the Tickstory community, we’re asking for your backing so we are able to ramp up our development effort and also to demonstrate that our community is right behind us in the work we do.

    What will this payment get me?

    Your payment of US$23.95 will allow you to have “early access” to version 1.6 of Tickstory which specifically supports the latest MT4 Build 830. Banner ads will also be suppressed until at least [s:195n3ftl]31st of August[/s:195n3ftl] [s:195n3ftl]30th September[/s:195n3ftl] 31st October 2015. Access to the software is given on a per-user basis and each user has permission to install it on a maximum of 2 machines that they own (each additional license serves an additional 2 machines). No other terms of the software license and support change (although we always prioritise those who show their support!)

    Do note that there are no guarantees that the launcher will work on future versions of MT4. For those who have paid, we will endeavour to provide continued “early access” to any further updates until at least [s:195n3ftl]31st August[/s:195n3ftl] 30 September 2015 (subject to whether it is technically feasible).

    What if I can’t afford to pay?

    If you have utilised Tickstory to back-test your EA, you have probably already reaped the significant monetary benefits from the software (not to mention time-saved!) Tickstory has undoubtedly saved many a Forex account from bankruptcy – it’s surely worth the minimal payment we are asking. Just think – your broker charges you much more just to execute a few trades!

    We really would like all those who can afford to to support us. This includes our non-English speaking users across the world – Russia, China, Europe, etc. who we have taken time to make the software accessible to you in your native language. Note also that the registration process will assist us to identify which countries/languages are part of our core user-base and future translated versions will be prioritised accordingly.

    For those who genuinely cannot contribute, we suggest you revert your MT4 build back until the latest version of Tickstory is available to you.

    Can I still use Tickstory if I haven’t paid?

    Yes you can still continue to use your current version of Tickstory v1.5, although you will need to revert back to an earlier version of MT4 if you wish to continue back-testing. Discussion on how to do this can be found here:

    viewtopic.php?f=2&t=683

    Will Tickstory remain free in the future?

    That really depends on what sort of support we get from you. In our bid to keep a version of Tickstory free, we continue to encounter on-going costs to keep the software up-to-date and to add new features. We are exploring various ways in which users can support this on-going development. One way you can assist right now is to ensure you make any purchases through our affiliate links and also white-list our website from any ad-blocking software. We are also working on a licensed version of Tickstory which offers an enhanced set of features and will be a must-have tool for any serious trader. We hope that our users will give a strong show of support for us when it launches!

    To avoid everyone hoping that the “other guy” will help out, we have created a scale giving some visibility of the level of support we are getting. If the meter shown makes it to a green level, it means that a good percentage of our users are getting behind us.

    If you have any other suggestions that may help us, or if you have a company interested in advertising with us, please free to PM us to discuss further.

    [attachment=0:195n3ftl]meter.jpg[/attachment:195n3ftl]

    When will Tickstory v1.6 be freely available?

    At a later, yet to be determined date (that is, depending on whether we get a strong showing of support from our users), general access will be available to access the software. Our support of Tickstory continues to be free for all – although we will be giving priority to users who have supported us.

    What other options are there to launch MT4 for back-testing?

    We recommend using Birt’s Tick Data Suite – it provides a number of useful features such as being able to test beyond 4GB of data. Birt also provides updates as necessary whenever MT4 breaks the launcher. You can use our affiliate link to order and/or find out more: http://cd710nh5qn5ax84ol4ncpnfp99.hop.clickbank.net/?tid=V16

    How can I pay?

    Click the following link to get your advanced copy of Tickstory v1.6 and specify the number of licenses you require:

    http://sites.fastspring.com/tickstory/product/tickstoryv16?action=adds

    You will be issued with a license key and the link to the latest version of Tickstory v1.6 via email. To enable the latest features, select Help->License from the main menu and enter the key you were issued.

    (Please note that sharing your registration details with other users will not only result in bad karma but could result in your software being deactivated. If you value the software, please value our service – every license helps us to help you).

    Release Notes for v1.6

    New features
    •[artf279130] MT4 Launcher: Added support for latest Metatrader Builds 730+.

    Fixes
    •[artf272539] Margin Currency is being exported as ‘USD’ instead of ‘EUR’ for ‘EURUSD’.
    •[artf254896] Added support for AUSIDXAUD.

    Thank you for your support and we look forward to providing you with the next version of Tickstory!

    Threshold
    Participant
    Post count: 7

    @ratsh wrote:

    Longterm AmiBroker user speaking here:

    FYI AmiBroker is not dependent on any predefined fix format to get data imported to it. There is no such thing as “fix format”. AB works with any format defined. It also provides millisecond data which is not even covered in those two predefined formats. In short those two formats supposed to work with Amiquote are just two of thousands possibilities as there are in addition any other standard data file extensions supported also. Also you don’t need Amiquote to get data files imported since you can use any custom data plugin or OLE import script or the two manual file import options in File menu of AB. This is just meant to clarify to remove misunderstanding of how AB works. It’s not like MT or NT who only work with fix datafile formats. It is highly flexible. So saying this or that 3rd party software now supports Amibroker for data import sounds quite funny to insiders.

    Side note: aqi, aqd, aqh,aqfe other Amiquote file extensions are just standard comma separated ascii data files also and are readable with any texteditor. So there is no mystery about them and no hidden protection.

    Hope this clears up a few tings.

    ##################################################################################################################
    Here is one (out of many) examples showing how to import bid/ask price and volume with millisecond timestamp to AmiBroker at once.
    ##################################################################################################################

    In Tickstory choose:

    Timeframe: Tick
    Timezone: whatever you need
    Output format: Custom

    Check include header

    Header info:
    Timestamp,Bid price,Bid volume,Ask Price,Ask volume

    Data format (timestamp is again just one of many possiblities):
    {Timestamp:yyyyMMdd HH:mm:ss.fff},{BidPrice},{BidVolume},{AskPrice},{AskVolume}

    File name: for example use {Symbol}.csv

    and start downloading

    ##################################################################################################################
    With notepad++ create a file with following content (this is a “to be done just one time” procedure for each format you need):
    ##################################################################################################################

    $FORMAT Date_YMD,Time,Close,Volume,Aux1,Aux2
    $SKIPLINES 1
    $SEPARATOR ", "
    $CONT 1
    $GROUP 255
    $AUTOADD 1
    $DEBUG 1
    $TICKMODE 1
    $TIMESHIFT 0

    and save it with file extension .format (for example TickstoryBidAsk.format) and copy that file to …AmiBrokerFormats subfolder

    Note:
    Timshift line is set to zero but if you want to shift to other time zone during import then for example change to $TIMESHIFT 2 which would shift the time stamp by +two hours while $TIMESHIFT -4 would shift by 4 hours backwards (for example if you want import different timezone as the one you have set in tickstory download. Of course you need to take care of summer/winter time, so you would have to split data file if summer/winter time range is part of same file and need to adjust $TIMESHIFT line for summer and winter time import. Anyway $TIMESHIFT is not needed if you are happy with downloaded timezone. Just showing that it’s possible to change time zone after download also.)

    Go to same subfolder AmiBrokerFormats, open import.types file placed in there and add line (for example):
    TickstoryTickBidAsk (*.csv)|*.csv|TickstoryBidAsk.format
    (you can see that the format file info at the end of the line needs to have same file name as you have saved your format file to before)

    save that import.types file

    Now you are finished with preparations.
    Open AmiBroker, create a Tickstory database, go to File –> Import Ascii, choose file format “TickstoryTickBidAsk” in drop down menu and browse to your tickstory download folder to open your previously downloaded Bid/Ask data file(s) separated or all at once (by marking them).

    Of course you can use programmatic import too but that’s another short story.

    One thing to do while creating your Database and being related to upper example is setting data source to local database since it is off-line data and setting base time interval to tick there. In addition go to File –> Database settings –> Intraday settings of our database and set Aux1 to Last and Aux2 to Sum (since latter one is ask volume). Also set start minutes to “00” from “30” to start hourly TF at 00.
    see picture

    I followed your instructions. Importation goes well, no errors. Takes some time, but its obviously because of the size of these tick files which average atleast around 10gigs each. I imported just 1 for a test. Worked. So to save it, I shut down Amibroker, which took a long, laggy time, about 10 minutes or so to shut down on my pc with 4 cores @ 4ghz and 16 gigs of ram. Then I restarted the program, start up took equally long with similar lag. Then I tried to pull up the chart and this seems to be an impossible task. Memeory usage skyrockets to max, program becomes unresponsive, pc lags. I let this go on for about to hour to see if it would load eventually and then had to end process.

    Do you not experience any issues with your tick files? I download the fill length, 2003-now for EURUSD. That was my test file. I thought Amibroker was even better than MT4 @ handling data, backtesting, and optimizing. It seems I’m unable to even pull up a chart.

    Thoughts?

Viewing 15 posts - 16 through 30 (of 40 total)

You must be logged in to reply to this topic.