Some suggestion to put you put you head and shoulders above.

Have some interesting ideas about how to improve the software? Let us know in this section!
Post Reply
coffeesnob
Posts: 4
Joined: Sat Feb 02, 2013 10:09 pm

Some suggestion to put you put you head and shoulders above.

Post by coffeesnob »

Hi Tickstory, I would have PMed you rather than put these suggestions in the thread but it seems this isn't allowed on my profile, I think this is information you should read before putting it in the public domain but as this isn't an option the public domain it is.

I really love what your trying to do here.. I love the concept; however I think you have a long way to go to make it a product that would be worth singing about. Tick data for hard-core back testing is a problem, and I think your product is currently the best around however given the bar is so low this isn’t a great achievement yet…

A bit about me, I am a communications engineer and I work in software development, I am also a trader and I have developed a number of tools of my own, I am frustrated by the huge gaps that are still in the market around back testing, tick data is one part but to have a really good standalone back tester in my view is really required.
There are a few developers close but they aren’t there yet. So anyway, in the case of tick story I think your heading the right direction but I want to make some suggestions so you can continue to build the best product around and hopefully you can make some money from it (if this is really great you should charge for it).

So here are some suggestions that I think would make your product something I would pay money for. :D

I know you have said that you are planning to have the database updated “live” and in real time. But honestly I think this is not required and would introduce more problems than you would like to solve.
The main issue is you have no control over the speed that the data is going to be able to be downloaded, because Internet speeds vary from site to site. Having real-time will in some cases be impossible.
So you need to have an alternative. What I am suggesting below will achieve this and will also enable “real time” of sorts should the user desire it.
I would therefore like to suggest that you modify the architecture of your product to do the following.

1. Start up as a windows service and download/export based on a configuration file. The service would be running all the time and would just do what it’s told in the configuration file. There should be a notification icon in the notification area and from that icon you should be able to quick load different configurations or open the configuration editor for the current configuration that is loaded

2. Modify the current GUI to create an XML configuration file that is used by the service that, way you could setup your desired workflow (download these pairs over this period and export these pairs between these dates) you could still use the pre defines (quick button) to determine the period you want to download but you could add one which is “To Today” which will always download the data for the pairs you have selected up to today. When tomorrow becomes today then the service should automatically download the latest data (this would need to be synchronised to the Data source clock). You should be able to save the configuration in different versions that can be opened by the service and you should also have a “publish” button which will load it to the service and restart it.

3. Have the ability to run the application in Command line mode, you could still use the XML file creator/editor to configure the command line parameters but having a CLI would mean if a user wanted to, they could schedule the download for a specific time of day (if they have a data provider that gives them high bandwidth at night for instance). Some users may have a specific need to schedule the export of their data or download a specific pair at market close this CLI in conjunction with the existing Windows scheduler would achieve this.

4. Ability to limit the resources (ie Download speed) for the application, I have noticed that at the moment if you try to get ambitious with your downloads, the PC will slow down and in some cases crash. The same issues happens when you are using other pier to pier applications (such as bit torrent downloaders), the solution to this would be to have the ability to limit the number of download threads that you are running and queue the rest. You could also have a limit to the download speed as well. The only catch with this approach is that you may get a race condition if you have the “To Today” parameter set as there is the potential for the user to throttle the downloads too far and the application will constantly be trying to catch up to today. However this could be worked around by either preventing the “To Today” function if the speed is below a certain threshold or disabling speeds below a certain level if the “To Today” function is used.

5. A back tester that works constantly…this should enable you to import a number of different formats (Mt4, MT5,Ninga trader ect) and run a back test and walk forward analysis with Out of Sample data comparison, an added feature to this which is presently missing from the market completely is a portfolio tester. This would need to be able to back test several strategies at the same time on a variety of pairs, this is well beyond the scope of your product but it is needed. One of your competitors is currently working on this and I know they will charge for it.
I honestly think this would put you head and shoulders above what you are now. If you’re too busy to develop this further, would you consider working out some kind of agreement to enable me to pick up development?

I have been using this product for over a year and there hasn’t been much improvement in that time which tells me you might have a bit going on. I think your product has really strong potential, If there is any way I can help I would be willing to get involved.

Very warm regards
Tony Fitzsimmons

tickstory
Posts: 4899
Joined: Sun Jan 06, 2013 12:27 am

Re: Some suggestion to put you put you head and shoulders ab

Post by tickstory »

Hi Coffeesnob,

Thank you for your comprehensive suggestions and information. Many of the items that you have mentioned such as an auto-update feature are on the TODO list. As you know, Tickstory is primarily focused on data gathering and dissemination which means that a back-testing function is not immediately on the cards - especially when you consider the all alternatives that are available.

The reason for the limited activity on Version 1 at the moment is that all development effort is being invested in the new version. This has been taking some time to design properly while factoring in all the great feedback we have been getting. With the redesigned framework, we're hoping that once the new application is deployed we can move a lot faster on all the new feature requests.

If you have examples of software which works for you, please let us know more so we can understand better what features give the most value to you.

Thanks & regards.

coffeesnob
Posts: 4
Joined: Sat Feb 02, 2013 10:09 pm

Re: Some suggestion to put you put you head and shoulders ab

Post by coffeesnob »

Thanks for your reply. re "If you have examples of software which works for you" in the case of backtesting and history data, they are all pretty crap. The history data is always a problem and I think this is the root cause of why most of the back-test applications I have tried are also problematic, even Tickstory with is current heavy dependence on Dukascopy has lots of gaps in the history.

Forex Strategy Builder is the closest I have found to getting it right in my opinion, however this is still problematic and buggy. at least it is open source and because its build around XML is platform agnostic (although I have never tried to get it working on Linux) it is also an example of a configuration interface that generates an XML file that is used by a server application (Forex Strategy Trader) which is what I was describing above.

other than that you would have to go to an application which is not related to Forex to see an example, services with configuration files have been around a very long time, but I would be happy to develop a design breif to explain this better if you like (time will be a challenge for me as well but I believe in what your doing and want to help) the beauty of this approach is that it is always running in the background and as a result your chosen pairs can be always up-to-date. if you use you current Gui to generate the Configuration file then half the work is done I think.

tickstory
Posts: 4899
Joined: Sun Jan 06, 2013 12:27 am

Re: Some suggestion to put you put you head and shoulders ab

Post by tickstory »

Hi Coffeesnob,

Thanks for for the info. We totally hear what you're saying - we believe that it's accessible & quality data that allows you to perform professional evaluations of a trading system. We plan to address the items you mention including giving access to multiple data-sources that can be readily/automatically updated. We're not big on XML though and are going down the path of allowing users to configure everything via the user-interface to make it easier to set up.

Thank you for your offer of assistance - much of the design is complete and we are essentially in the development phase and just doing the hard yards to get a beta out. If you have any more specific features that you would like, then this sort of feedback really helps to make the product better.

Kind regards.

TickTester
Posts: 7
Joined: Wed Feb 05, 2014 11:11 pm

Re: Some suggestion to put you put you head and shoulders ab

Post by TickTester »

Is there any way to get around the 4GB limit on history files? It's a real pain because the most tick data I can get to fit in a 4GB file is 3 years. So, I have two MT4 platforms set up. One for Jan 2008-Dec 2010 and another for Jan 2011-Dec 2013. Now, that it's 2014, I have to set up a third mt4 platform for Jan 2014 - Dec 2016. And I would like to backtest before 2008, so that means more platforms, more downloads, etc. And then I have to test every EA in every platform and stitch together the results. Don't even get me started about optimization...

Isn't there some way to be able to backtest at least 6 years worth of tick data at once in one platform? Preferably more than 6 as I would at least like to be able to test Jan 2008 - Feb 2014 in one run.

tickstory
Posts: 4899
Joined: Sun Jan 06, 2013 12:27 am

Re: Some suggestion to put you put you head and shoulders ab

Post by tickstory »

Hi TickTester,

I believe Birt's Tick Data Suite (TDS) by-passes the 4GB limitation. You read more here: http://17293gp5li0a4xdimxo5gkiy0k.hop.clickbank.net/.

Hope this helps.

Post Reply