Live chart data export to CSV

Here you can post and download custom indicators. PLEASE: Do not start topics unless you are posting your own indicator, they will be moved to appropriate section even if you do.

Moderator: admin

Re: Live chart data export to CSV

Postby Gennadiy » Thu Jul 24, 2014 2:41 am

Hello chimpy,
It looks like you are using the old version of the application.
Here is the output example of the new application:
Code: Select all
07.16.2014 1,71404 1,71498 1,71114 1,71338 1,71464 1,71524 1,71151 1,71411 119200
07.17.2014 1,71338 1,71426 1,70843 1,70987 1,71411 1,7145 1,70866 1,7104 205346
07.18.2014 1,70987 1,71167 1,70352 1,70789 1,7104 1,7119 1,70378 1,70909 131131
07.21.2014 1,70805 1,70984 1,70547 1,70736 1,7095 1,71009 1,70571 1,70777 91887
07.22.2014 1,70736 1,70822 1,70404 1,70626 1,70777 1,70847 1,70426 1,70667 92956
07.23.2014 1,70626 1,70942 1,70229 1,70415 1,70667 1,70967 1,70257 1,70459 104943
07.24.2014 1,70415 1,70458 1,7021 1,70429 1,70459 1,70483 1,70238 1,70456 16820

Also the structure of the config file was changed in the latest version of the application.
Please, download the latest version one more time, extract it in the new folder, fill the new config file and try to use the application again (new config does not contain <Timeout>1</Timeout> parameter). Please let me know about the result.

Thank you.
Gennadiy
 

Re: Live chart data export to CSV

Postby chimpy » Thu Jul 24, 2014 11:57 am

ok fixed that. the new app file name changed with the x86 bit missing off the end caught me out.
The new application runs but crashes on the word "Real" referring to the Real/Demo choice in the config file.
Mine is set to Real as I am using it on a real account. Here is my config file below. Please tell me which options are no longer used and that should be removed as well?

<UserID></UserID>
<URL>www.fxcorporate.com/Hosts.jsp</URL>
<Connection>Real</Connection>
<SessionID></SessionID>
<Pin></Pin>
<TradingDayOffset>-7</TradingDayOffset>
<TradingWeekOffset>0</TradingWeekOffset>
<Delimiter>,</Delimiter>
<NeedLastCompletedCandle>N</NeedLastCompletedCandle>
<TimeZone>UTC</TimeZone>
<SeparateDateAndTime>Y</SeparateDateAndTime>
<FormatDecimalPlaces>Y</FormatDecimalPlaces>
<OutputDir>H:\fxcmdata</OutputDir>

The TimeZone; and SeperateDateAndTime options are needed by some people because, of the way their third party applications process data
I am not sure about the FormatDecimalPlaces. Allpin put it in to fix some problem but I cant remember what it does and cant test it without all the old functionality of the old FXconnect version.
chimpy
FXCodeBase: Initiate
 
Posts: 112
Joined: Fri Jun 10, 2011 10:32 am

Re: Live chart data export to CSV

Postby chimpy » Thu Jul 24, 2014 12:13 pm

Glennadiy,
This is what FormatDecimalPlaces does, from the conversation on 01 Aug 2011.

"Some 3rd party charting packages have a problem with the price data keep changing the decimal places it uses, for example
one time the open is "1.82" and then on the next line it is "1.82037" then its "1.827" etc. For compatibility can the data be formated using all 5 decimal places as so, 1.82 becomes 1.82000 and 1.827 becomes 1.82700 . I can then set the charting package to analyse to the first four or five decinal places
Thanks again
Chimpy"

"- Prices can be written formatted with fixed number of decimal places (using Digits value from Offers table). You have to provide <FormatDecimalPlaces>Y</FormatDecimalPlaces> in configuration file (default is 'N' - do not format price"

Its important for compatibility. Can you confirm if this still works as designed?
Thanks
chimpy
FXCodeBase: Initiate
 
Posts: 112
Joined: Fri Jun 10, 2011 10:32 am

Re: Live chart data export to CSV

Postby Gennadiy » Fri Jul 25, 2014 12:09 am

<FormatDecimalPlaces>Y</FormatDecimalPlaces>

Its important for compatibility. Can you confirm if this still works as designed?

Unfortunately this functionality is not included in the version 2. But we will return it in the nearest time. Also could you please clarify which parameters from the old config are required and, please describe these parameters:

<NeedLastCompletedCandle>N</NeedLastCompletedCandle>
<SeparateDateAndTime>Y</SeparateDateAndTime>
<TimeZone>UTC</TimeZone>

We will return/add them in the version 2 of the application.

Please tell me which options are no longer used and that should be removed as well?

The following parameters are included in the new config (config sample may be found in the archive with new version of the application as well):
Code: Select all
<Login></Login>
<Url>www.fxcorporate.com/Hosts.jsp</Url>
<Connection>demo</Connection>
<SessionID></SessionID>
<Pin></Pin>
<OutputDir>d:\fxcmdata</OutputDir>
<Delimiter>;</Delimiter>

    <History>
      <Instrument>USD/JPY</Instrument>
      <Timeframe>m1</Timeframe>
      <Filename>USD_JPY_m1</Filename>
      <NumBars>400</NumBars>
    </History>
Gennadiy
 

Re: Live chart data export to CSV

Postby chimpy » Fri Jul 25, 2014 3:16 am

Gennadiy,

The <NeedLastCompletedCandle>N</NeedLastCompletedCandle>

Basically this option made the last line in the .csv not update per tick/timer... its waited until the 1m,5m,15m 30m ..etc was up before rolling all the updates into one rather than edit the file each tick or per timer.
personally I never used it but someone with a performance issue on their system my use it to avoid hashing the hard disk every tick for every timeframe.
so {Priority Medium/Low}

<SeparateDateAndTime>Y</SeparateDateAndTime>

If set to N then Time and date were lumped together as in DD/MM/YYYYHHMM
I have not seen this format in any of the third party applications I have used. Maybe if someone else speaks up and requests it then put it back in?
so {Priority Low}

<TimeZone>UTC</TimeZone>

This is important and worked the same as in marketscope with the options of UTC, Server, Local, Financial Time, New York.
(not sure if financial time was included by allpin but New York was included and called EST)

If you play around with the option in marketsope you can see how it effects the candles in the chart and someone using this application in usa will want a different setting to someone in London or Paris.
so {Priority High}

<FormatDecimalPlaces>Y</FormatDecimalPlaces>
Some 3rd party apps simply wont work if the data keeps jumping around from "1.72" > "1.72190" > "1.723" etc
Got to be able to format the decimal places so if a symbol provides a maximum of 5 digits or 3 digits after the period (as with JPY) then there should always be 5 or 3 digits - this is how it worked in the original. I.E "101.1" becomes "101.100" and "1.72" is "1.72000"
so {Priority High}

The date format needs to be delimited with like DD/MM/YYYY (the original) or MMDDYYY, DDMMYYYY works well for most charting software I think.
Time is HH:MM (original) or HHMM

If you can get the FormatDecimalPlaces working, Date delimiting fixed and timezone temporarily hard coded to UTC then at least the app is in a usable state. Also I was not sure why I could not log in earlier using the "Real" account option?

Thanks
C
chimpy
FXCodeBase: Initiate
 
Posts: 112
Joined: Fri Jun 10, 2011 10:32 am

Re: Live chart data export to CSV

Postby Gennadiy » Sun Jul 27, 2014 11:29 pm

Hello,

Thank you very much for the clarifications. We have started to work on an update for the application. I will let you know about the result.

Also I was not sure why I could not log in earlier using the "Real" account option?

Could you please clarify if this happens with the old application? Could you please try to do it with the new application and let me know about result?

Thank you.
Gennadiy
 

Re: Live chart data export to CSV

Postby chimpy » Mon Jul 28, 2014 3:21 am

Gennadiy,

No this is a new thing with the latest application update you posted earlier this year.
I am passing the password on the command line as parameter, just like all the previous versions.
Crash pic attached
Attachments
livecrash.jpg
chimpy
FXCodeBase: Initiate
 
Posts: 112
Joined: Fri Jun 10, 2011 10:32 am

Re: Live chart data export to CSV

Postby Gennadiy » Wed Jul 30, 2014 1:38 am

Hello chimpy,

Please find the new version of the application below:

LiveChartDataExportToCSV_v2.0.1_x86.zip

LiveChartDataExportToCSV_v2.0.1_x64.zip


Release Notes:
1) New format of date in CSV (dd/MM/yyyy);
2) FormatDecimalPlaces parameter is added;
3) TImezone parameter is added.

Please note that the new configuration file shall be used (template is contained in archives above).
Gennadiy
 

Re: Live chart data export to CSV

Postby chimpy » Wed Jul 30, 2014 7:21 am

Gennadiy,

Thanks for the update, I have havd a quick look and I can see that although the date format has been fixed to the original, (dd/mm/yyyy) it is now lumped in with the time plus a space between. I.E there is no delimiter after the date:

30/07/2014 12:00;1.34003;1.34039;1.33947;1.33981;1.34027;1.34064;1.33972;1.34003;3237

This would be ok if the <SeparateDateAndTime>Y</SeparateDateAndTime> option still existed, which I just tried but did not work.

The normal format for most analysis packages is:

30/07/2014,12:00;1.34003;1.34039;1.33947;1.33981;1.34027;1.34064;1.33972;1.34003;3237

Can the date and time be delimited in their own cells or the SeparateDateAndTime be put back in as before?

Thanks
chimpy
FXCodeBase: Initiate
 
Posts: 112
Joined: Fri Jun 10, 2011 10:32 am

Re: Live chart data export to CSV

Postby Gennadiy » Thu Jul 31, 2014 12:28 am

Hello chimpy,
We will work on it. I will let you know about the result later. Thank you.
Gennadiy
 

PreviousNext

Return to Custom Indicators

Who is online

Users browsing this forum: Google [Bot] and 32 guests