Discrepancies on hard disk vs. real-time data

[comino]

Hi,

I have downloaded data on to my hard disk. After having done tests on the "obvious" errors I found that many securities have incorrect opening prices (Open is outside High-Low range).

That is if I open the data from my hard disk it has (some) Open price errors and when I open the same security using the eSignal software (in a chart) it shows the correct Open prices.

How is that possible, it comes from the same provider (eSignal), it is the same security and both are daily data?

Looking forward to your input.

Ed Comino

https://www.4ever.info

[ACM]

Ed
What program are you using to download data?
If you could provide a symbol or two I can download them with Qcollector and see what results I get.
Also what format are you downloading in (ascii, metastock, other)?
Alex

[comino]

Re.: Discrepancies on hard disk vs. real-time data

Alex,

I do download in MetaStock format with "The Downloader".
Two examples:

CITIGROUP (C) Daily
Record #467 (12-11-2001) O 45,26 RT 46,90
Record #666 (28-8-2002) O 34,20 RT 33,95
Record #699 (15-10-2002) O 30,65 RT 32,55
Record #708 (28-10-2002) O 35,71 RT 35,714


BOEING (BA) Daily
Record #426 (17-9-2001) O 43,46 RT 38,70
Record #437 (2-10-2001) O 33,00 RT 33,13
Record #701 (18-10-2002) O 29,99 RT 29,45


Ed

[ACM]

Ed
I just did a download and get the same errors.
I also checked the charts on eSignal Advanced Charts and the errors are there too albeit not visible because the charting app must have some form of error correction that adjusts the plot.
However if you look at the Cursor Window on those dates you will see that the value of the Open is out of range.
In cases like these I suggest sending an email to [email protected] listing the symbol[s], date[s] and incorrect values or the type of error (ie Open out of range)
Alex

[comino]

Thanks for checking. Looked at the Cursor Window myself but do not see that the value of the Open is out of range.
Where do I have to look?

I am happy to report this to eSignal but I have HUNDREDS of securities with this problem. Isn't there a way eSignal runs the same test and does the fixing for us?

Ed

[ACM]

Ed
Attached is an example of Open out of range.
Notice what the value for the Open is in the Cursor Window. On the chart though the bar is plotted with the correct values.
As to your second question I am sure someone from eSignal will respond to this.
Alex

[comino]

Alex,

Attached is an example of Open out of range (using candlesticks).
I notice that the value for the Open is in the Cursor Window is the same as in your chart. But the plotted chart ALSO shows the incorrect values.

I sent an e-mail out and waiting for a reply.

Ed

[JayF]

Hello comino and Alex,

I have verified these issues as well, and have passed them along to our QA Team for investigation.

Thanks,
Jay F.
eSignal Support

[comino]

Hi Jay!

Thanks for the additional help! (needed it)
I have spoken today with the eSignal helpdesk (with Steve, there seems to be only one Steve) and he told me that all the data on Esignals servers are correct.
He suggested two things to me:

1. To remove winros.sdb

Did that – did not solve the problem

2. Re-install eSignal 7.2 and delete an additional 3 files.
This I have not done.

Apparently I should have deleted the 7.1 release before installing the 7.2.
The files he referred to are needed within the Data Manager.

Can you speed up the process for me/us please?
I like to work with this data and need to make sure that the data can be trusted.

Thanks,


Ed

[JayF]

BA and C corrected

Hi Comino,

Our QA team fixed the referenced errors on BA and C.

Typically, these errors on the open are caused by regional exchanges that output erroneous trades near the open (ie. PSE). I have seen similar issues on other data providers as well. Since the exchanges do not send open information in their summary data, providers typically use just the first tick as the open. The reason the high or low is outside the range of the open is due to the summary data setting our high and low, but not taking into account the erroneous opening values.

We will be running a scan to find opens that are out of range of the high and low and we will correct them as soon as possible (ETA to follow.)

Regards,
Jay

[comino]

Jay!

I just checked upon the fixes of BA and C.
They now show the correct Open prices!

I have downloaded ALL the US Common Stocks and found hundreds of securities like BA en C.
I am very happy the read that those will be resolved shortly too!
Looking forward to the ETA.

Thanks again for the assistance!


Ed

[comino]

Jay / Alex,

Is there any news about the ETA?

Ed

[JayF]

Comino,

I heard back from our QA Team, and they estimate the bad opens on NYSE and AMEX will be corrected in the next business day or two.

Regards,
Jay F.
eSignal Community Support

[comino]

Dear Jay,

This morning I downloaded all the securities with tickers between T-Z (1.052 in total)
When I test the data I still get 497 errors (Open outside of High-Low range)
Should that have been fixed by now?


Ed

[JayF]

Comino,

Our original estimate was fairly aggresive, and there are some errors still present. We continue to work on the corrections, and will have them done as soon as possible.