this is why LiveCharts freezes

[hubanks]

i have been having problems with LiveCharts freezing up my computer a few times a day ... every day

i always have to re-boot to get control back and restart my live charts sessions

i have read a few other threads about possible memory leaks in the Live Charts app

I think this is right ... I changed my Java Console to verbose mode and found it printed out this error just before LiveCharts froze

"Exception in thread AWT-EventQueue-1 java.lang.OutOfMemoryError: Java heap space"

So I think this memory leak problem in LiveCharts is the issue ...

[ScottJ]

Thanks for capturing that error message. That may be a critical clue. We'll pass on to Engineering.

Thanks.

[dannol48]

hubanks,

How many stocks are currently in your Portfolio?

If you have more than one portfolio, how many were active in the portfolio watched at the point that heap failure occurred?

And, Nice Catch!

Dan

[hubanks]

i have only 1 saved portfolio with 22 or 23 stocks listed.

one other thing

i always have the main live charts window and the 4 additional livecharts windows running on my PC at the same time

so i have 5 livecharts windows running on my PC

so the freezeups occue with all 5 windows open and running

i have no idea if a single live chart window will also freeze up at some point ... i should test that ... however i need 5 charts to monitor the stocks that i day trade. (so it's hard to shut down the other 4)

[dannol48]

That's interesting and does follow a possible theory I've passed to Todd.

Before I created a portfolio with no symbols named "Empty", I was running a portfolio with around 8 to 10. I didn't have the severity of your problem with less in the portfolio, but did have intermittent disconnnects with the secondary chart failures and a few 100% CPU failure including the one I posted about this morning.

By switching to no symbols in the portfolio, Nasdaq in Main chart for keepalive, and 4 secondary charts for stocks, I actually ran all the way from around 12:38 EDT to market close 100% stable.

May I ask the city and state where you're located? Don't need an address, just curious how far (distance) you are from the eSignal server.

[hubanks]

i am located in Bowie, Maryland

i have Comcast high speed cable internet, my service is pretty stable i never appear lose my connection

by the way, i never run indexes. i usually run AAPL or GOOG in the main window.
what do you mean you run the nasdaq index for keepalive. is there some instability using stock tickers instead of index tickers?

this locking up problem has only occurred with the new LiveCharts, the old version never hung up on me (freezing my computer) ... i always ran 6 of the old livecharts windows at one time ... i always run the max of 5 new LiveCharts windows now.

I just recounted the number of stocks in my 1 saved portfolio ... the count is 26.

i always run "Time and Sales" in the main Quotes and Hot List window

i usually run current Symbol i the News window

In the chart window, i run the chart with a 5 minute interval, and underneath that I run "Volume" and "MACD" using the default settings.

All 4 of my "New Chart" windows also run at a 5 minute ticker interval with Volume and MACD displayed under it.

I can keep my computer on overnight, with all 5 windows open and it doesnt lock up ... howver there is no data flowing since the markets are closed.

WHen the markets are open, my computer freezes (Java stops responding due to an out of memory error) after 2 to 4 hours

after i reboot, i can relogin and reinitiate all my windows ... and it runs for another 2 to 4 hours before freezing

i have a new computer with 2GB of RAM, running Windows XP Pro, all updates installed, and Norton Internet Secutiry running (no viruses)

[dannol48]

I use the every 15 second data "tick" update of the Nasdaq $COMPQ to keep the data network connection on socket 2812 alive. The constant disconnect/reconnect on that socket session is a possible root cause of why the application is unstable across Internet (distance) facility. A symbol with low to no ticks causes disconnects. A high data rate symbol, like CSCO, also seems to cause disconnects, BUT I was running that test with about 8 to 10 symbols in a Portfolio.

What I recently (yesterday) discovered was that no symbols in the Portfolio achieved a very stable period of no disconnects or chart drop-outs on secondary (over 3.5 hours). I may try the same methodology today with a very high volume symbol in the Main window.

My current theory is more data and further network distance causes more disconnects due to server and network timeouts. Since my Portfolio had relatively low activity stocks, I think it may actually be the number of stocks the server has to "service" that is tied to the problem (more time to service the call). That's based on the assumption that the developers and those using the app at eSignal aren't experiencing the problem in a local (near server) environment. That's why they couldn't replicate our problems.

Dan

[dannol48]

To examine the high-volume stock problem, I've place four very heavy traffic / tick stocks in the four secondary windows: CSCO, MSFT, AAPL, GOOG. I'm running Nasdaq $COMPQ in the Main chart and operating with the "Empty" portfolio. I just assumed that configuration at 8:45 EDT.

I'm watching Memory Usage with Task Manager and the Java Console for any signs of problems.

Let's see if / when it breaks..... or if my only five symbols concurrently "subscribed" theory keeps me stable.

Edit1: 10:45 EDT Using $INDU (DOW), not $COMPQ (Nasdaq) this morning for Main chart updating every 2 seconds from start. Sorry, wanted to push the Main window too. After one hour, rock stable with no disconnects or chart failures. Did a brief switch on the Main Chart from Dow to Nasdaq and back to DOW to see if a change would cause a failure, but that worked OK. Except for alot of ?Painting of layer? messages, my Java Console log looks clean. My processor is definitely getting a workout with those symbols. Memory did a creep from about 135.5MB to 147MB over the hour.

Edit2: 11:45 EDT Main + 4 stable. Socket Session stable, no disconnects/reconnects. Memory now 165.7MB and continues to steadily climb. I didn't close the initial logon browser window after login and applet launch, so that figure includes that memory. Java Console shows no unusual events. Note, I'm still on original Connection #0 session from start, so any memory leak problem at this point is not due to Socket 2812 failure.

Edit3: 12:45 EDT Main + 4 stable. Socket Session stable. Memory now 166.7 MB (increase definitely slowed in last hour to almost nil). Nothing in JC Log to report.

Edit4: 13:45 No change. Memory now 166.5 MB and appears to have stabilized around the mid-166MB range. This is now the longest sustained period of stability on my station since cutover to LC2.

Edit5: Server Name = LC-B-05 (current session server from JC)
ESignal Engineers....you should see my userid connected there.

Ping statistics for 199.217.10.233:
Packets: Sent = 71, Received = 71, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 75ms, Maximum = 194ms, Average = 84ms

Ping done at around 14:05 EDT.

Edit6: DISCONNECT JC Log follows:

Receiver thread (S) #0 exiting.
Waiting 10 seconds to reconnect.
New session state: WaitingBetweenConnections
14:06:14 Communication error: java.net.SocketTimeoutException: Read timed out
Sender thread (S) #0 exiting.
Socket (S) #0 closed.
14:06:24 Attempting to connect.
Server connection (S) #1 created.
New session state: Communication, connected = false
14:06:24 Socket connected
Client Protocol # = 232
IMAF is disabled (Invisible Off).
Server Name = LC-B-07
Server URL = lc-b-07.esignal.com
User authorized.
onConnected() invoked in McNewsServerInfo
Sending news headlines update request.
Sending SubscribeQuery for symbol CSCO
Sending SubscribeQuery for symbol MSFT
Sending SubscribeQuery for symbol AAPL
Sending SubscribeQuery for symbol GOOG
Sending SubscribeQuery for symbol $INDU
DEBUG TIME & SALES: request time from = Thu Apr 24 00:00:00 EDT 2008
DEBUG TIME & SALES: request time to = Thu Apr 24 23:59:59 EDT 2008
Server Quote Limit =75
TS: SessionInfo changed
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol AAPL
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol MSFT
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol CSCO
SD exception for symbol CSCO
SD exception for symbol MSFT
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol $INDU
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol MSFT
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol MSFT
SD exception for symbol CSCO
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol MSFT
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol MSFT
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol MSFT
SD exception for symbol AAPL
SD exception for symbol $INDU
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol MSFT
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol MSFT
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol GOOG
SD exception for symbol AAPL
SD exception for symbol $INDU

That might have been concurrent to time I did PING. Interesting.....

As opposed to prior socket 2812 disconnects I've reported, this disconnect/reconnect recovered the 4 secondary charts. Apparently, this "Read timed out" failure (different failure) can recover. Netstat confirms a change of dynamic port number at my end. Small increase in memory to 167.8MB.

Update to last: Although charts recovered, they are missing the data on bar (real day high-low range) for day to point of failure. All 5 charts are using day (D) for period with volume and 50 and 70 day moving averages. Cycling each secondary to another symbol $INDU and back restored data. Cylcing the Main from DOW to Nasdaq caused an immediate 2nd failure. JC Log follows:

Sending UnsubscribeQuery for symbol GOOG
Sending SubscribeQuery for symbol GOOG
Sending UnsubscribeQuery for symbol AAPL
Sending SubscribeQuery for symbol AAPL
Sending UnsubscribeQuery for symbol MSFT
Sending SubscribeQuery for symbol MSFT
Sending UnsubscribeQuery for symbol CSCO
Sending SubscribeQuery for symbol CSCO
Sending SubscribeQuery for symbol $COMPQ
Sending UnsubscribeQuery for symbol $INDU
Receiver thread (S) #1 exiting.
Waiting 10 seconds to reconnect.
New session state: WaitingBetweenConnections
14:33:15 Communication error: java.net.SocketException: Resource temporarily unavailable: recv failed
Socket (S) #1 closed.
Sender thread (S) #1 exiting.
14:33:25 Attempting to connect.
Server connection (S) #2 created.
New session state: Communication, connected = false
14:33:25 Socket connected
Client Protocol # = 232
IMAF is disabled (Invisible Off).
Server Name = LC-B-02
Server URL = lc-b-02.esignal.com
User authorized.
onConnected() invoked in McNewsServerInfo
Sending news headlines update request.
Sending SubscribeQuery for symbol GOOG
Sending SubscribeQuery for symbol AAPL
Sending SubscribeQuery for symbol MSFT
Sending SubscribeQuery for symbol CSCO
Sending SubscribeQuery for symbol $COMPQ
Server Quote Limit =75
TS: SessionInfo changed
TS: SessionInfo changed
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
DEBUG TIME & SALES: request time from = Thu Apr 24 00:00:00 EDT 2008
DEBUG TIME & SALES: request time to = Thu Apr 24 23:59:59 EDT 2008
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL
SD exception for symbol AAPL

Just before 15:00 EDT I shutdown the task and IE7 window to restart from scratch. On the restart I got this error in the JC Log:

Exception in thread "AWT-EventQueue-2" java.lang.IllegalArgumentException: Illegal group reference
at java.util.regex.Matcher.appendReplacement(Unknown Source)
at java.util.regex.Matcher.replaceAll(Unknown Source)
at java.lang.String.replaceAll(Unknown Source)
at com.futuresource.livecharts.marketview.datacell.LC ActiveSymbolCell$LCSymbolPopupMenu.defineMenuConte nt(Unknown Source)
at com.futuresource.livecharts.marketview.datacell.LC ActiveSymbolCell.onMouseClicked(Unknown Source)
at com.futuresource.datacell.DataTableImpl.mouseClick ed(Unknown Source)
at com.futuresource.quotes.ActiveDataTable.mouseClick ed(Unknown Source)
at java.awt.AWTEventMulticaster.mouseClicked(Unknown Source)
at java.awt.Component.processMouseEvent(Unknown Source)
at java.awt.Component.processEvent(Unknown Source)
at java.awt.Container.processEvent(Unknown Source)
at java.awt.Component.dispatchEventImpl(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilter s(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(U nknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarch y(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)

[j1900q]

We are beta testers, face it

I just wish they would get this stuff solved.
I think a version we could download would solve the problem. Like Ib does. at least give a choice.
thanks
keith

[rduclos]

Had a freeze today that displayed the same Java Console error message that hubanks reported at the start of this thread:

Exception in thread "AWT-EventQueue-1" java.lang.OutOfMemoryError: Java heap space

I had been invoking memory checks periodically with the console "m" command as follows:

Memory: 53,716K Free: 18,601K (34%) ... completed.
Memory: 53,716K Free: 16,352K (30%) ... completed.
Memory: 53,716K Free: 5,887K (10%) ... completed.
Memory: 53,716K Free: 5,887K (10%) ... completed.
Memory: 53,716K Free: 22,688K (42%) ... completed.
Memory: 53,716K Free: 19,947K (37%) ... completed.
Memory: 53,716K Free: 8,430K (15%) ... completed.
Memory: 65,088K Free: 6,207K (9%) ... completed.
Memory: 65,088K Free: 20,134K (30%) ... completed.
Memory: 65,088K Free: 9,639K (14%) ... completed.
Memory: 65,088K Free: 2,264K (3%) ... completed.
Memory: 65,088K Free: 5,661K (8%) ... completed.
Memory: 65,088K Free: 5,365K (8%) ... completed.

[JimE]

I have passed along some of this feedback to our Development Group. I can post an update after I have conversations with them.

--Jim

[dannol48]

Is anyone else seeing this specific error in their Java Console Log?

Communication error: java.net.SocketException: Resource temporarily unavailable: recv failed

If so, are you running any Security Suite/Firewall product on your desktop?

[hubanks]

i dont recall ever seeing that

[hubanks]

Live Charts froze on my 4 times today.

When I try to shut down, it says Internet Explorer is not responding.

[awuit9090]

I also got the "java.lang.OutOfMemoryError

Memory: 36,872K Free: 11,077K (30%) ... completed.
Memory: 36,872K Free: 11,181K (30%) ... completed.
Memory: 36,872K Free: 10,516K (28%) ... completed.
Memory: 36,872K Free: 8,246K (22%) ... completed.
Memory: 36,872K Free: 5,567K (15%) ... completed.
Memory: 36,872K Free: 3,846K (10%) ... completed.
Memory: 36,872K Free: 1,825K (4%) ... completed.