Tweet
I have just witnessed a sight that I never thought I would see and that was a Ts2ki file trying to exceed the 4 GB limit. The file did not stop updating, it just disappeared and if there was no backup all 4 GB of that data would be lost. The way Ts2ki works is that whenever a new symbol is added the program assigns it to a particular Global Server (GS) data file and all data for that symbol must be stored in that specific file and can't be spread across files. If you have a lot of tick data you may be approaching a similar situation with your system. I have written a freeware program which when the GS is shut down will determine how much available space is in the file (see image) and if the available space is getting low the report shows where the most data is stored. For instance, on my very small program development GS data even though the "Available-Space" is large, it is apparent that Citigroup (C) tick data is by far the largest storage consumer and if I needed to reduce data size then reducing the number of days of "C" tick history might be a good choice.
When GS data is deleted, the size of the GS file does not get smaller but that deleted data space is available for other data storage. The only way to reduce the size of GS files to the minimum is to use a third party program such as the Ts2ki Unfrag utility. In the case of the subject file, only 3 KB was available free space so even the Ts2ki Unfrag utility would not have helped here since the primary purpose of this utility is to defragment the GS files. What should have been done was to delete data until there was sufficient available space. The problem - which symbols are stored in which files - and until I wrote the Ts2ki Diagnostics program that information was not available.
I have provided the Ts2ki Diagnostics utility free of charge on my website in the Downloads Section:
I would advise anyone with significant amounts of GS data to use this utility.
Best regards,
~Bob
When GS data is deleted, the size of the GS file does not get smaller but that deleted data space is available for other data storage. The only way to reduce the size of GS files to the minimum is to use a third party program such as the Ts2ki Unfrag utility. In the case of the subject file, only 3 KB was available free space so even the Ts2ki Unfrag utility would not have helped here since the primary purpose of this utility is to defragment the GS files. What should have been done was to delete data until there was sufficient available space. The problem - which symbols are stored in which files - and until I wrote the Ts2ki Diagnostics program that information was not available.
I have provided the Ts2ki Diagnostics utility free of charge on my website in the Downloads Section:
I would advise anyone with significant amounts of GS data to use this utility.
Best regards,
~Bob
Attached Files