Loading huge text files
As a part of my Swing application development I am required to load huge log files close to 1GB in size. In the log file, each row is like a record with fixed length fields. Currently i am using BufferedReader to load the log file into a Vector and then into JTable to represent the data in a spreadsheet format. I am also using a paging scheme wherein i display only 100,000 records at a time. The loading of data seems fine (speedwise) but when i apply my filters it really brings the system to a crawl. Does anyone have pointers on what tool i could use to implement filters or any other methods in general? Thanks.
|