Comments on: chunk – Read a large (XML) file a chunk at a time

By: dom111

dom111 — Tue, 29 Dec 2009 11:32:41 +0000

Hi there Ben,

I’ll certainly have a play with it and see if it’s something I can resolve quickly, not sure why it would have any impact though…

Thanks for pointing this out!

Dom

By: Ben Reubenstein

Ben Reubenstein — Wed, 23 Dec 2009 17:33:42 +0000

This code helped me parse some very large files quickly, however when I try to create more than one chunk instance in a script, it will error out. I am not quite sure why this is happening. I receive the following exception when I try to read the second XML file in:

./chunk.rb:223:in `+': can't convert nil into String (TypeError)
	from ./chunk.rb:223:in `read'

I am calling Chunk.new again, so I am not sure why a second execution would cause this behavior. If I execute each import separately, everything works. Any help is greatly appreciated.

By: chunk – Read a large (XML) file a chunk at a time | dom111.co.uk

chunk – Read a large (XML) file a chunk at a time | dom111.co.uk — Fri, 02 Oct 2009 01:24:36 +0000

[...] Read more from the original source: chunk – Read a large (XML) file a chunk at a time | dom111.co.uk [...]

By: dom111

dom111 — Thu, 10 Sep 2009 21:22:18 +0000

That looks like a good solution for compiled languages…

By: Harry Xu

Harry Xu — Fri, 04 Sep 2009 23:21:36 +0000

Have you considered vtd-xml for chunk extraction?

http://vtd-xml.sf.net