Hi, I'm working on plagiarism detection and I need some help on text extraction from pdfs. I've tried PDFTextStream which really works well for extracting text from pdfs. I need to be able to extract the text into a strutured format where i could query thing like title, chapters,etc. Would appreciate it if I could get pointers to achieving this task. Thanks
Have you tried posting this to <a href="http://stackoverflow.com" rel="nofollow">http://stackoverflow.com</a> ? That's a better forum for these kinds of questions.<p>If you were to write a blog post about how to structure the extracted text, that's more the HN thing.
I won't swear to it, but I suspect you're going to have to largely roll your own, and that it will be at least partly heuristic driven. I use Apache Tika[1] to extract text from PDFs and then index it with Lucene, but we don't need to discriminate between various chapters or anything. But I can picture how you could use OpenNLP[2] and some custom code, to break down the chapters.<p>[1]: <a href="http://tika.apache.org" rel="nofollow">http://tika.apache.org</a><p>[2]: <a href="http://opennlp.apache.org" rel="nofollow">http://opennlp.apache.org</a>