# Way off topic: extract table data from PDF

**URL:** <https://discourse.gohugo.io/t/way-off-topic-extract-table-data-from-pdf/1400>\
**Category:** support\
**Created:** [July 6, 2015, 7:34am UTC](https://discourse.gohugo.io/t/way-off-topic-extract-table-data-from-pdf/1400 "2015-07-06T07:34:47Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![bep](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.gohugo.io/bep/32/3332_2.png) [@bep](https://discourse.gohugo.io/u/bep)\
**Post date:** [July 6, 2015, 7:34am UTC](https://discourse.gohugo.io/t/way-off-topic-extract-table-data-from-pdf/1400/1 "2015-07-06T07:34:47Z")

</div>

Yes, this is me abusing this forum with off topic questions, but you are so helpful!

A customer of me for the last 15 years asked me if I could dig up a piece of software that could take his personal bank statements in PDF (Norwegian banks only hand out the very recent transaction history in CSV, the archive is in PDF) and convert them to CSV or Excel.

He had done a job himself looking. And the software out there that works are either very expensive or an online service (which is no good for confidential data).\*

So I though I take a stab at it myself, and with my Hugo-driven Go-skills I thought a `pdftocsv` application would be useful to many.

So I took this little library from Go’s Russ Cox:

> **[rsc/pdf](https://github.com/rsc/pdf)**
>
> PDF reader. Contribute to rsc/pdf development by creating an account on GitHub.

And this little test case file:

> **[kto.pdf](https://bepsays.com/tmp/kto.pdf)**
>
> 97.37 KB

And I manage to extract the plain text outside the tables (and other plain text PDFs), but the rest is jibberish. There are obvious parts of the PDF format/encodings etc. that I do not understand – and will have to read up on. But I throw it out here to see if anyone have any relevant experience and hints in this area?

- I have looked at [http://tabula.technology/](http://tabula.technology/) which seems to do what I want, but it is a monster web app to do a small simple task.

---

<div class="post-metadata">

**Author:** ![dplesca](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.gohugo.io/dplesca/32/278_2.png) [@dplesca](https://discourse.gohugo.io/u/dplesca)\
**Post date:** [July 6, 2015, 8:03am UTC](https://discourse.gohugo.io/t/way-off-topic-extract-table-data-from-pdf/1400/2 "2015-07-06T08:03:51Z")

</div>

Just a shot in the dark, but have you thought of maybe using [pdf.js](https://mozilla.github.io/pdf.js/) to render the pdfs in html and maybe try to parse them as you’d do an html file?

---

<div class="post-metadata">

**Author:** ![lotrfan](https://avatars.discourse-cdn.com/v4/letter/l/76d3ee/32.png) [@lotrfan](https://discourse.gohugo.io/u/lotrfan)\
**Post date:** [July 7, 2015, 1:16am UTC](https://discourse.gohugo.io/t/way-off-topic-extract-table-data-from-pdf/1400/3 "2015-07-07T01:16:40Z")

</div>

You might try [`pdftotext`](http://linux.die.net/man/1/pdftotext), bundled with the [Poppler PDF library](http://poppler.freedesktop.org/)

I’ve found that the `-layout` option can give decent results, which might be machine-parseable:

```auto
pdftotext -layout input.pdf output.txt

```

If you want to write something in pure Go (or any other languange), you’ll probably have to learn a fair bit of the PDF spec. Some random links that may or may not be helpful:

- [http://www.planetpdf.com/developer/article.asp?ContentID=navigating\_the\_internal\_struct](http://www.planetpdf.com/developer/article.asp?ContentID=navigating_the_internal_struct)
- [http://stackoverflow.com/questions/88582/structure-of-a-pdf-file](http://stackoverflow.com/questions/88582/structure-of-a-pdf-file)
- [http://superuser.com/questions/256997/browse-internal-pdf-structure](http://superuser.com/questions/256997/browse-internal-pdf-structure)
- and the spec itself: [http://www.adobe.com/content/dam/Adobe/en/devnet/acrobat/pdfs/pdf\_reference\_1-7.pdf](http://www.adobe.com/content/dam/Adobe/en/devnet/acrobat/pdfs/pdf_reference_1-7.pdf). In my experience with the spec, it’s pretty annoying to navigate unless you’re already partly (mostly) familiar with the structure of PDFs :(. (Ironically, it’s a PDF document.)

It’ll also be helpful to have a graphical viewer of the structure. I used [iText RUPS](http://sourceforge.net/projects/itextrups/) when I dealt with PDFs a year or two ago. There are some others mentioned on the thrid link above.

---

<div class="post-metadata">

**Author:** ![bep](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.gohugo.io/bep/32/3332_2.png) [@bep](https://discourse.gohugo.io/u/bep)\
**Post date:** [July 7, 2015, 6:00am UTC](https://discourse.gohugo.io/t/way-off-topic-extract-table-data-from-pdf/1400/4 "2015-07-07T06:00:13Z")

</div>

Thanks @lotrfan – that info will be very useful. I have tried `pdftotext` with both -layout and -html, and it looses too much of the tabular info to be useful in this case.

---

<div class="post-metadata">

**Author:** ![Weston\_McNamee](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.gohugo.io/weston_mcnamee/32/540_2.png) [@Weston\_McNamee](https://discourse.gohugo.io/u/Weston_McNamee)\
**Post date:** [July 17, 2015, 5:54am UTC](https://discourse.gohugo.io/t/way-off-topic-extract-table-data-from-pdf/1400/5 "2015-07-17T05:54:50Z")

</div>

@bep - Simple calling out that this thread is way off topic and that you are abusing the forum doesn’t make it right to do so. I would **_highly_** recommend using [StackOverflow](https://stackoverflow.com) for this type of thing. There are many more people there that would be able to help.

In the spirit of helping out: here’s an article for a PowerShell cmdlet that outputs the contents of a PDF to plain-text. From there, you can continue to use PowerShell to sanitize and convert to CSV, or whatever else you want, as you now have plain-text to work with.  
[http://www.beefycode.com/post/convertfrom-pdf-cmdlet.aspx](http://www.beefycode.com/post/convertfrom-pdf-cmdlet.aspx)