Google Code-In 2012/OCR document reformatting - Revision history

Cjl at 15:08, 23 November 2012

2012-11-23T15:08:23Z

← Older revision		Revision as of 11:08, 23 November 2012
Line 17:		Line 17:
	3) Save file as either Pagennn.xls or Pagennn.ods. Both formats are acceptable.		3) Save file as either Pagennn.xls or Pagennn.ods. Both formats are acceptable.

	4) Visually review (copyedit) each of the PDF file and spreadsheet file pairs. Try to correct any errors introduced by the OCR process (for example a a "b" is sometimes OCR'ed as an "h" and vice-versa. Pay special attention to characters with accents or other diacritical marks.		4) Visually review (copyedit) each of the PDF file and spreadsheet file pairs. Try to correct any errors introduced by the OCR process (for example a a "b" is sometimes OCR'ed as an "h" and vice-versa.fo Pay special attention to characters with accents or other diacritical marks.

	5) Repeat process from step 3 with next 9 Page files in the zip.		5) Repeat process from step 3 with next 9 Page files in the zip.

	6) Submit the spreadsheet files to the task mentor for review/~~sing~~-off.		6) Submit the spreadsheet files to the task mentor for review/sign-off.

Cjl at 15:07, 23 November 2012

2012-11-23T15:07:41Z

← Older revision		Revision as of 11:07, 23 November 2012
Line 17:		Line 17:
	3) Save file as either Pagennn.xls or Pagennn.ods. Both formats are acceptable.		3) Save file as either Pagennn.xls or Pagennn.ods. Both formats are acceptable.

	4) Visually review (copyedit) each of the PDF file and spreadsheet file pairs. Try to correct any errors introduced by the OCR process (for example a a "b" is sometimes OCR'ed as an "h" and vice-versa. Pay special attention to characters with accents of other diacritical marks.		4) Visually review (copyedit) each of the PDF file and spreadsheet file pairs. Try to correct any errors introduced by the OCR process (for example a a "b" is sometimes OCR'ed as an "h" and vice-versa. Pay special attention to characters with accents or other diacritical marks.

	5) Repeat process from step 3 with next 9 Page files in the zip.		5) Repeat process from step 3 with next 9 Page files in the zip.

Cjl at 15:07, 23 November 2012

2012-11-23T15:07:04Z

← Older revision		Revision as of 11:07, 23 November 2012
Line 1:		Line 1:
	The goal is to transform a 456 page image-PDF file of an Asháninka-Spanish and Spanish-Asháninka dictionary into OCR'ed digital text. That digitized text is the starting point for any number of efforts. A batch processing fo the PDFs into text files has already been performed.		The goal is to transform a 456 page image-PDF file of an Asháninka-Spanish and Spanish-Asháninka dictionary into OCR'ed digital text. That digitized text is the starting point for any number of efforts. A batch processing of the PDFs into text files has already been performed.

	The next critical step is to take the imperfectly formatted OCR output and restructure it into something ~~tha~~ corresponds to the two column format of the original PDF. The format of choice for this is a spreadsheet containing each entry in side by side columns.

			The next critical step is to take the imperfectly formatted OCR output and restructure it into something that corresponds to the two column format of the original PDF. The format of choice for this is a spreadsheet containing each entry in side by side columns.

	Here is the full image-PDF [[File:Dt19.pdf]], which has been broken down to individual pages and grouped in batches below containing both the original PDF page and th eOCR'ed text.		Here is the full image-PDF [[File:Dt19.pdf]], which has been broken down to individual pages and grouped in batches below containing both the original PDF page and th eOCR'ed text.

	Download the zips ~~blow~~ (each contains 10 PDF image files and ten text files).		Download the zips below (each contains 10 PDF image files and ten text files).

	Recommended approach:		Recommended approach:

Cjl at 14:43, 23 November 2012

2012-11-23T14:43:15Z

← Older revision		Revision as of 10:43, 23 November 2012
Line 15:		Line 15:
	3) Save file as either Pagennn.xls or Pagennn.ods. Both formats are acceptable.		3) Save file as either Pagennn.xls or Pagennn.ods. Both formats are acceptable.

	3) ~~Repeat~~ process ~~from step 3~~ with ~~next 9 Page files in the zip~~.		4) Visually review (copyedit) each of the PDF file and spreadsheet file pairs. Try to correct any errors introduced by the OCR process (for example a a "b" is sometimes OCR'ed as an "h" and vice-versa. Pay special attention to characters with accents of other diacritical marks.

	4) ~~Visually review (copyedit~~) ~~each of~~ the ~~PDF file and~~ spreadsheet ~~file pairs. Try~~ to ~~correct any errors introduced by~~ the ~~OCR process (~~for ~~example a a "b" is sometimes OCR'ed as an "h" and vice~~-~~versa. Pay special attention to characters with accents of other diacritical marks~~.		5) Repeat process from step 3 with next 9 Page files in the zip.

			6) Submit the spreadsheet files to the task mentor for review/sing-off.



	* [[File:Batch-cni-dict-01.zip]]		* [[File:Batch-cni-dict-01.zip]] (Completed example)

	* [[File:Batch-cni-dict-02.zip]]		* [[File:Batch-cni-dict-02.zip]]

Cjl: Created page with "The goal is to transform a 456 page image-PDF file of an Asháninka-Spanish and Spanish-Asháninka dictionary into OCR'ed digital text. That digitized text is the starting po..."

2012-11-23T14:25:11Z

Created page with "The goal is to transform a 456 page image-PDF file of an Asháninka-Spanish and Spanish-Asháninka dictionary into OCR'ed digital text. That digitized text is the starting po..."

New page

The goal is to transform a 456 page image-PDF file of an Asháninka-Spanish and Spanish-Asháninka dictionary into OCR'ed digital text. That digitized text is the starting point for any number of efforts. A batch processing fo the PDFs into text files has already been performed.

The next critical step is to take the imperfectly formatted OCR output and restructure it into something tha corresponds to the two column format of the original PDF. The format of choice for this is a spreadsheet containing each entry in side by side columns.

Here is the full image-PDF [[File:Dt19.pdf]], which has been broken down to individual pages and grouped in batches below containing both the original PDF page and th eOCR'ed text.

Download the zips blow (each contains 10 PDF image files and ten text files).

Recommended approach:

1) Copy the text from the text file (Pagennn.txt) and paste it into two side-by-side columns in an MSExcel or OpenOffice .ods spreadsheet (Pagennn.xls or Pagennn.ods)

2) Carefully delete certain entries in the two columns so that the result mirrors the aligned organization of the PDF file columns. Please note that line wraps in the PDF should be ignored and all of an entry should be placed into a single cell. In addition, the header and footer information present on the PDF image should be excluded from the spreadsheet. It is irrelevant whether the entries are separated by a blank row or not as long as the entry in column A corresponds to the entry in column B.

3) Save file as either Pagennn.xls or Pagennn.ods. Both formats are acceptable.

3) Repeat process from step 3 with next 9 Page files in the zip.

4) Visually review (copyedit) each of the PDF file and spreadsheet file pairs. Try to correct any errors introduced by the OCR process (for example a a "b" is sometimes OCR'ed as an "h" and vice-versa. Pay special attention to characters with accents of other diacritical marks.

* [[File:Batch-cni-dict-01.zip]]

* [[File:Batch-cni-dict-02.zip]]

* [[File:Batch-cni-dict-03.zip]]

* [[File:Batch-cni-dict-04.zip]]

* [[File:Batch-cni-dict-05.zip]]

* [[File:Batch-cni-dict-06.zip]]

* [[File:Batch-cni-dict-07.zip]]

* [[File:Batch-cni-dict-08.zip]]

* [[File:Batch-cni-dict-09.zip]]

* [[File:Batch-cni-dict-10.zip]]

* [[File:Batch-cni-dict-11.zip]]

* [[File:Batch-cni-dict-12.zip]]

* [[File:Batch-cni-dict-13.zip]]

* [[File:Batch-cni-dict-14.zip]]

* [[File:Batch-cni-dict-15.zip]]

* [[File:Batch-cni-dict-16.zip]]

* [[File:Batch-cni-dict-17.zip]]

* [[File:Batch-cni-dict-18.zip]]

* [[File:Batch-cni-dict-19.zip]]

* [[File:Batch-cni-dict-20.zip]]

* [[File:Batch-cni-dict-21.zip]]

* [[File:Batch-cni-dict-22.zip]]

* [[File:Batch-cni-dict-23.zip]]

* [[File:Batch-cni-dict-24.zip]]

* [[File:Batch-cni-dict-25.zip]]

* [[File:Batch-cni-dict-26.zip]]

* [[File:Batch-cni-dict-27.zip]]

* [[File:Batch-cni-dict-28.zip]]

* [[File:Batch-cni-dict-29.zip]]

* [[File:Batch-cni-dict-30.zip]]

* [[File:Batch-cni-dict-31.zip]]

* [[File:Batch-cni-dict-32.zip]]

* [[File:Batch-cni-dict-33.zip]]

* [[File:Batch-cni-dict-34.zip]]

* [[File:Batch-cni-dict-35.zip]]

* [[File:Batch-cni-dict-36.zip]]

* [[File:Batch-cni-dict-37.zip]]

* [[File:Batch-cni-dict-38.zip]]

* [[File:Batch-cni-dict-39.zip]]

* [[File:Batch-cni-dict-40.zip]]

* [[File:Batch-cni-dict-41.zip]]

* [[File:Batch-cni-dict-42.zip]]

* [[File:Batch-cni-dict-43.zip]]

* [[File:Batch-cni-dict-44.zip]]

* [[File:Batch-cni-dict-45.zip]]

* [[File:Batch-cni-dict-46.zip]]

[[Category: GCI2012]]