GreenFIE

GreenFIE GreenFIE - Start

Added : 2017-04-12 Views :28K

Download Presentation

GreenFIE




Download Presentation - The PPT/PDF document "GreenFIE" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.



Presentations text content in GreenFIE

Slide1

GreenFIE: A Green Form-Based Information-Extraction System for Historical Documents

(Self-improving Extraction Systems)

Tae Woo KimDavid W. EmbleyStephen W. Liddle

Slide2

A Green Information Extraction System

“Green” systems improve with useGreenFIEGreen Form-based Information ExtractionGenerates extraction rules by watching users workCOMET

2

Slide3

DEMO

3

Slide4

DEMO

4

Slide5

DEMO

5

Slide6

DEMO

6

Slide7

DEMO

7

Slide8

DEMO

8

Slide9

DEMO

9

Slide10

Regex Extraction Rules

\n([A-Z]{1}[a-z]{3}),\s(\d{1}\s[A-Z]{1}[a-z]{2}\.\s\d{4})\.

Register of Marriages and Baptisms. 31Jean, 6 Mar. 1698.Ann, 25 Oct. 1701.Cordoner, James, par., and Florence Landiss, par. of Paisleym. 13 June 1679…Elizabeth, 2 Sept. 1692.

10

Slide11

Regex Extraction Rules

\n([A-Z]{1}[a-z]{3}),\s(\d{1}\s[A-Z]{1}[a-z]{2}\.\s\d{4})\.\n([A-Z]{1}[a-z]{1,5}),\s(\d{0,2}\s[A-Z]{1}[a-z]{1,3}\.\s\d{2,6})\.

Register of Marriages and Baptisms. 31Jean, 6 Mar. 1698.Ann, 25 Oct. 1701.Cordoner, James, par., and Florence Landiss, par. of Paisleym. 13 June 1679…Elizabeth, 2 Sept. 1692.

11

Slide12

Regex Extraction Rules

\n([A-Z]{1}[a-z]{3}),\s(\d{1}\s[A-Z]{1}[a-z]{2}\.\s\d{4})\.\n([A-Z]{1}[a-z]{1,5}),\s(\d{0,2}\s[A-Z]{1}[a-z]{1,3}\.\s\d{2,6})\.\n([A-Z]{1}[a-z]{1,10}),\s(\d{1,2}\s[JFMASOND][a-z]{1,5}\.?\s\d{4})\.

Register of Marriages and Baptisms. 31Jean, 6 Mar. 1698.Ann, 25 Oct. 1701.Cordoner, James, par., and Florence Landiss, par. of Paisleym. 13 June 1679…Elizabeth, 2 Sept. 1692.

Name

ChristeningDate

12

Slide13

Regex Extraction Rules

\n([A-Z]{1}[a-z]{3}),\s(\d{1}\s[A-Z]{1}[a-z]{2}\.\s\d{4})\.\n([A-Z]{1}[a-z]{1,5}),\s(\d{0,2}\s[A-Z]{1}[a-z]{1,3}\.\s\d{2,6})\.\n([A-Z]{1}[a-z]{1,10}),\s(\d{1,2}\s[JFMASOND][a-z]{1,5}\.?\s\d{4})\.

…Margaret, 3 Feb. 1751.Robert, born 29 July 1753.John, 25 Jan. 1756.Craig, James, and Mary M'Dowall, in Monkland p. 8 Dec. 1749Janet, born 12 July 1751.…

13

Slide14

Regex Extraction Rules

\n([A-Z]{1}[a-z]{3}),\s(\d{1}\s[A-Z]{1}[a-z]{2}\.\s\d{4})\.\n([A-Z]{1}[a-z]{1,5}),\s(\d{0,2}\s[A-Z]{1}[a-z]{1,3}\.\s\d{2,6})\.\n([A-Z]{1}[a-z]{1,10}),\s(\d{1,2}\s[JFMASOND][a-z]{1,5}\.?\s\d{4})\.\n([A-Z]{1}[a-z]{1,10}),\sborn\s(\d{1,2}\s[JFMASOND][a-z]{1,5}\.?\s\d{4})\.

…Margaret, 3 Feb. 1751.Robert, born 29 July 1753.John, 25 Jan. 1756.Craig, James, and Mary M'Dowall, in Monkland p. 8 Dec. 1749Janet, born 12 July 1751.…

Name

BirthDate

14

Slide15

Results: Naïve Generalization

15

Slide16

Results: Type-Specific Generalization

Pg. 31

Pg. 32

16

Type-Dependent

Slide17

Couple Form

17

Slide18

Results: Couple Form

18

Slide19

Couple Patterns

Cordoner, James, par., and Florence Landiss, par. of Paisley m. 13 June 1679Cordoner, John, and Catherine Adam m. 21 April 1656Cordonnar, John, par., and Jean Craufurd, par. of Beith m. Beith, 16 June 1659Cordoner, John, and Issobell Speir, in Walkmilne of Johnstoun m. 16 July 1673Cordoner, John, and Margaret Cochran, in Nether WalkmilneCordner, John, and Jonet Cochran, in Walkinshaw, 1688 in Walkmiln of Johnstoun m. 22 April 1680Cordonar, William, and jean Cochran m. 7 Feb. 1651Cordoner, William, and Issobell Young, in AuchnamesCordoner, William, and 1 liza Orr, in Netherwalkmilne of JohnstounCorss, John, and Jean PatisonCouper, James, and Issobell Load m. 30 Nov. 1682Couper, James, par. of Erskine, and Mary Black, par. 30 Mar. 1744Coupar, William, in Kilbarchan, and Janet Caldwell p. 29 Dec. 1768Cowan, Daniel, in town par. of Paisley, and Margaret DougalCraig, James, par. of Kilbryde, and Jonet Cordonar, par. m. 28 June 1658Craig, James, Moreland in Forehouse, and Jonet Reid m. Lochwinnoch, 18 Jan. 1693

19

Slide20

Couple Patterns

Cordoner, James, par., and Florence Landiss, par. of Paisley m. 13 June 1679Cordoner, John, and Catherine Adam m. 21 April 1656Cordonnar, John, par., and Jean Craufurd, par. of Beith m. Beith, 16 June 1659Cordoner, John, and Issobell Speir, in Walkmilne of Johnstoun m. 16 July 1673Cordoner, John, and Margaret Cochran, in Nether WalkmilneCordner, John, and Jonet Cochran, in Walkinshaw, 1688 in Walkmiln of Johnstoun m. 22 April 1680Cordonar, William, and jean Cochran m. 7 Feb. 1651Cordoner, William, and Issobell Young, in AuchnamesCordoner, William, and 1 liza Orr, in Netherwalkmilne of JohnstounCorss, John, and Jean PatisonCouper, James, and Issobell Load m. 30 Nov. 1682Couper, James, par. of Erskine, and Mary Black, par. 30 Mar. 1744Coupar, William, in Kilbarchan, and Janet Caldwell p. 29 Dec. 1768Cowan, Daniel, in town par. of Paisley, and Margaret DougalCraig, James, par. of Kilbryde, and Jonet Cordonar, par. m. 28 June 1658Craig, James, Moreland in Forehouse, and Jonet Reid m. Lochwinnoch, 18 Jan. 1693

20

Slide21

Couple Patterns

Cordoner, James, par., and Florence Landiss, par. of Paisley m. 13 June 1679Cordoner, John, and Catherine Adam m. 21 April 1656Cordonnar, John, par., and Jean Craufurd, par. of Beith m. Beith, 16 June 1659Cordoner, John, and Issobell Speir, in Walkmilne of Johnstoun m. 16 July 1673Cordoner, John, and Margaret Cochran, in Nether WalkmilneCordner, John, and Jonet Cochran, in Walkinshaw, 1688 in Walkmiln of Johnstoun m. 22 April 1680Cordonar, William, and jean Cochran m. 7 Feb. 1651Cordoner, William, and Issobell Young, in AuchnamesCordoner, William, and 1 liza Orr, in Netherwalkmilne of JohnstounCorss, John, and Jean PatisonCouper, James, and Issobell Load m. 30 Nov. 1682Couper, James, par. of Erskine, and Mary Black, par. 30 Mar. 1744Coupar, William, in Kilbarchan, and Janet Caldwell p. 29 Dec. 1768Cowan, Daniel, in town par. of Paisley, and Margaret DougalCraig, James, par. of Kilbryde, and Jonet Cordonar, par. m. 28 June 1658Craig, James, Moreland in Forehouse, and Jonet Reid m. Lochwinnoch, 18 Jan. 1693

21

Slide22

Results: Couple Form

Precision: not necessarily 100% (over-generalization)

22

Slide23

Conclusions

GreenFIE is “green”!Extraction-rule generationDocument pattern consistencyNumber and variability of patternsGo green!!

BYU

D

ata Extraction Research Group

www.deg.byu.edu

23


About DocSlides
DocSlides allows users to easily upload and share presentations, PDF documents, and images.Share your documents with the world , watch,share and upload any time you want. How can you benefit from using DocSlides? DocSlides consists documents from individuals and organizations on topics ranging from technology and business to travel, health, and education. Find and search for what interests you, and learn from people and more. You can also download DocSlides to read or reference later.
Youtube