init

README.md

-# SequenceLabelingTool
+中文自然语言处理 (NLP) 标注工具，与 有志之士 共同 促进 中文 自然语言处理 的 发展。
 
-数据序列标注工具
\ No newline at end of file
+## 一、关于
+- 这个项目最原始的代码是从 YEDA fork 过来的，访问 [YEDA](https://github.com/jiesutd/YEDDA) 项目，了解更多信息
+- 这 **不是** 一个 web 应用，而是一个基于 Python tkinter 的轻量级桌面端应用
+- 本项目仅支持 Python 3.x，**不考虑** 兼容 Python 2.x
+- 本项目目前仅支持实体标注，未来将加入更多功能
+
+## 二、使用指南
+
+### 安装 Python 3.x
+
+### 下载本项目
+
+`git clone https://github.com/SophonPlus/ChineseAnnotator.git` 或直接下载 [压缩包](https://github.com/SophonPlus/ChineseAnnotator/archive/master.zip) 并解压
+
+### 开始标注
+![alt text](https://github.com/SophonPlus/ChineseAnnotator/blob/master/EnglishInterface.png "标注英文")
+![alt text](https://github.com/SophonPlus/ChineseAnnotator/blob/master/ChineseInterface.png "标注中文")
+
+- 执行 `python YEDDA_Annotator.py`，启动标注程序
+- 在标注程序界面的右侧，设置快捷键，如 `a: Action; b: Loc; c: Cont`
+- 点击 `ReMap` 按钮，保存快捷键设置
+- 点击 `Open` 按钮，选择文件 (后缀必须为 .txt 或 .ann)
+- 选中文本，然后使用设置好的快捷键进行标注，标注格式形如 `[@the text span＃Location*]`
+- 通过 `RMOn` 和 `RMOff` 按钮，可以开启或关闭智能推荐
+- 智能推荐会根据已经手动标注的数据，自动标注未标注的数据。其格式为 `[$the text span＃Location*]`，并用绿色展示出来（注意：手动标注以 `[@` 打头，而推荐标注则以 `[$` 打头）
+- 标注结果与原始文件保存在同一个目录中，文件名为 ***"原文件名 + .ann"***
+
+### 管理标注工作
+![alt text](https://github.com/SophonPlus/ChineseAnnotator/blob/master/AdminInterface.png "管理员界面")
+
+- 执行 `python YEDDA_Admin.py`，启动管理程序
+- 点击 `多人标注分析`，然后选择多个 `*.ann` 文件，会给出不同标注结果的 F 值矩阵
+ ![alt text](https://github.com/SophonPlus/ChineseAnnotator/blob/master/resultMatrix.png "结果矩阵")
+- 点击 `配对比较`，然后选择 2 个 `*.ann` 文件，会生成相应的对比报告 (报告为 `.tex` 格式，可以进一步编译为 `.pdf` 文件)。示例 pdf 报告如下：
+
+![alt text](https://github.com/SophonPlus/ChineseAnnotator/blob/master/detailReport.png "详细报告")
+
+### 其他（重要）功能
+1. 按 `ctrl + z` 撤销最近 1 次的修改
+2. 选择已经标注的实体，或将光标置于已标注的实体范围内，按其他实体类别的快捷键 (如 `x`) 更新实体类别 (与 `x` 对应的实体)，按 `q`，删除实体标注
+3. 选择已标注的文本，如 `[@美国＃Location*]`, 再按 `q`, 删除实体标注，即恢复到未标注的状态 (如"美国")
+4. 确认/删除推荐标注的实体：将光标置于推荐标注的实体范围内，按 `y` (确认)，按 `q` (退出)
+5. 点击 `export` 按钮，会将 ***".ann"*** 文件导出为同名的 ***".anns"*** 文件（存放在同一目录下）。导出文件为序列标注的格式。
+  - 源代码中，参数 `self.seged` 用于控制导出的行为。如果句子由空格间隔的单词构成（英文或已分词的中文），则该值应设置为 `True`，否则应设置为 `False`（如未分词的中文）
+  - 另一个参数 `self.tagScheme` 控制导出的格式，***".anns"*** 文件将使用 `BMES` 格式，如何该值为 `"BMES"`，否则导出格式为 `"BIO"`
+
+## 三、FAQ
+1. 为什么是桌面端应用？
+
+  - 理由一：我们调研了其他的开源标注工具，包括 [brat](https://github.com/nlplab/brat) 在内的大部分工具，都有点太复杂了，难以扩展
+
+  - 理由二：开发/维护 Web 应用，涉及到前/后端的工作，需要额外的知识和技能。我们相信在 NLP 领域，Python 的普及程度要远超 Web 开发，将项目限定在 Python 之内，能够让更多感兴趣的 NLP 业内人士参与其中，共同促进中文自然语言处理的发展
+
+2. 你们知道一个叫 [Chinese-Annotator]( https://github.com/crownpku/Chinese-Annotator) 的项目吗？
+
+  - 当然！我们在一开始调研中文自然语言处理标注工具的时候，就注意到这个项目了。他们在 [Wiki](https://github.com/crownpku/Chinese-Annotator/wiki/Annotator-Examples) 中，详细总结了几款有代表性的标注工具，极大地帮助了我们调研工作的开展。
+
+  - 但是，遗憾的是，截止目前 (2018-06-22) 为止，这个工具仍然处于开发阶段，尚不可用。这让我们萌生了开始本项目的想法。我们希望一开始就提供可以使用的工具，然后再在使用过程中快速地迭代完善。
+
+3. 为什么选择从 fork [YEDA](https://github.com/jiesutd/YEDDA) 开始？
+  - 我们仔细调研了大量的标注工具，而 YEDA 可能是其中功能最简陋、代码最精简的项目了。但这恰恰是我们需要的，其他项目都太复杂，难以着手改造。
+
+## 四、未来计划
+1. 采用 brat 的文件格式
+2. 采用 anafora 的可视化方式
+3. 加入规则标注功能
+4. 加入文本分类标注功能
+5. 加入主动学习功能
+6. ……
+
+## 五、参考
+| 项目 | star | fork | 最后更新 | 值得借鉴之处 |
+| :---- | --- | ----- | ------- | :----------- |
+| [brat](https://github.com/nlplab/brat) | 575 | 212 | 2017-11-30 | 文件格式 |
+| [IEPY](https://github.com/machinalis/iepy) | 675 | 152 | 2016-10-14 | 主动学习、规则标注 |
+| [anafora](https://github.com/weitechen/anafora) | 82 | 25 | 2018-05-12 | 可视化方式 |
+| [Chinese-Annotator](https://github.com/crownpku/Chinese-Annotator) | 384 | 98 | 2018-03-06 | 调研/设计 文档 |
+| [Prodigy](https://prodi.gy/) | - | - | - | 交互方式 |

YEDDA_Admin.py

+# -*- coding: utf-8 -*-
+# @Author: Jie Yang from SUTD
+# @Date:   2016-Jan-06 17:11:59
+# @Last Modified by:   Jie Yang,     Contact: jieynlp@gmail.com
+# @Last Modified time: 2017-09-24 21:47:14
+#!/usr/bin/env python
+# coding=utf-8
+
+from tkinter import *
+from tkinter.ttk import * # Frame, Button, Label, Style, Scrollbar
+from tkinter import filedialog as tkFileDialog
+from tkinter import font as tkFont
+from tkinter import messagebox as tkMessageBox
+
+import re
+from collections import deque
+import pickle
+import os.path
+import platform
+
+from utils.recommend import *
+from utils.metric4ann import *
+from utils.compareAnn import *
+
+
+class Example(Frame):
+    def __init__(self, parent):
+        Frame.__init__(self, parent)
+        self.Version = u"YEDDA-V1.0 管理员"
+        self.OS = platform.system().lower()
+        self.parent = parent
+        self.fileName = ""
+        # 初始化 GUI 显示参数        
+        self.textColumn = 3
+        self.initUI()        
+        
+    def initUI(self):
+        ## 初始化 UI	
+        self.parent.title(self.Version)
+        self.pack(fill=BOTH, expand=True)
+        
+        for idx in range(0,self.textColumn):
+            if idx == 1:
+                self.columnconfigure(idx, weight =10)
+            else:
+                self.columnconfigure(idx, weight =1)
+        # for idx in range(0,2):
+        #     self.rowconfigure(idx, weight =1)
+        the_font=('TkDefaultFont', 18, )
+        style0 = Style()
+        style0.configure(".", font=the_font, )
+
+        width_size = 30
+
+        abtn = Button(self, text=u"多标注分析", command=self.multiFiles, width = width_size)
+        abtn.grid(row=0, column=1)
+
+        recButton = Button(self, text=u"配对比较", command=self.compareTwoFiles,  width = width_size)
+        recButton.grid(row=1, column=1)
+
+        cbtn = Button(self, text=u"退出", command=self.quit, width = width_size)
+        cbtn.grid(row=2, column=1)
+
+    def ChildWindow(self, input_list, result_matrix):
+        file_list = []
+        for dir_name in input_list:
+            if ".ann" in dir_name:
+                dir_name = dir_name[:-4]
+            if "/" in dir_name:
+                file_list.append(dir_name.split('/')[-1])
+            else:
+                file_list.append(dir_name)
+
+        # 创建菜单
+        self.popup = Menu(self.parent, tearoff=0)
+        self.popup.add_command(label="Next", command=self.selection)
+        self.popup.add_separator()
+
+        def do_popup(event):
+            # 显示弹出菜单
+            try:
+                self.popup.selection = self.tree.set(self.tree.identify_row(event.y))
+                self.popup.post(event.x_root, event.y_root)
+            finally:
+                # make sure to release the grab (Tk 8.0a1 only)
+                self.popup.grab_release()
+
+        # 创建树状视图
+        win2 = Toplevel(self.parent)
+        new_element_header=file_list
+        treeScroll = Scrollbar(win2)
+        treeScroll.pack(side=RIGHT, fill=Y)
+        title_string = "F:Entity/Chunk"
+        self.tree = Treeview(win2, columns=[title_string]+file_list, show="headings")
+
+        self.tree.heading(title_string, text=title_string, anchor=CENTER)
+        self.tree.column(title_string, stretch=YES, minwidth=50, width=100, anchor=CENTER)
+        for each_file in file_list:
+            self.tree.heading(each_file, text=each_file, anchor=CENTER)
+            self.tree.column(each_file, stretch=YES, minwidth=50, width=100, anchor=CENTER)
+        for idx in range(len(file_list)):
+            self.tree.insert("" ,  'end', text=file_list[idx], values=[file_list[idx]]+result_matrix[idx],  tags = ('chart',))
+        the_font=('TkDefaultFont', 18, )
+        self.tree.tag_configure('chart', font=the_font)
+        style = Style()
+        style.configure(".", font=the_font, )
+        style.configure("Treeview", )
+        style.configure("Treeview.Heading",font=the_font, ) #<----
+        self.tree.pack(side=TOP, fill=BOTH)
+        # self.tree.grid()
+
+        self.tree.bind("<Button-3>", do_popup)
+
+        win2.minsize(30,30)
+		
+    def selection(self):
+        print(self.popup.selection)
+
+    def multiFiles(self):
+        ftypes = [('ann files', '.ann')]
+        filez = tkFileDialog.askopenfilenames(parent=self.parent, filetypes = ftypes, title='Choose a file')
+        if len(filez) < 2:
+            tkMessageBox.showinfo(u"监视错误", u"不足 2 个文件！\n\n请至少选择 2 个文件！")
+        else:
+            result_matrix =  generate_report_from_list(filez)
+            self.ChildWindow(filez, result_matrix)
+
+    def compareTwoFiles(self):
+        ftypes = [('ann files', '.ann')]
+        filez = tkFileDialog.askopenfilenames(parent=self.parent, filetypes = ftypes, title=u'选择文件')
+        if len(filez) != 2:
+            tkMessageBox.showinfo(u"比较错误", u"请选择 2 个文件！")
+        else:
+            f = tkFileDialog.asksaveasfile(mode='w', defaultextension=".tex")
+            write_result = compareBoundary(filez[0],filez[1],f)
+            if write_result:
+                tkMessageBox.showinfo(u"生成 Latex", u"成功生成 Latex 文件！\n\保存到 "+ f.name)
+                # import os
+                # os.system("pdflatex "+ f.name)
+            else:
+                tkMessageBox.showinfo(u"Latex 错误", u"生成 Latex 错误：2 个文件的句子数不相等！")
+            f.close()
+
+
+def main():
+    print(u"启动 YEDDA 管理员程序！")
+    print((u"操作系统：%s")%(platform.system()))
+    root = Tk()
+    root.geometry("400x100")
+    app = Example(root)
+    
+    root.mainloop()
+	
+
+if __name__ == '__main__':
+    main()
\ No newline at end of file

demotext/ChineseDemo.txt

+我觉得你们啊，你们……我感觉你们新闻界还要学习一个，你们非常熟悉西方的这一套value。
+你们毕竟还tooyoung（太年轻），明白这意思吧。我告诉你们我是身经百战了，见得多了！啊，西方的哪一个国家我没去过？媒体他们——你……你们要知道，美国的华莱士，那比你们不知道高到哪里去了。啊，我跟他谈笑风生！所以说媒体啊，要……还是要提高自己的知识水平！懂我的意思——识得唔识得啊？（懂不懂啊？）
+我的这个经历就是到了上海，到了89年的年初的时候，我在想我估计是快要离休了，我想我应该去当教授。于是我就给朱物华校长、张钟俊院长，给他们写了一个报告。他们说欢迎你来，不过，这个ApplyforProfessor（申请当教授），你要去做一个报告。我就做了一个能源与发展趋势的主要的节能措施，这个报告经过好几百个教授一致通过。
+那么上海交大教授当了以后我就做第二个报告，就是微电子工业的发展。这两个报告做了以后不久，过后，1989年的5月31号北京就把我调到北京去了。现在这个报告做了快20年了，所以呢我就去年呢在我们交大的学报，我发表了两篇文章，就是呼应这个89年的报告的。特别是昨天晚上，他又把我这个第二篇报告，还有我这十几年包括在电子工业部、上海市所做的有关于信息产业化的文章，总共我听他们讲是27篇……我也没有什么别的东西送给你们，我们拿来以后我叫钱秘书啊，就把这两个学报，两个学报的英文本──因为他们这里洋文好的人多得很哪──英文本，还有前面出过两本书，再加上昨天晚上出的这本书，送给郭伟华同志，给你送过来，那么给你们作为一个纪念。
+人呐就都不知道，自己就不可以预料。一个人的命运啊，当然要靠自我奋斗，但是也要考虑到历史的行程。我绝对不知道，我作为一个上海市委书记怎么把我选到北京去了，所以邓小平同志跟我讲话，说“中央都决定啦，你来当总书记”，我说另请高明吧。
+我实在我也不是谦虚，我一个上海市委书记怎么到北京来了呢？但是呢，小平同志讲“大家已经研究决定了”，所以后来我就念了两首诗（原话如此），叫“苟利国家生死以，岂因祸福避趋之”，那么所以我就到了北京。到了北京我干了这十几年也没有什么别的，大概三件事：
+一个，确立了社会主义市场经济；
+第二个，把邓小平的理论列入了党章；
+第三个，就是我们知道的“三个代表”。
+如果说还有一点什么成绩就是军队一律不得经商！这个对军队的命运有很大的关系。
+因为我后来又干了一年零八个月，等于我在部队干了15年军委主席。还有九八年的抗洪也是很大的。但这些都是次要的，我主要的我就是三件事情，很惭愧，就做了一点微小的工作，谢谢大家。
\ No newline at end of file

demotext/ChineseDemo.txt.ann

+我 觉得 [@你们#Person*] 啊 ， [@你们#Person*] …… 我 感觉 [@你们#Person*] 新闻界 还 要 学习 一个 ， [@你们#Person*] 非常 熟悉 西方的 这 一套 value 。 [@你们#Person*] 毕竟 还 too young （ 太 年轻 ） ， 明白 这 意思 吧 。 我 告诉 [@你们#Person*] 我 是 身经百战 了 ， 见得 多 了 ！ 啊 ， 西方 的 哪 一个 国家 我 没 去过 ？ 媒体 他们 —— 你 …… [@你们#Person*] 要 知道 ， [@美国#Location*] 的 [@华莱士#Person*] ， 那 比 [@你们#Person*] 不知道 高 到 哪里 去 了 。 啊 ， 我 跟 他 谈笑风生 ！ 所以 说 媒体 啊 ， 要 …… 还是 要 提高 自己 的 知识 水平 ！ 懂 我的 意思 —— 识得 唔 识得 啊 ？（ 懂 不懂 啊 ？ ）
+我 的 这个 经历 就是 到了 上海 ， 到了 89年 的 年初 的 时候 ，我 在 想 我 估计 是 快要 离休 了 ， 我 想 我 应该 去 当 教授 。 于是 我 就 给 [@朱物华#Person*] 校长 、 [@张钟俊#Person*] 院长 ， 给 他们 写 了 一个 报告 。 他们 说 欢迎 你 来 ， 不过 ， 这个 Apply for Professor（ 申请 当 教授 ） ， 你 要 去 做 一个 报告 。 我 就 做了 一个 能源 与 发展 趋势 的 主要 的 节能 措施 ， 这个 报告 经过 好几百个 教授 一致 通过 。 那么 [@上海交大#Organization*] 教授 当了 以后 我 就 做 第二个 报告 ， 就是 [@微电子 工业#Sector*] 的 发展 。 这 两个 报告 做了 以后 不久 ， 过后 ， 1989年 的 5月31号 北京 就 把 我 调到 北京 去 了 。 现在 这个 报告 做了 快 20年 了 ， 所以  呢 我 就 去年 呢 在 我们 [@交大#Organization*] 的 学报 ， 我 发表 了 两篇 文章 ， 就是 呼应 这个 89年 的 报告 的 。 特别 是 昨天 晚上 ， 他 又把 我 这个 第二篇 报告 ， 还有 我 这 十几年 包括 在 电子 工业部 、 上海市 所 做 的 有关 于 信息 产业化 的 文章 ， 总共 我 听 他们 讲 是 27篇 …… 我 也 没有 什么 别的 东西 送 给 [$你们#Person*] ， 我们 拿来 以后 我 叫 [@钱秘书#Person*] 啊 ， 就 把 这 两个 学报 ， 两个 学报 的 英文本 ── 因为 他们 这里 洋文 好 的 人 多得很 哪 ── 英文本 ， 还有 前面 出过 两本书 ， 再 加上 昨天 晚上 出的 这 本书 ， 送给 郭伟华 同志 ， 给 你 送 过来 ， 那么 给 [$你们#Person*] 作为 一个 纪念 。
+人 呐 就 都 不知道 ， 自己 就 不可以 预料 。 一个人 的 命运 啊 ， 当然 要 靠 自我奋斗 ， 但是 也要 考虑 到 历史 的 行程 。 我 绝对 不知道 ， 我 作为 一个 上海 市委书记 怎么 把 我 选 到 北京 去 了 ， 所以 邓小平 同志 跟 我 讲话 ， 说 “ 中央 都 决定 啦 ， 你 来 当 总书记 ” ， 我 说 另请高明 吧 。 我 实在 我 也 不是 谦虚 ， 我 一个 上海 市委书记 怎么 到 北京 来 了 呢 ？ 但是 呢 ， 小平 同志 讲 “ 大家 已经 研究 决定 了 ” ， 所以 后来 我 就 念了 两首诗 （ 原话 如此 ） ， 叫 “ 苟 利 国家 生死 以 ， 岂 因 祸福 避趋 之 ” ， 那么 所以 我 就到 了 北京 。 到了 北京 我 干了 这 十几年 也 没有 什么 别 的 ， 大概 三件 事 ：
+一个 ，确立 了 社会主义 市场 经济 ；
+第二个 ，把 邓小平 的 理论 列入 了 党章 ；
+第三个 ， 就是 我们 知道的 “ 三个代表 ” 。
+如果 说 还有 一点 什么 成绩 就是 军队 一律 不得 经商 ！ 这个 对 军队 的 命运 有 很大 的 关系 。 因为 我 后来 又 干了 一年 零 八个月 ， 等于 我 在 部队 干了 15年 军委主席 。 还有 九八年 的 抗洪 也是 很大 的 。 但 这些 都是 次要 的 ， 我 主要的 我 就是 三件 事情 ， 很 惭愧 ， 就 做了 一点 微小 的 工作 ， 谢谢 大家 。
\ No newline at end of file

demotext/EnglishDemo.txt

+A US aircraft carrier and other warships did not sail towards North Korea - but went in the opposite direction, it has emerged.
+The US Navy said on 8 April that the Carl Vinson strike group was travelling to the Korean peninsula amid tensions over Pyongyang's nuclear ambitions.
+Last week President Trump said an "armada" was being sent.
+But the group was actually farther away over the weekend, moving through the Sunda Strait into the Indian Ocean.
+The US military's Pacific Command said on Tuesday that it had cancelled a port visit to Perth, but had completed previously scheduled training with Australia off its northwest coast after departing Singapore on 8 April.
+The strike group was now "proceeding to the Western Pacific as ordered".
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader Kim Jong-un, a change of plan or simple miscommunication, the BBC's Korea correspondent Stephen Evans says.
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.
+He said the US was "working closely" with China to engage North Korea.
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.

demotext/EnglishDemo.txt.ann

+A [@US#Location*] [@aircraft carrier#Artifical*] and other warships did not sail towards [@North Korea#Location*] - but went in the opposite direction, it has emerged.
+The [@US Navy#Organization*] said on 8 April that the Carl Vinson strike group was travelling to the Korean peninsula amid tensions over Pyongyang's nuclear ambitions.
+Last week [@President Trump#Person*] said an "armada" was being sent.
+But the group was actually farther away over the weekend, moving through [@the Sunda Strait#Location*] into the Indian Ocean.
+The [@US#Location*] military's [@Pacific Command#Person*] said on Tuesday that it had cancelled a port visit to [@Perth#Location*], but had completed previously scheduled training with [@Australia#Location*] off its northwest coast after departing [@Singapore#Location*] on 8 April.
+The strike group was now "proceeding to [@the Western Pacific#Location*] as ordered".
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten [$North Korea#Location*]'s leader Kim Jong-un, a change of plan or simple miscommunication, the BBC's Korea correspondent Stephen Evans says.
+Either way, [$US#Location*] Vice-President Mike Pence was undeterred as he spoke aboard the [$US#Location*]S Ronald Reagan - an [$aircraft carrier#Artifical*] docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".
+[$North Korea#Location*] and the [$US#Location*] have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the [$US#Location*].
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.
+He said the US was "working closely" with China to engage North Korea.
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.
+A [@US#Location*] [@aircraft carrier#Artifical*] and other warships did not sail towards [@North Korea#Location*] - but went in the opposite direction, it has emerged.
+The [@US Navy#Organization*] said on 8 April that the Carl Vinson strike group was travelling to the Korean peninsula amid tensions over Pyongyang's nuclear ambitions.
+Last week [@President Trump#Person*] said an "armada" was being sent.
+But the group was actually farther away over the weekend, moving through [@the Sunda Strait#Location*] into the Indian Ocean.
+The [@US#Location*] military's [@Pacific Command#Person*] said on Tuesday that it had cancelled a port visit to [@Perth#Location*], but had completed previously scheduled training with [@Australia#Location*] off its northwest coast after departing [@Singapore#Location*] on 8 April.
+The strike group was now "proceeding to [@the Western Pacific#Location*] as ordered".
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader Kim Jong-un, a change of plan or simple miscommunication, the BBC's Korea correspondent Stephen Evans says.
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.
+He said the US was "working closely" with China to engage North Korea.
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.
+A [@US#Location*] [@aircraft carrier#Artifical*] and other warships did not sail towards [@North Korea#Location*] - but went in the opposite direction, it has emerged.
+The [@US Navy#Organization*] said on 8 April that the Carl Vinson strike group was travelling to the Korean peninsula amid tensions over Pyongyang's nuclear ambitions.
+Last week [@President Trump#Person*] said an "armada" was being sent.
+But the group was actually farther away over the weekend, moving through [@the Sunda Strait#Location*] into the Indian Ocean.
+The [@US#Location*] military's [@Pacific Command#Person*] said on Tuesday that it had cancelled a port visit to [@Perth#Location*], but had completed previously scheduled training with [@Australia#Location*] off its northwest coast after departing [@Singapore#Location*] on 8 April.
+The strike group was now "proceeding to [@the Western Pacific#Location*] as ordered".
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader Kim Jong-un, a change of plan or simple miscommunication, the BBC's Korea correspondent Stephen Evans says.
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.
+He said the US was "working closely" with China to engage North Korea.
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.
+A [@US#Location*] [@aircraft carrier#Artifical*] and other warships did not sail towards [@North Korea#Location*] - but went in the opposite direction, it has emerged.
+The [@US Navy#Organization*] said on 8 April that the Carl Vinson strike group was travelling to the Korean peninsula amid tensions over Pyongyang's nuclear ambitions.
+Last week [@President Trump#Person*] said an "armada" was being sent.
+But the group was actually farther away over the weekend, moving through [@the Sunda Strait#Location*] into the Indian Ocean.
+The [@US#Location*] military's [@Pacific Command#Person*] said on Tuesday that it had cancelled a port visit to [@Perth#Location*], but had completed previously scheduled training with [@Australia#Location*] off its northwest coast after departing [@Singapore#Location*] on 8 April.
+The strike group was now "proceeding to [@the Western Pacific#Location*] as ordered".
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader Kim Jong-un, a change of plan or simple miscommunication, the BBC's Korea correspondent Stephen Evans says.
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.
+He said the US was "working closely" with China to engage North Korea.
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.
\ No newline at end of file

demotext/EnglishDemo1.txt

+A US aircraft carrier and other warships did not sail towards North Korea - but went in the opposite direction, it has emerged.
+The US Navy said on 8 April that the Carl Vinson strike group was travelling to the Korean peninsula amid tensions over Pyongyang's nuclear ambitions.
+Last week President Trump said an "armada" was being sent.
+But the group was actually farther away over the weekend, moving through the Sunda Strait into the Indian Ocean.
+The US military's Pacific Command said on Tuesday that it had cancelled a port visit to Perth, but had completed previously scheduled training with Australia off its northwest coast after departing Singapore on 8 April.
+The strike group was now "proceeding to the Western Pacific as ordered".
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader Kim Jong-un, a change of plan or simple miscommunication, the BBC's Korea correspondent Stephen Evans says.
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.
+He said the US was "working closely" with China to engage North Korea.
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.

tex2pdf/eng.aux

+\relax 
+\@writefile{toc}{\contentsline {title}{Annotation Comparison Report}{1}}
+\@writefile{toc}{\authcount {1}}
+\@writefile{toc}{\contentsline {author}{SUTDNLP Group}{1}}
+\@writefile{toc}{\contentsline {section}{\numberline {1}Overall Statistics}{1}}
+\@writefile{lot}{\contentsline {table}{\numberline {1}{\ignorespaces Statistics for two annotations, assume File1 as gold standard}}{1}}
+\@writefile{toc}{\contentsline {section}{\numberline {2}Detail Content Comparison}{1}}

tex2pdf/eng.fdb_latexmk

+# Fdb version 3
+["pdflatex"] 1505999228 "eng.tex" "eng.pdf" "eng" 1505999229
+  "/usr/local/texlive/2014/texmf-dist/fonts/map/fontname/texfonts.map" 1272929888 3287 e6b82fe08f5336d4d5ebc73fb1152e87 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm" 1246382020 1004 54797486969f23fa377b128694d548df ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex9.tfm" 1246382020 996 a18840b13b499c08ac2de96a99eda4bc ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm" 1246382020 916 f87d7c45f9c908e672703b83b72241a3 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam5.tfm" 1246382020 924 9904cf1d39e9767e7a3622f2a125a565 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam7.tfm" 1246382020 928 2dc8d444221b7a635bb58038579b861a ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm" 1246382020 908 2921f8a10601f252058503cc6570e581 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm5.tfm" 1246382020 940 75ac932a52f80982a9f8ea75d03a34cf ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm7.tfm" 1246382020 940 228d6584342e91276bf566bcf9716b83 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmbx12.tfm" 1136768653 1324 c910af8c371558dc20f2d7822f66fe64 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmbx9.tfm" 1136768653 1328 5442e22a7072966dbaf88ca900acf3f0 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmmi6.tfm" 1136768653 1512 f21f83efb36853c0b70002322c1ab3ad ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmmi9.tfm" 1136768653 1524 d89e2d087a9828407a196f428428ef4a ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr12.tfm" 1136768653 1288 655e228510b4c2a1abe905c368440826 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr6.tfm" 1136768653 1300 b62933e007d01cfd073f79b963c01526 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr9.tfm" 1136768653 1292 6b21b9c2c7bebb38aa2273f7ca0fb3af ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmsy6.tfm" 1136768653 1116 933a60c408fc0a863a92debe84b2d294 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmsy9.tfm" 1136768653 1116 25a7bf822c58caf309a702ef79f4afbb ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx12.pfb" 1248133631 32080 340ef9bf63678554ee606688e7b5339d ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx9.pfb" 1248133631 32298 c6d25bb16d1eac01ebdc6d7084126a1e ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmr10.pfb" 1248133631 35752 024fb6c41858982481f6968b5fc26508 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmr9.pfb" 1248133631 33993 9b89b85fd2d9df0482bd47194d1d3bf3 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/context/base/supp-pdf.mkii" 1337017135 71627 94eb9990bed73c364d7f53f960cc8c5b ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/etexcmds.sty" 1335995445 7612 c47308d923ec19888707b0f1792b326a ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifluatex.sty" 1303254447 7324 11d14f318d865f420e692d4e6c9c18c3 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifpdf.sty" 1303254447 7140 ece2cc23d9f20e1f53975ac167f42d3e ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/infwarerr.sty" 1335995445 8253 3bdedc8409aa5d290a2339be6f09af03 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvdefinekeys.sty" 1335995445 5152 387d9200f396b498d5fd679ae44ed898 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty" 1335995445 14040 8de9f47fabc4ca3bd69b6d795e32751c ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ltxcmds.sty" 1335995445 18425 775b341047ce304520cc7c11ca41392e ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/pdftexcmds.sty" 1335995445 19987 01cb2f3c1d21e5f05711b7fd50b17f2a ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amsfonts.sty" 1359763108 5949 3f3fd50a8cc94c3d4cbf4fc66cd3df1c ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amssymb.sty" 1359763108 13829 94730e64147574077f8ecfea9bb69af4 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsa.fd" 1359763108 961 6518c6525a34feb5e8250ffa91731cff ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsb.fd" 1359763108 961 d02606146ba5601b5645f987c92e6193 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsbsy.sty" 1362954379 2412 2d98314dc5be38f455f8890deeb2d091 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsgen.sty" 1362954379 4357 ad30ad08920902fc9b38caf35a3b0496 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsmath.sty" 1362954379 79178 b2e326c351e876df0e5e23df2e02441b ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsopn.sty" 1362954379 4082 502152465aedb8f6a3c4b0b7c0fa8ae5 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amstext.sty" 1362954379 2637 846ebe982d3549c7ede7ce135456f54a ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/base/article.cls" 1399675188 20496 66dd832c447553f6776fbeac03bb0580 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/base/size10.clo" 1399675188 8967 546f1b177fd18efd7ad74d77a7bdac64 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/carlisle/remreset.sty" 1137109962 1096 6a75275ca00e32428c6f059d2f618ea7 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/CJK.enc" 1336691841 29591 eefa7fcd8dc7ed51469bfefaa126930d ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/CJK.sty" 1336691841 32687 3257b1bf971cec202cb9f439e19313c1 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.bdg" 1336691841 3857 db8148d88918b04ce88d70aef60c0926 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.chr" 1336691841 8601 56f62306bc1b77b1b81ae95c1fe14da5 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.enc" 1336691841 6111 e18ff346b9609ac3fe218452ae362309 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/mule/MULEenc.sty" 1336691841 12177 35bc847718d10d70afa824372bc56b9b ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/graphics/color.sty" 1399675188 6559 34a083f539c61168227e1ad844684e63 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphics.sty" 1254151804 14183 42a8fc761b806986eef292369afc2988 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphicx.sty" 1399675188 7911 bf0a64f89bfb668c239ddf6324bf4afb ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/graphics/keyval.sty" 1399675188 2317 0ace13e225e9d95dd9defe947adc9fbb ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/graphics/trig.sty" 1156702488 3153 c50e6bd54d2dd3933fc52bcf369bec4a ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/color.cfg" 1254097189 802 7b8c8d72c24d795ed7720e4dfd29bff3 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg" 1279039959 678 4792914a8f45be57bb98413425e4c7af ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/graphics.cfg" 1278958963 3563 d35e897cae3b8c6848f6677b73370b54 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/multirow/multirow.sty" 1137110401 7374 f7c1f13fc632dd5c9b220a247d233082 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/aliascnt.sty" 1335995445 2511 8ef653ad0c83209793c35dc808929370 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty" 1303254447 12029 04d7fdf76e0464c23b5aa3a727952d7c ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/grfext.sty" 1335995445 7075 bd0c34fbf1ae8fd1debd2a554e41b2d5 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/kvoptions.sty" 1335995445 22417 c74ff4af6a1aa2b65d1924020edbbe11 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/pdftex-def/pdftex.def" 1306616590 55368 3c8a0d99822330f2dfabc0dfb09ce897 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.cfg" 1167176009 2062 a0e7d66e09e508f51289a656aec06ed2 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.sty" 1167176009 15188 91281c7ddbccfa54a8e0c3b56ab5aa72 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/tools/multicol.sty" 1399675188 29193 08a2f6b9e76c544040f9143397c0d6dc ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/url/url.sty" 1388531844 12796 8edb7d69a20b857904dd0ea757c14ec9 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/xcolor/xcolor.sty" 1169481954 55224 a43bab84e0ac5e6efcaf9a98bde73a94 ""
+  "/usr/local/texlive/2014/texmf-dist/web2c/texmf.cnf" 1398200874 31722 4f52421e59a4b9e910cf18e64c1f2b4a ""
+  "/usr/local/texlive/2014/texmf-var/fonts/map/pdftex/updmap/pdftex.map" 1401025944 1445653 26a0aacf3d70032b1ec192e8c7792117 ""
+  "/usr/local/texlive/2014/texmf-var/web2c/pdftex/pdflatex.fmt" 1414992882 3832012 194c4db574515d58e6b0f573631d9cc2 ""
+  "/usr/local/texlive/2014/texmf.cnf" 1401025936 577 a59edbde8d3a8c549d0eeaab1739e2ff ""
+  "eng.aux" 1505999229 477 6045205284688e9a6c58790953019c51 ""
+  "eng.tex" 1505999226 9258 5453aa181950197f26d4bfb05d628a21 ""
+  "llncs.cls" 1458498458 41688 65f2552e476e2e54b95289f3e5fe5bf6 ""
+  (generated)
+  "eng.log"
+  "eng.pdf"
+  "eng.aux"

tex2pdf/eng.fls

+PWD /Users/Jie/Dropbox/research/SUTDAnnotator/tex2pdf
+INPUT /usr/local/texlive/2014/texmf.cnf
+INPUT /usr/local/texlive/2014/texmf-dist/web2c/texmf.cnf
+INPUT /usr/local/texlive/2014/texmf-var/web2c/pdftex/pdflatex.fmt
+INPUT eng.tex
+OUTPUT eng.log
+INPUT llncs.cls
+INPUT llncs.cls
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/base/article.cls
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/base/article.cls
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/base/size10.clo
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/base/size10.clo
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/tools/multicol.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/tools/multicol.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/aliascnt.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/aliascnt.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/carlisle/remreset.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/carlisle/remreset.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amssymb.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amssymb.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amsfonts.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amsfonts.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphicx.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphicx.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/keyval.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/keyval.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphics.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphics.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/trig.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/trig.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/graphics.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/graphics.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/pdftex-def/pdftex.def
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/pdftex-def/pdftex.def
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/infwarerr.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/infwarerr.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ltxcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ltxcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/multirow/multirow.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/multirow/multirow.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsmath.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsmath.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amstext.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amstext.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsgen.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsgen.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsbsy.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsbsy.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsopn.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsopn.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/CJK.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/CJK.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/mule/MULEenc.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/mule/MULEenc.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/CJK.enc
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/color.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/color.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/color.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/color.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/xcolor/xcolor.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/xcolor/xcolor.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/color.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/color.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/url/url.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/url/url.sty
+INPUT eng.aux
+INPUT eng.aux
+OUTPUT eng.aux
+INPUT /usr/local/texlive/2014/texmf-dist/tex/context/base/supp-pdf.mkii
+INPUT /usr/local/texlive/2014/texmf-dist/tex/context/base/supp-pdf.mkii
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/pdftexcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/pdftexcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifluatex.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifluatex.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifpdf.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifpdf.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/grfext.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/grfext.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvdefinekeys.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvdefinekeys.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/kvoptions.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/kvoptions.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/etexcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/etexcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.bdg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.enc
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.chr
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/map/fontname/texfonts.map
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/map/fontname/texfonts.map
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr12.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmbx12.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsa.fd
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsa.fd
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam5.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsb.fd
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsb.fd
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm5.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr9.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr12.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmbx12.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmbx9.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr6.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmmi9.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmmi6.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmsy9.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmsy6.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex9.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm7.tfm
+OUTPUT eng.pdf
+INPUT /usr/local/texlive/2014/texmf-var/fonts/map/pdftex/updmap/pdftex.map
+INPUT eng.aux
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx12.pfb
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx9.pfb
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmr10.pfb
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmr9.pfb

tex2pdf/eng.tex

+%%%%%%%%%%%%%%%%%%%%%%% file typeinst.tex %%%%%%%%%%%%%%%%%%%%%%%%%
+\documentclass[runningheads,a4paper]{llncs}
+\usepackage{amssymb}
+\setcounter{tocdepth}{3}
+\usepackage{graphicx}
+\usepackage{multirow}
+\usepackage{subfigure}
+\usepackage{amsmath}
+\usepackage{CJK}
+\usepackage{color}
+\usepackage{xcolor}
+\usepackage{url}
+\begin{document}
+\begin{CJK*}{UTF8}{gbsn}
+\mainmatter  % start of an individual contribution
+\title{Annotation Comparison Report}
+\author{SUTDNLP Group}
+\institute{Singapore University of Technology and Design}
+\maketitle
+
+\section{Overall Statistics}
+File1 color: \colorbox{blue!30}{Blue}; Dir: \colorbox{blue!30}{../demotext/EnglishUserA.txt.ann}\\
+File2 color: \colorbox{red!30}{Red}; Dir: \colorbox{red!30}{../demotext/EnglishUserB.txt.ann}\\
+\begin{table}[!htbp]
+\centering
+\caption{Statistics for two annotations, assume File1 as gold standard}
+\begin{tabular}{l|l|l}
+\hline
+P/R/F (\%)& Entity &Boundary\\
+\hline
+Artifical& 74.36/50.0/59.79 &--\\
+Event& Nan/0.0/Nan &--\\
+Fin-Concept& 57.36/68.07/62.26 &--\\
+Location& 50.0/100.0/66.67 &--\\
+Organization& 66.67/82.93/73.91 &--\\
+Other& 57.14/44.44/50.0 &--\\
+Person& 91.3/67.74/77.78 &--\\
+Sector& 56.52/76.47/65.0 &--\\
+\hline
+Overall& 61.96/66.36/64.08 &72.05/77.16/74.52\\
+\hline
+\end{tabular}
+\end{table}
+\section{Detail Content Comparison}
+\colorbox{blue!30}{Blue}: only annotated in File1.\\
+\colorbox{red!30}{Red}: only annotated in File2.\\
+\colorbox{green!30}{Green}: annotated in both files.\\
+\rule{5cm}{0.1em}\\
+\vspace{0.3cm}\\
+But the group was actually farther away over the weekend, moving through \colorbox{blue!30}{the }\colorbox{green!30}{Sunda Strait} into the \colorbox{red!30}{Indian Ocean}.\\
+The \colorbox{green!30}{US} military's \colorbox{blue!30}{Pacific }\colorbox{green!30}{Command} said on Tuesday that it had cancelled a port visit to\colorbox{green!30}{Perth}, but had completed previously scheduled training with \colorbox{blue!30}{Australia} off its northwest coast after departing \colorbox{green!30}{Singapore} on 8 April.\\
+The strike group was now "proceeding to \colorbox{blue!30}{the Western Pacific} as ordered".\\
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader \colorbox{red!30}{Kim Jong-un}, a change of plan or simple miscommunication, the \colorbox{red!30}{BBC's Korea correspondent Stephen Evans} says.\\
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".\\
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.\\
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.\\
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.\\
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.\\
+He said the US was "working closely" with China to engage North Korea.\\
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.\\
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.\\
+A \colorbox{green!30}{US} \colorbox{green!30}{aircraft carrier} and other \colorbox{red!30}{warships} did not sail towards \colorbox{green!30}{North Korea} - but went in the opposite direction, it has emerged.\\
+The \colorbox{green!30}{US}\colorbox{blue!30}{ Navy} said on 8 April that the \colorbox{red!30}{Carl Vinson strike group} was travelling to the Korean peninsula amid tensions over Pyongyang's nuclear ambitions.\\
+Last week \colorbox{blue!30}{President Trump} said an "armada" was being sent.\\
+But the group was actually farther away over the weekend, moving through \colorbox{blue!30}{the }\colorbox{green!30}{Sunda Strait} into the \colorbox{red!30}{Indian Ocean}.\\
+The \colorbox{green!30}{US} military's \colorbox{blue!30}{Pacific }\colorbox{green!30}{Command} said on Tuesday that it had cancelled a port visit to\colorbox{red!30}{ }\colorbox{green!30}{Perth}, but had completed previously scheduled training with \colorbox{blue!30}{Australia} off its northwest coast after departing \colorbox{green!30}{Singapore} on 8 April.\\
+The strike group was now "proceeding to \colorbox{blue!30}{the Western Pacific} as ordered".\\
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader \colorbox{red!30}{Kim Jong-un}, a change of plan or simple miscommunication, the \colorbox{red!30}{BBC's Korea correspondent Stephen Evans} says.\\
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".\\
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.\\
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.\\
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.\\
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.\\
+He said the US was "working closely" with China to engage North Korea.\\
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.\\
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.\\
+A \colorbox{green!30}{US} \colorbox{green!30}{aircraft carrier} and other \colorbox{red!30}{warships} did not sail towards \colorbox{green!30}{North Korea} - but went in the opposite direction, it has emerged.\\
+The \colorbox{green!30}{US}\colorbox{blue!30}{ Navy} said on 8 April that the \colorbox{red!30}{Carl Vinson strike group} was travelling to the Korean peninsula amid tensions over Pyongyang's nuclear ambitions.\\
+Last week \colorbox{blue!30}{President Trump} said an "armada" was being sent.\\
+But the group was actually farther away over the weekend, moving through \colorbox{blue!30}{the }\colorbox{green!30}{Sunda Strait} into the \colorbox{red!30}{Indian Ocean}.\\
+The \colorbox{green!30}{US} military's \colorbox{blue!30}{Pacific }\colorbox{green!30}{Command} said on Tuesday that it had cancelled a port visit to\colorbox{red!30}{ }\colorbox{green!30}{Perth}, but had completed previously scheduled training with \colorbox{blue!30}{Australia} off its northwest coast after departing \colorbox{green!30}{Singapore} on 8 April.\\
+The strike group was now "proceeding to \colorbox{blue!30}{the Western Pacific} as ordered".\\
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader \colorbox{red!30}{Kim Jong-un}, a change of plan or simple miscommunication, the \colorbox{red!30}{BBC's Korea correspondent Stephen Evans} says.\\
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".\\
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.\\
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.\\
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.\\
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.\\
+He said the US was "working closely" with China to engage North Korea.\\
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.\\
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.\\
+\end{CJK*}
+\end{document}

tex2pdf/test.aux

+\relax 
+\@writefile{toc}{\contentsline {title}{Annotation Comparison Report}{1}}
+\@writefile{toc}{\authcount {1}}
+\@writefile{toc}{\contentsline {author}{SUTDNLP Group}{1}}
+\@writefile{toc}{\contentsline {section}{\numberline {1}Overall Statistics}{1}}
+\@writefile{lot}{\contentsline {table}{\numberline {1}{\ignorespaces Statistics for two annotations, assume File1 as gold standard}}{1}}
+\@writefile{toc}{\contentsline {section}{\numberline {2}Detail Content Comparison}{1}}

tex2pdf/test.fdb_latexmk

+# Fdb version 3
+["pdflatex"] 1506253252 "test.tex" "test.pdf" "test" 1506253253
+  "/usr/local/texlive/2014/texmf-dist/fonts/map/fontname/texfonts.map" 1272929888 3287 e6b82fe08f5336d4d5ebc73fb1152e87 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm" 1246382020 1004 54797486969f23fa377b128694d548df ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex9.tfm" 1246382020 996 a18840b13b499c08ac2de96a99eda4bc ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm" 1246382020 916 f87d7c45f9c908e672703b83b72241a3 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam5.tfm" 1246382020 924 9904cf1d39e9767e7a3622f2a125a565 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam7.tfm" 1246382020 928 2dc8d444221b7a635bb58038579b861a ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm" 1246382020 908 2921f8a10601f252058503cc6570e581 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm5.tfm" 1246382020 940 75ac932a52f80982a9f8ea75d03a34cf ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm7.tfm" 1246382020 940 228d6584342e91276bf566bcf9716b83 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmbx12.tfm" 1136768653 1324 c910af8c371558dc20f2d7822f66fe64 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmbx9.tfm" 1136768653 1328 5442e22a7072966dbaf88ca900acf3f0 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmmi6.tfm" 1136768653 1512 f21f83efb36853c0b70002322c1ab3ad ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmmi9.tfm" 1136768653 1524 d89e2d087a9828407a196f428428ef4a ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr12.tfm" 1136768653 1288 655e228510b4c2a1abe905c368440826 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr6.tfm" 1136768653 1300 b62933e007d01cfd073f79b963c01526 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr9.tfm" 1136768653 1292 6b21b9c2c7bebb38aa2273f7ca0fb3af ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmsy6.tfm" 1136768653 1116 933a60c408fc0a863a92debe84b2d294 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmsy9.tfm" 1136768653 1116 25a7bf822c58caf309a702ef79f4afbb ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx12.pfb" 1248133631 32080 340ef9bf63678554ee606688e7b5339d ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx9.pfb" 1248133631 32298 c6d25bb16d1eac01ebdc6d7084126a1e ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmr10.pfb" 1248133631 35752 024fb6c41858982481f6968b5fc26508 ""
+  "/usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmr9.pfb" 1248133631 33993 9b89b85fd2d9df0482bd47194d1d3bf3 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/context/base/supp-pdf.mkii" 1337017135 71627 94eb9990bed73c364d7f53f960cc8c5b ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/etexcmds.sty" 1335995445 7612 c47308d923ec19888707b0f1792b326a ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifluatex.sty" 1303254447 7324 11d14f318d865f420e692d4e6c9c18c3 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifpdf.sty" 1303254447 7140 ece2cc23d9f20e1f53975ac167f42d3e ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/infwarerr.sty" 1335995445 8253 3bdedc8409aa5d290a2339be6f09af03 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvdefinekeys.sty" 1335995445 5152 387d9200f396b498d5fd679ae44ed898 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty" 1335995445 14040 8de9f47fabc4ca3bd69b6d795e32751c ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ltxcmds.sty" 1335995445 18425 775b341047ce304520cc7c11ca41392e ""
+  "/usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/pdftexcmds.sty" 1335995445 19987 01cb2f3c1d21e5f05711b7fd50b17f2a ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amsfonts.sty" 1359763108 5949 3f3fd50a8cc94c3d4cbf4fc66cd3df1c ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amssymb.sty" 1359763108 13829 94730e64147574077f8ecfea9bb69af4 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsa.fd" 1359763108 961 6518c6525a34feb5e8250ffa91731cff ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsb.fd" 1359763108 961 d02606146ba5601b5645f987c92e6193 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsbsy.sty" 1362954379 2412 2d98314dc5be38f455f8890deeb2d091 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsgen.sty" 1362954379 4357 ad30ad08920902fc9b38caf35a3b0496 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsmath.sty" 1362954379 79178 b2e326c351e876df0e5e23df2e02441b ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsopn.sty" 1362954379 4082 502152465aedb8f6a3c4b0b7c0fa8ae5 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amstext.sty" 1362954379 2637 846ebe982d3549c7ede7ce135456f54a ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/base/article.cls" 1399675188 20496 66dd832c447553f6776fbeac03bb0580 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/base/size10.clo" 1399675188 8967 546f1b177fd18efd7ad74d77a7bdac64 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/carlisle/remreset.sty" 1137109962 1096 6a75275ca00e32428c6f059d2f618ea7 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/CJK.enc" 1336691841 29591 eefa7fcd8dc7ed51469bfefaa126930d ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/CJK.sty" 1336691841 32687 3257b1bf971cec202cb9f439e19313c1 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.bdg" 1336691841 3857 db8148d88918b04ce88d70aef60c0926 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.chr" 1336691841 8601 56f62306bc1b77b1b81ae95c1fe14da5 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.enc" 1336691841 6111 e18ff346b9609ac3fe218452ae362309 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/mule/MULEenc.sty" 1336691841 12177 35bc847718d10d70afa824372bc56b9b ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/graphics/color.sty" 1399675188 6559 34a083f539c61168227e1ad844684e63 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphics.sty" 1254151804 14183 42a8fc761b806986eef292369afc2988 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphicx.sty" 1399675188 7911 bf0a64f89bfb668c239ddf6324bf4afb ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/graphics/keyval.sty" 1399675188 2317 0ace13e225e9d95dd9defe947adc9fbb ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/graphics/trig.sty" 1156702488 3153 c50e6bd54d2dd3933fc52bcf369bec4a ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/color.cfg" 1254097189 802 7b8c8d72c24d795ed7720e4dfd29bff3 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg" 1279039959 678 4792914a8f45be57bb98413425e4c7af ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/graphics.cfg" 1278958963 3563 d35e897cae3b8c6848f6677b73370b54 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/multirow/multirow.sty" 1137110401 7374 f7c1f13fc632dd5c9b220a247d233082 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/aliascnt.sty" 1335995445 2511 8ef653ad0c83209793c35dc808929370 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty" 1303254447 12029 04d7fdf76e0464c23b5aa3a727952d7c ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/grfext.sty" 1335995445 7075 bd0c34fbf1ae8fd1debd2a554e41b2d5 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/kvoptions.sty" 1335995445 22417 c74ff4af6a1aa2b65d1924020edbbe11 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/pdftex-def/pdftex.def" 1306616590 55368 3c8a0d99822330f2dfabc0dfb09ce897 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.cfg" 1167176009 2062 a0e7d66e09e508f51289a656aec06ed2 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.sty" 1167176009 15188 91281c7ddbccfa54a8e0c3b56ab5aa72 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/tools/multicol.sty" 1399675188 29193 08a2f6b9e76c544040f9143397c0d6dc ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/url/url.sty" 1388531844 12796 8edb7d69a20b857904dd0ea757c14ec9 ""
+  "/usr/local/texlive/2014/texmf-dist/tex/latex/xcolor/xcolor.sty" 1169481954 55224 a43bab84e0ac5e6efcaf9a98bde73a94 ""
+  "/usr/local/texlive/2014/texmf-dist/web2c/texmf.cnf" 1398200874 31722 4f52421e59a4b9e910cf18e64c1f2b4a ""
+  "/usr/local/texlive/2014/texmf-var/fonts/map/pdftex/updmap/pdftex.map" 1401025944 1445653 26a0aacf3d70032b1ec192e8c7792117 ""
+  "/usr/local/texlive/2014/texmf-var/web2c/pdftex/pdflatex.fmt" 1414992882 3832012 194c4db574515d58e6b0f573631d9cc2 ""
+  "/usr/local/texlive/2014/texmf.cnf" 1401025936 577 a59edbde8d3a8c549d0eeaab1739e2ff ""
+  "llncs.cls" 1458498458 41688 65f2552e476e2e54b95289f3e5fe5bf6 ""
+  "test.aux" 1506253253 477 6045205284688e9a6c58790953019c51 ""
+  "test.tex" 1506253236 9217 c1309dc45c6313f7ba264d22059e1ba5 ""
+  (generated)
+  "test.pdf"
+  "test.log"
+  "test.aux"

tex2pdf/test.fls

+PWD /Users/Jie/Dropbox/research/SUTDAnnotator/tex2pdf
+INPUT /usr/local/texlive/2014/texmf.cnf
+INPUT /usr/local/texlive/2014/texmf-dist/web2c/texmf.cnf
+INPUT /usr/local/texlive/2014/texmf-var/web2c/pdftex/pdflatex.fmt
+INPUT test.tex
+OUTPUT test.log
+INPUT llncs.cls
+INPUT llncs.cls
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/base/article.cls
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/base/article.cls
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/base/size10.clo
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/base/size10.clo
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/tools/multicol.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/tools/multicol.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/aliascnt.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/aliascnt.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/carlisle/remreset.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/carlisle/remreset.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amssymb.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amssymb.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amsfonts.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/amsfonts.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphicx.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphicx.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/keyval.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/keyval.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphics.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/graphics.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/trig.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/trig.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/graphics.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/graphics.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/pdftex-def/pdftex.def
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/pdftex-def/pdftex.def
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/infwarerr.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/infwarerr.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ltxcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ltxcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/multirow/multirow.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/multirow/multirow.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/subfigure/subfigure.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsmath.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsmath.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amstext.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amstext.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsgen.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsgen.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsbsy.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsbsy.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsopn.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsmath/amsopn.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/CJK.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/CJK.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/mule/MULEenc.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/mule/MULEenc.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/CJK.enc
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/color.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/graphics/color.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/color.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/color.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/xcolor/xcolor.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/xcolor/xcolor.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/color.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/color.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/url/url.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/url/url.sty
+INPUT test.aux
+INPUT test.aux
+OUTPUT test.aux
+INPUT /usr/local/texlive/2014/texmf-dist/tex/context/base/supp-pdf.mkii
+INPUT /usr/local/texlive/2014/texmf-dist/tex/context/base/supp-pdf.mkii
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/pdftexcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/pdftexcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifluatex.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifluatex.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifpdf.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/ifpdf.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/grfext.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/grfext.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvdefinekeys.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvdefinekeys.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/kvoptions.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/oberdiek/kvoptions.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/etexcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/generic/oberdiek/etexcmds.sty
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.bdg
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.enc
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/cjk/texinput/UTF8/UTF8.chr
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/map/fontname/texfonts.map
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/map/fontname/texfonts.map
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr12.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmbx12.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsa.fd
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsa.fd
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam5.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsb.fd
+INPUT /usr/local/texlive/2014/texmf-dist/tex/latex/amsfonts/umsb.fd
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm5.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr9.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr12.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmbx12.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmbx9.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmr6.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmmi9.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmmi6.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmsy9.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/cm/cmsy6.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex9.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam7.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm7.tfm
+OUTPUT test.pdf
+INPUT /usr/local/texlive/2014/texmf-var/fonts/map/pdftex/updmap/pdftex.map
+INPUT test.aux
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx12.pfb
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx9.pfb
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmr10.pfb
+INPUT /usr/local/texlive/2014/texmf-dist/fonts/type1/public/amsfonts/cm/cmr9.pfb

tex2pdf/test.tex

+%%%%%%%%%%%%%%%%%%%%%%% file typeinst.tex %%%%%%%%%%%%%%%%%%%%%%%%%
+\documentclass[runningheads,a4paper]{llncs}
+\usepackage{amssymb}
+\setcounter{tocdepth}{3}
+\usepackage{graphicx}
+\usepackage{multirow}
+\usepackage{subfigure}
+\usepackage{amsmath}
+\usepackage{CJK}
+\usepackage{color}
+\usepackage{xcolor}
+\usepackage{url}
+\begin{document}
+\begin{CJK*}{UTF8}{gbsn}
+\mainmatter  % start of an individual contribution
+\title{Annotation Comparison Report}
+\author{SUTDNLP Group}
+\institute{Singapore University of Technology and Design}
+\maketitle
+
+\section{Overall Statistics}
+File1 color: \colorbox{blue!30}{Blue}; Dir: \colorbox{blue!30}{/Users/Jie/Dropbox/Research/SUTDAnnotator/demotext/EnglishDemo.txt.ann}\\
+File2 color: \colorbox{red!30}{Red}; Dir: \colorbox{red!30}{/Users/Jie/Dropbox/Research/SUTDAnnotator/demotext/EnglishDemo1.txt.ann}\\
+\begin{table}[!htbp]
+\centering
+\caption{Statistics for two annotations, assume File1 as gold standard}
+\begin{tabular}{l|l|l}
+\hline
+P/R/F (\%)& Entity &Boundary\\
+\hline
+Artifical& 50.0/100.0/66.67 &--\\
+Location& 62.5/62.5/62.5 &--\\
+Organization& 0.0/0.0/Nan &--\\
+Person& 0.0/0.0/Nan &--\\
+\hline
+Overall& 42.86/50.0/46.15 &42.86/50.0/46.15\\
+\hline
+\end{tabular}
+\end{table}
+\section{Detail Content Comparison}
+\colorbox{blue!30}{Blue}: only annotated in File1.\\
+\colorbox{red!30}{Red}: only annotated in File2.\\
+\colorbox{green!30}{Green}: annotated in both files.\\
+\rule{5cm}{0.1em}\\
+\vspace{0.3cm}\\
+But the group was actually farther away over the weekend, moving through \colorbox{blue!30}{the }\colorbox{green!30}{Sunda Strait} into the \colorbox{red!30}{Indian Ocean}.\\
+The \colorbox{green!30}{US} military's \colorbox{blue!30}{Pacific }\colorbox{green!30}{Command} said on Tuesday that it had cancelled a port visit to\colorbox{red!30}{ }\colorbox{green!30}{Perth}, but had completed previously scheduled training with \colorbox{blue!30}{Australia} off its northwest coast after departing \colorbox{green!30}{Singapore} on 8 April.\\
+The strike group was now "proceeding to \colorbox{blue!30}{the Western Pacific} as ordered".\\
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader \colorbox{red!30}{Kim Jong-un}, a change of plan or simple miscommunication, the \colorbox{red!30}{BBC's Korea correspondent Stephen Evans} says.\\
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".\\
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.\\
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.\\
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.\\
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.\\
+He said the US was "working closely" with China to engage North Korea.\\
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.\\
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.\\
+A \colorbox{green!30}{US} \colorbox{green!30}{aircraft carrier} and other \colorbox{red!30}{warships} did not sail towards \colorbox{green!30}{North Korea} - but went in the opposite direction, it has emerged.\\
+The \colorbox{green!30}{US}\colorbox{blue!30}{ Navy} said on 8 April that the \colorbox{red!30}{Carl Vinson strike group} was travelling to the Korean peninsula amid tensions over Pyongyang's nuclear ambitions.\\
+Last week \colorbox{blue!30}{President Trump} said an "armada" was being sent.\\
+But the group was actually farther away over the weekend, moving through \colorbox{blue!30}{the }\colorbox{green!30}{Sunda Strait} into the \colorbox{red!30}{Indian Ocean}.\\
+The \colorbox{green!30}{US} military's \colorbox{blue!30}{Pacific }\colorbox{green!30}{Command} said on Tuesday that it had cancelled a port visit to\colorbox{red!30}{ }\colorbox{green!30}{Perth}, but had completed previously scheduled training with \colorbox{blue!30}{Australia} off its northwest coast after departing \colorbox{green!30}{Singapore} on 8 April.\\
+The strike group was now "proceeding to \colorbox{blue!30}{the Western Pacific} as ordered".\\
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader \colorbox{red!30}{Kim Jong-un}, a change of plan or simple miscommunication, the \colorbox{red!30}{BBC's Korea correspondent Stephen Evans} says.\\
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".\\
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.\\
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.\\
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.\\
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.\\
+He said the US was "working closely" with China to engage North Korea.\\
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.\\
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.\\
+A \colorbox{green!30}{US} \colorbox{green!30}{aircraft carrier} and other \colorbox{red!30}{warships} did not sail towards \colorbox{green!30}{North Korea} - but went in the opposite direction, it has emerged.\\
+The \colorbox{green!30}{US}\colorbox{blue!30}{ Navy} said on 8 April that the \colorbox{red!30}{Carl Vinson strike group} was travelling to the Korean peninsula amid tensions over Pyongyang's nuclear ambitions.\\
+Last week \colorbox{blue!30}{President Trump} said an "armada" was being sent.\\
+But the group was actually farther away over the weekend, moving through \colorbox{blue!30}{the }\colorbox{green!30}{Sunda Strait} into the \colorbox{red!30}{Indian Ocean}.\\
+The \colorbox{green!30}{US} military's \colorbox{blue!30}{Pacific }\colorbox{green!30}{Command} said on Tuesday that it had cancelled a port visit to\colorbox{red!30}{ }\colorbox{green!30}{Perth}, but had completed previously scheduled training with \colorbox{blue!30}{Australia} off its northwest coast after departing \colorbox{green!30}{Singapore} on 8 April.\\
+The strike group was now "proceeding to \colorbox{blue!30}{the Western Pacific} as ordered".\\
+It is not clear whether the failure to arrive was a deliberate deception, perhaps designed to frighten North Korea's leader \colorbox{red!30}{Kim Jong-un}, a change of plan or simple miscommunication, the \colorbox{red!30}{BBC's Korea correspondent Stephen Evans} says.\\
+Either way, US Vice-President Mike Pence was undeterred as he spoke aboard the USS Ronald Reagan - an aircraft carrier docked in Japan - during his tour of the region, vowing to "defeat any attack and meet any use of conventional or nuclear weapons with an overwhelming and effective American response".\\
+North Korea and the US have ratcheted up tensions in recent weeks and the movement of the strike group had raised the question of a pre-emptive strike by the US.\\
+On Wednesday, Mr Pence described the country as the "most dangerous and urgent threat to peace and security" in the Asia-Pacific.\\
+His words came after the North held a show of military might in a parade over the weekend and tested another missile on Sunday, which blew up almost immediately after launch, the Pentagon said.\\
+The US also accused North Korea of trying to "provoke something", with US Defence Secretary James Mattis calling the test a reckless move on Tuesday.\\
+He said the US was "working closely" with China to engage North Korea.\\
+Pyongyang said it may test missiles on a weekly basis, and warned of "all-out war" if the US takes military action.\\
+"If the US is planning a military attack against us, we will react with a nuclear pre-emptive strike by our own style and method," Vice-Foreign Minister Han Song-ryol told the BBC on Monday.\\
+\end{CJK*}
+\end{document}

utils/recommend.py

+# -*- coding: utf-8 -*-
+# @Author: Jie Yang
+# @Date:   2017-09-14 16:38:21
+# @Last Modified by:   Jie Yang,     Contact: jieynlp@gmail.com
+# @Last Modified time: 2018-05-01 21:17:27
+
+import re
+
+
+def maximum_matching(train_text, decode_text, entityRe = r'\[\@.*?\#.*?\*\](?!\#)', recommendRe = r'\[\$.*?\#.*?\*\](?!\#)'):
+	# print("Training data:")
+	# print(train_text)
+	# print("Decode data:")
+	# print(decode_text)
+	# train_text = train_text
+	# decode_text = decode_text
+	extracted_dict = {}
+	max_length = 0
+	for match in re.finditer(entityRe, train_text):
+		recognized_entity = train_text[match.span()[0]:match.span()[1]]
+		[entity, entity_type] = recognized_entity.strip('[@]*').rsplit('#',1)
+		
+		if len(entity) > max_length:
+			max_length = len(entity)
+		
+		extracted_dict[entity] = entity_type
+	# print("dict:", extracted_dict)
+
+	if len(extracted_dict) == 0:
+		return train_text + decode_text
+
+	## only recommend following 10 sentences (reduce time)
+	near_sentences = ""
+	far_sentences = ""
+	sentences = decode_text.split('\n')
+	for idx in range(len(sentences)):
+		if idx != len(sentences) -1 :
+			new_string = sentences[idx] + '\n'
+		else:
+			new_string = sentences[idx]
+		if idx > 20 :
+			far_sentences += new_string
+		else:
+			near_sentences += new_string
+	decode_text = near_sentences
+
+	### forward maximum match algorithm with following conditions:
+	### 1. for previous recommend entities, remove them and recommend again
+	### 2. for recognized entities, ignored them (forward process ends at the begining of recognized entity)
+	
+	## remove previous recommend entity format
+	decode_no_recommend = ""
+	last_entity_end = 0
+	for match in re.finditer(recommendRe, decode_text):
+		decode_no_recommend += decode_text[last_entity_end:match.span()[0]]
+		recommend_entity = decode_text[match.span()[0]:match.span()[1]]
+		entity = recommend_entity.strip('[$]').rsplit('#',1)[0]
+		decode_no_recommend += entity
+		last_entity_end = match.span()[1]
+	decode_no_recommend += decode_text[last_entity_end:]
+	# print(decode_no_recommend)
+	## ignored annotated entities but record them position (in entity_recognized_list)
+	decode_origin = ""
+	entity_recognized_list = []
+	last_entity_end = 0
+	for match in re.finditer(entityRe, decode_no_recommend):
+		decode_origin += decode_no_recommend[last_entity_end:match.span()[0]]
+		entity_recognized_list += [0]*(match.span()[0]-last_entity_end)
+		recommend_entity = decode_no_recommend[match.span()[0]:match.span()[1]]
+		[entity, recognized_type] = recommend_entity.strip('[@]*').rsplit('#',1)
+		decode_origin += entity
+		entity_recognized_list += ["B-@-"+recognized_type] +["I-@-"+recognized_type] *(len(entity)-1)
+		last_entity_end = match.span()[1]
+	decode_origin += decode_no_recommend[last_entity_end:]
+	entity_recognized_list += [0]*(len(decode_no_recommend)-last_entity_end)
+	assert(len(decode_origin) == len(entity_recognized_list))
+	# print(decode_origin)
+	# print(entity_recognized_list)
+
+	## forward maximum matching (FMM)
+	origin_length = len(decode_origin)
+	FMM_start = 0 
+	FMM_end = (FMM_start + max_length) if (FMM_start + max_length) < origin_length-1 else origin_length-1
+	entity_recommend_list = []
+	while FMM_start < origin_length:
+		if FMM_end == FMM_start:
+			entity_recommend_list += [0]
+			FMM_start += 1
+			FMM_end = (FMM_start + max_length) if (FMM_start + max_length) < origin_length-1 else origin_length-1
+		## recognized span detection: for the following two conditions, it jump when the word is located in recognized entity span
+		elif entity_recognized_list[FMM_start] != 0 or decode_origin[FMM_start] == '\n':
+			entity_recommend_list += [0]
+			FMM_start += 1
+			FMM_end = (FMM_start + max_length) if (FMM_start + max_length) < origin_length-1 else origin_length-1
+		elif entity_recognized_list[FMM_end] != 0 or decode_origin[FMM_end] == '\n':
+			FMM_end -= 1
+		## finish recognized span detection	
+		else:
+			word = decode_origin[FMM_start:FMM_end]
+			if word in extracted_dict:
+				entity_recommend_list += ["B-$-"+extracted_dict[word]] +["I-$-"+extracted_dict[word]] *(FMM_end-FMM_start-1)
+				FMM_start = FMM_end
+				FMM_end = (FMM_start + max_length) if (FMM_start + max_length) < origin_length-1 else origin_length-1
+			else:
+				FMM_end -= 1
+	# print(entity_recommend_list)
+	assert(len(entity_recommend_list)== len(entity_recognized_list))
+	recommend_decode_text =  merge_text_with_entity(decode_origin, entity_recognized_list, entity_recommend_list)
+	return train_text + recommend_decode_text + far_sentences
+	
+
+def merge_text_with_entity(origin_text, recognized_list, recommend_list):
+	length = len(origin_text)
+	assert(len(recognized_list)==length)
+	assert(len(recommend_list)==length)
+	combine_list = recommend_list
+	for idx in range(length):
+		if combine_list[idx] == 0 and recognized_list[idx] != 0:
+			combine_list[idx] = recognized_list[idx]
+	new_string = ""
+	entity_string = ""
+	entity_type = "Error"
+	entity_source = "Error"
+	for idx in range(length):
+		if combine_list[idx] == 0:
+			if entity_string:
+				new_string += "["+entity_source + entity_string + "#" + entity_type+"*]"
+				entity_string = ""
+				entity_type = "Error"
+				entity_source = "Error"
+			# print(new_string)
+			new_string += origin_text[idx]
+
+		elif combine_list[idx].startswith("B-"):
+			if entity_string:
+				new_string += "["+entity_source + entity_string + "#" + entity_type+"*]"
+				entity_string = ""
+				entity_type = "Error"
+				entity_source = "Error"
+			entity_string = origin_text[idx]
+			entity_type = combine_list[idx][4:]
+			entity_source = combine_list[idx][2:3]
+		elif combine_list[idx].startswith("I-"):
+			entity_string += origin_text[idx]
+		else:
+			print("merge_text_with_entity error!")
+	if entity_string:
+		new_string += "["+entity_source + entity_string + "#" + entity_type +"*]"
+		entity_string = ""
+		entity_type = "Error"
+		entity_source = "Error"
+	return new_string
+
+
+if __name__ == '__main__':
+	train_text = u"于是我就给[@朱物华#Location*]校长、[@张钟俊#Location*]院长给他们写了一个报告!"
+	decode_text = u"张钟俊院长，给他[$张钟俊#Location*][$张钟俊#Location*]..[@朱物华#Location*]."
+	print(maximum_matching(train_text, decode_text))
\ No newline at end of file