Skip to content

Commit

Permalink
Integrates changes from Wycliffe-USA#62 into new dev dir structure. C…
Browse files Browse the repository at this point in the history
…onnects Wycliffe-USA#25.
  • Loading branch information
Bren Briggs committed Jan 23, 2016
1 parent 463ad15 commit 88ce273
Show file tree
Hide file tree
Showing 10 changed files with 109,952 additions and 78,851 deletions.
15,916 changes: 7,958 additions & 7,958 deletions webserver/data/asv_plain.txt

Large diffs are not rendered by default.

31,104 changes: 31,103 additions & 1 deletion webserver/data/asv_tokenized.txt

Large diffs are not rendered by default.

15,914 changes: 7,957 additions & 7,957 deletions webserver/data/spanish_plain.txt

Large diffs are not rendered by default.

31,103 changes: 31,102 additions & 1 deletion webserver/data/spanish_tokenized.txt

Large diffs are not rendered by default.

15,916 changes: 7,958 additions & 7,958 deletions webserver/tests/data/asv_plain.txt

Large diffs are not rendered by default.

15,916 changes: 7,958 additions & 7,958 deletions webserver/tests/data/asv_tokenized.txt

Large diffs are not rendered by default.

15,914 changes: 7,957 additions & 7,957 deletions webserver/tests/data/spanish_plain.txt

Large diffs are not rendered by default.

31,102 changes: 0 additions & 31,102 deletions webserver/tests/data/spanish_plain.txt.out

This file was deleted.

15,914 changes: 7,957 additions & 7,957 deletions webserver/tests/data/spanish_tokenized.txt

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions webserver/tools/unbound2plain.py
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ def unbound2plain(infile,outfile):
with open(infile) as source:
for line in source:
if not line.startswith('#'):
line = re.sub(r'^[\d\sOn]+\t','', line)
line = re.sub(r'^[\d\sON]+\t','', line)
line = re.sub(r'\r\n$','\n',line)
tmp_file.write(line)
source.close()
Expand All @@ -32,4 +32,4 @@ def main(infile,outfile):
parser.add_argument('infile', metavar='source', type=str, nargs=1, help='the Unbound formatted text. Usually ends in _8tf8.txt')
parser.add_argument('outfile', metavar='dest', type=str, nargs=1, help='file to write for output. Be sure to include your correct suffix (ie, .txt)')
args = parser.parse_args()
main(args.infile[0],args.outfile[0])
main(args.infile[0],args.outfile[0])

0 comments on commit 88ce273

Please sign in to comment.