Xtykutl

I have a txt file I'm trying to make lists from. The txt file has 3 columns tab separated (index, word, tag).

Example of the txt file:

1   i   PRP

2   want    VBP

3   to  TO

4   go  VB

What I'm trying to do is add a beginning and end of sentence marker (<s> for beginning and </s> for the end).

My code is as follows:

trainfile=open("/Users/Desktop/training.txt").read().split('n')

from collections import Counter, defaultdict



trainlines=



for line in trainfile:

    trainlines.append(line)



indexlist=

wordlist=

taglist=



word_tag_counts = defaultdict(Counter)

for line in trainlines:

    if not line.strip():

        continue

    index, word, tags = line.split()

    word_tag_counts[word.lower()][tags] += 1

    indexlist.append(index)

    if index == "1":

        indexlist.insert(0, '0')

        wordlist.insert(0, '<s>')

        taglist.insert(0, '<s>')

    else:

        indexlist.append(index)

        wordlist.append(word)

        taglist.append(tags)

        if word == '.':

            taglist.append('</s>')

            wordlist.append('</s>')

        else:

            continue

The issue I'm having is my results for the indexlist are:

['0', '0', '0', '0', '0', '0', '0', '0', '0', '0', '0',...]

and wordlist and taglist are the same problem:

['<s>', '<s>', '<s>', '<s>', '<s>', '<s>', '<s>', '<s>', '<s>',...]

Why is the inserted property the only thing thats showing up in my entire list?

What I want for a final result is:

indexlist: [0, 1, 2, 3, 4, 5, 6, 0, 1, 2...]

wordlist: [<s>, i, want, to, go, home, </s>, <s>, ...]