ValueError: [E103]

[Huzmorgoth]

I get the error mentioned below while training, even when I used the same code.

ValueError: [E103] Trying to set conflicting doc.ents: '(6861, 6870, 'Companies worked at')' and '(6305, 7258, 'Skills')'. A token can only be part of one entity, so make sure the entities you're setting don't overlap.

[Abhimanyu100]

@Huzmorgoth paste this code
`# trim some entity
def trim_entity_spans(data: list) -> list:

invalid_span_tokens = re.compile(r'\s')
cleaned_data = []
for text, annotations in data:
    entities = annotations['entities']
    valid_entities = []
    for start, end, label in entities:
        valid_start = start
        valid_end = end
        while valid_start < len(text) and invalid_span_tokens.match(
                text[valid_start]):
            valid_start += 1
        while valid_end > 1 and invalid_span_tokens.match(
                text[valid_end - 1]):
            valid_end -= 1
        valid_entities.append([valid_start, valid_end, label])
    cleaned_data.append([text, {'entities': valid_entities}])

return cleaned_data`

[Huzmorgoth]

@Abhimanyu100
Hi, I tried but it's not working, the same issue occurring.

---

Statring iteration 0
Traceback (most recent call last):

File "", line 1, in
.
.
.
_format_docs_and_golds
gold = GoldParse(doc, **gold)

File "gold.pyx", line 715, in spacy.gold.GoldParse.init

File "gold.pyx", line 925, in spacy.gold.biluo_tags_from_offsets

ValueError: [E103] Trying to set conflicting doc.ents: '(3385, 3391, 'Companies worked at')' and '(3345, 3896, 'Skills')'. A token can only be part of one entity, so make sure the entities you're setting don't overlap.

[Nisit007]

i also have this error..

ValueError: [E103] Trying to set conflicting doc.ents: '(370, 392, 'Designation')' and '(370, 391, 'Designation')'. A token can only be part of one entity, so make sure the entities you're setting don't overlap.

[Abhimanyu100]

[Edit] Which spacy version you are using? I'm able to resolve this issue.

[Huzmorgoth]

Python 3

[Abhimanyu100]

I'm sorry. I was asking for Spacy version.

[Huzmorgoth]

Oh damn, it's 2.2.2

[Abhimanyu100]

Use Spacy version 2.1.4 I was able to get results with this library. Let me know if this works for you.

[sayalraza]

I am using spacy 2.2.3. In the older version of spacy, there was a bug which messed up the model after loading from disk. So, I had to update spacy and when I updated, I came across this issue. Sadly, I couldn't find a workaround and had to manually remove all conflicting entities. I have both testdata.json and traindata.json with cleaned data which will not raise this error. But I am not able to attach json format here.

[vverman]

I am using spacy 2.2.3. In the older version of spacy, there was a bug which messed up the model after loading from disk. So, I had to update spacy and when I updated, I came across this issue. Sadly, I couldn't find a workaround and had to manually remove all conflicting entities. I have both testdata.json and traindata.json with cleaned data which will not raise this error. But I am not able to attach json format here.

Hey could you post it in your own git and share the file?

[Srijha09]

I got the same error as well.
ValueError: [E103] Trying to set conflicting doc.ents: '(6861, 6870, 'Companies worked at')' and '(6305, 7258, 'Skills')'. A token can only be part of one entity, so make sure the entities you're setting don't overlap.
It would be very helpful if someone can help out

[JasonLing95]

I am using spacy 2.2.3. In the older version of spacy, there was a bug which messed up the model after loading from disk. So, I had to update spacy and when I updated, I came across this issue. Sadly, I couldn't find a workaround and had to manually remove all conflicting entities. I have both testdata.json and traindata.json with cleaned data which will not raise this error. But I am not able to attach json format here.

Hi, could you share the test and train.json. Thank you

[B-Yassine]

I am encounteering the same problem: ValueError: [E103] Trying to set conflicting doc.ents: '(1155, 1199, 'Email Address')' and '(1143, 1240, 'Links')'. A token can only be part of one entity, so make sure the entities you're setting don't overlap.

Did you guys figure out a way to resolve it?