Skip to content

test_decode

handler(err)

Handle UnicodeDecodeError.

Parameters:

Name Type Description Default
err UnicodeDecodeError

the error.

 required

Returns:

Type Description
str

The fixed string
Source code in corpustools/test/test_decode.py 
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
def handler(err):
    """Handle UnicodeDecodeError.

    Args:
        err (exceptions.UnicodeDecodeError): the error.

    Returns:
        (str): The fixed string
    """
    start = err.start
    end = err.end
    return (
        "".join([f"&#{err.object[i]};" for i in range(start, end)]),
        end,
    )