Users have reported several issues with the WALS Roberta Sets 136.zip file, including:

If "sets" refers to the WALS linguistic feature sets being mapped to a RoBERTa tokenizer:

Before altering your Python scripts or model architectures, confirm that the file is not corrupted. You can force-check the integrity of the zip container via the command line.