注意
单击此处下载完整的示例代码
TorchMultimodal 教程：微调 FLAVA¶
创建时间： 2022年10月27日 |上次更新时间：2023 年 4 月 11 日 |上次验证： Nov 05， 2024
多模态 AI 最近变得非常流行，因为它无处不在 nature，从图像字幕和视觉搜索等用例 最近的应用程序，例如从文本生成图像。Torch多模态 是由 Pytorch 提供支持的库，由构建块和端到端的 结束示例，旨在实现和加速 多模态。
在本教程中，我们将演示如何使用预训练的 SoTA 名为 FLAVA 的模型来自 TorchMultimodal 库，用于微调多模态任务，即视觉对象 问答 （VQA）。该模型由两个单峰变压器组成 基于文本和图像的编码器以及要组合的多模态编码器 两个嵌入向量。它使用对比、图像文本匹配和 文本、图像和多模态掩码损失。
安装¶
为此，我们将使用 TextVQA 数据集和 Hugging Face
教程。因此，除了 TorchMultimodal 之外，您还需要安装 datasets 和 transformers。bert tokenizer
注意
在 Google Colab 中运行本教程时，请通过以下方式安装所需的软件包 创建新单元并运行以下命令：
!pip install torchmultimodal-nightly
!pip install datasets
!pip install transformers
步骤¶
通过运行以下命令，将 Hugging Face 数据集下载到计算机上的目录：
wget http://dl.fbaipublicfiles.com/pythia/data/vocab.tar.gz tar xf vocab.tar.gz
注意
如果您在 Google Colab 中运行本教程，请运行以下命令 并在这些命令前面加上感叹号 （！）
在本教程中，我们将 VQA 视为一个分类任务，其中 输入是 images 和 question （text），输出是 answer 类。 所以我们需要下载带有 answer classes 的 vocab 文件，并创建答案 标签映射。
我们还加载了 textvqa 包含 34602 个训练样本的数据集 （图片、问题和答案） 来自 Hugging Face
我们看到有 3997 个答案类，包括一个表示 未知答案。
with open("data/vocabs/answers_textvqa_more_than_1.txt") as f:
vocab = f.readlines()
answer_to_idx = {}
for idx, entry in enumerate(vocab):
answer_to_idx[entry.strip("\n")] = idx
print(len(vocab))
print(vocab[:5])
from datasets import load_dataset
dataset = load_dataset("textvqa")
3997
['<unk>\n', 'nokia\n', 'ec\n', 'virgin\n', '2011\n']
/usr/local/lib/python3.10/dist-packages/datasets/load.py:1491: FutureWarning:
The repository for textvqa contains custom code which must be executed to correctly load the dataset. You can inspect the repository content at https://hf.co/datasets/textvqa
You can avoid this message in future by passing the argument `trust_remote_code=True`.
Passing `trust_remote_code=True` will be mandatory to load this dataset from the next major release of `datasets`.
Downloading builder script: 0%| | 0.00/5.02k [00:00<?, ?B/s]
Downloading builder script: 100%|##########| 5.02k/5.02k [00:00<00:00, 26.9MB/s]
Downloading readme: 0%| | 0.00/13.2k [00:00<?, ?B/s]
Downloading readme: 100%|##########| 13.2k/13.2k [00:00<00:00, 37.7MB/s]
Downloading data: 0%| | 0.00/21.6M [00:00<?, ?B/s]
Downloading data: 40%|#### | 8.66M/21.6M [00:00<00:00, 86.6MB/s]
Downloading data: 83%|########2 | 17.9M/21.6M [00:00<00:00, 89.8MB/s]
Downloading data: 100%|##########| 21.6M/21.6M [00:00<00:00, 90.3MB/s]
Downloading data: 0.00B [00:00, ?B/s]
Downloading data: 3.12MB [00:00, 152MB/s]
Downloading data: 0.00B [00:00, ?B/s]
Downloading data: 2.77MB [00:00, 167MB/s]
Downloading data: 0%| | 0.00/7.07G [00:00<?, ?B/s]
Downloading data: 0%| | 8.20M/7.07G [00:00<01:26, 82.0MB/s]
Downloading data: 0%| | 17.0M/7.07G [00:00<01:22, 85.8MB/s]
Downloading data: 0%| | 26.1M/7.07G [00:00<01:19, 88.1MB/s]
Downloading data: 0%| | 35.2M/7.07G [00:00<01:18, 89.2MB/s]
Downloading data: 1%| | 44.2M/7.07G [00:00<01:18, 89.5MB/s]
Downloading data: 1%| | 53.4M/7.07G [00:00<01:17, 90.2MB/s]
Downloading data: 1%| | 62.4M/7.07G [00:00<01:17, 90.0MB/s]
Downloading data: 1%|1 | 71.5M/7.07G [00:00<01:17, 90.2MB/s]
Downloading data: 1%|1 | 80.7M/7.07G [00:00<01:17, 90.7MB/s]
Downloading data: 1%|1 | 89.8M/7.07G [00:01<01:16, 90.9MB/s]
Downloading data: 1%|1 | 98.9M/7.07G [00:01<01:16, 90.8MB/s]
Downloading data: 2%|1 | 108M/7.07G [00:01<01:16, 90.6MB/s]
Downloading data: 2%|1 | 117M/7.07G [00:01<01:17, 90.2MB/s]
Downloading data: 2%|1 | 126M/7.07G [00:01<01:16, 90.7MB/s]
Downloading data: 2%|1 | 135M/7.07G [00:01<01:16, 90.6MB/s]
Downloading data: 2%|2 | 144M/7.07G [00:01<01:16, 90.2MB/s]
Downloading data: 2%|2 | 153M/7.07G [00:01<01:16, 90.0MB/s]
Downloading data: 2%|2 | 162M/7.07G [00:01<01:16, 90.2MB/s]
Downloading data: 2%|2 | 171M/7.07G [00:01<01:16, 90.2MB/s]
Downloading data: 3%|2 | 180M/7.07G [00:02<01:16, 90.0MB/s]
Downloading data: 3%|2 | 189M/7.07G [00:02<01:16, 89.6MB/s]
Downloading data: 3%|2 | 198M/7.07G [00:02<01:16, 89.7MB/s]
Downloading data: 3%|2 | 207M/7.07G [00:02<01:16, 89.7MB/s]
Downloading data: 3%|3 | 217M/7.07G [00:02<01:16, 90.0MB/s]
Downloading data: 3%|3 | 226M/7.07G [00:02<01:15, 90.1MB/s]
Downloading data: 3%|3 | 235M/7.07G [00:02<01:15, 90.7MB/s]
Downloading data: 3%|3 | 244M/7.07G [00:02<01:15, 90.6MB/s]
Downloading data: 4%|3 | 253M/7.07G [00:02<01:14, 91.0MB/s]
Downloading data: 4%|3 | 262M/7.07G [00:02<01:14, 91.3MB/s]
Downloading data: 4%|3 | 271M/7.07G [00:03<01:14, 90.8MB/s]
Downloading data: 4%|3 | 280M/7.07G [00:03<01:15, 90.4MB/s]
Downloading data: 4%|4 | 290M/7.07G [00:03<01:15, 90.1MB/s]
Downloading data: 4%|4 | 299M/7.07G [00:03<01:15, 90.3MB/s]
Downloading data: 4%|4 | 308M/7.07G [00:03<01:14, 90.6MB/s]
Downloading data: 4%|4 | 317M/7.07G [00:03<01:14, 91.1MB/s]
Downloading data: 5%|4 | 326M/7.07G [00:03<01:13, 91.4MB/s]
Downloading data: 5%|4 | 335M/7.07G [00:03<01:13, 91.6MB/s]
Downloading data: 5%|4 | 345M/7.07G [00:03<01:13, 91.7MB/s]
Downloading data: 5%|5 | 354M/7.07G [00:03<01:13, 92.0MB/s]
Downloading data: 5%|5 | 363M/7.07G [00:04<01:12, 92.1MB/s]
Downloading data: 5%|5 | 372M/7.07G [00:04<01:12, 91.9MB/s]
Downloading data: 5%|5 | 381M/7.07G [00:04<01:12, 91.9MB/s]
Downloading data: 6%|5 | 391M/7.07G [00:04<01:12, 92.0MB/s]
Downloading data: 6%|5 | 400M/7.07G [00:04<01:12, 91.9MB/s]
Downloading data: 6%|5 | 409M/7.07G [00:04<01:12, 91.9MB/s]
Downloading data: 6%|5 | 418M/7.07G [00:04<01:12, 92.0MB/s]
Downloading data: 6%|6 | 428M/7.07G [00:04<01:12, 92.1MB/s]
Downloading data: 6%|6 | 437M/7.07G [00:04<01:11, 92.4MB/s]
Downloading data: 6%|6 | 446M/7.07G [00:04<01:11, 92.4MB/s]
Downloading data: 6%|6 | 455M/7.07G [00:05<01:11, 92.4MB/s]
Downloading data: 7%|6 | 465M/7.07G [00:05<01:11, 92.2MB/s]
Downloading data: 7%|6 | 474M/7.07G [00:05<01:11, 92.1MB/s]
Downloading data: 7%|6 | 483M/7.07G [00:05<01:11, 92.0MB/s]
Downloading data: 7%|6 | 492M/7.07G [00:05<01:11, 92.2MB/s]
Downloading data: 7%|7 | 501M/7.07G [00:05<01:11, 92.1MB/s]
Downloading data: 7%|7 | 511M/7.07G [00:05<01:11, 92.0MB/s]
Downloading data: 7%|7 | 520M/7.07G [00:05<01:11, 92.2MB/s]
Downloading data: 7%|7 | 529M/7.07G [00:05<01:10, 92.4MB/s]
Downloading data: 8%|7 | 538M/7.07G [00:05<01:10, 92.3MB/s]
Downloading data: 8%|7 | 548M/7.07G [00:06<01:10, 92.2MB/s]
Downloading data: 8%|7 | 557M/7.07G [00:06<01:10, 92.0MB/s]
Downloading data: 8%|8 | 566M/7.07G [00:06<01:10, 91.9MB/s]
Downloading data: 8%|8 | 575M/7.07G [00:06<01:10, 92.0MB/s]
Downloading data: 8%|8 | 585M/7.07G [00:06<01:10, 91.7MB/s]
Downloading data: 8%|8 | 594M/7.07G [00:06<01:10, 91.6MB/s]
Downloading data: 9%|8 | 603M/7.07G [00:06<01:10, 91.6MB/s]
Downloading data: 9%|8 | 612M/7.07G [00:06<01:10, 91.6MB/s]
Downloading data: 9%|8 | 621M/7.07G [00:06<01:10, 91.6MB/s]
Downloading data: 9%|8 | 630M/7.07G [00:06<01:10, 91.3MB/s]
Downloading data: 9%|9 | 640M/7.07G [00:07<01:10, 91.3MB/s]
Downloading data: 9%|9 | 649M/7.07G [00:07<01:10, 91.5MB/s]
Downloading data: 9%|9 | 658M/7.07G [00:07<01:10, 91.6MB/s]
Downloading data: 9%|9 | 667M/7.07G [00:07<01:10, 91.4MB/s]
Downloading data: 10%|9 | 676M/7.07G [00:07<01:09, 91.6MB/s]
Downloading data: 10%|9 | 685M/7.07G [00:07<01:09, 91.8MB/s]
Downloading data: 10%|9 | 695M/7.07G [00:07<01:09, 91.6MB/s]
Downloading data: 10%|9 | 704M/7.07G [00:07<01:09, 91.6MB/s]
Downloading data: 10%|# | 713M/7.07G [00:07<01:09, 91.9MB/s]
Downloading data: 10%|# | 722M/7.07G [00:07<01:09, 91.9MB/s]
Downloading data: 10%|# | 732M/7.07G [00:08<01:08, 91.9MB/s]
Downloading data: 10%|# | 741M/7.07G [00:08<01:08, 92.0MB/s]
Downloading data: 11%|# | 750M/7.07G [00:08<01:08, 92.2MB/s]
Downloading data: 11%|# | 759M/7.07G [00:08<01:08, 91.9MB/s]
Downloading data: 11%|# | 768M/7.07G [00:08<01:08, 92.1MB/s]
Downloading data: 11%|# | 778M/7.07G [00:08<01:08, 92.2MB/s]
Downloading data: 11%|#1 | 787M/7.07G [00:08<01:08, 92.3MB/s]
Downloading data: 11%|#1 | 796M/7.07G [00:08<01:07, 92.5MB/s]
Downloading data: 11%|#1 | 806M/7.07G [00:08<01:07, 92.7MB/s]
Downloading data: 12%|#1 | 815M/7.07G [00:08<01:07, 92.6MB/s]
Downloading data: 12%|#1 | 824M/7.07G [00:09<01:07, 92.9MB/s]
Downloading data: 12%|#1 | 833M/7.07G [00:09<01:07, 93.0MB/s]
Downloading data: 12%|#1 | 843M/7.07G [00:09<01:07, 92.8MB/s]
Downloading data: 12%|#2 | 852M/7.07G [00:09<01:06, 93.0MB/s]
Downloading data: 12%|#2 | 861M/7.07G [00:09<01:06, 93.0MB/s]
Downloading data: 12%|#2 | 871M/7.07G [00:09<01:06, 93.1MB/s]
Downloading data: 12%|#2 | 880M/7.07G [00:09<01:06, 93.1MB/s]
Downloading data: 13%|#2 | 889M/7.07G [00:09<01:06, 93.3MB/s]
Downloading data: 13%|#2 | 899M/7.07G [00:09<01:06, 93.3MB/s]
Downloading data: 13%|#2 | 908M/7.07G [00:09<01:05, 93.5MB/s]
Downloading data: 13%|#2 | 918M/7.07G [00:10<01:06, 93.1MB/s]
Downloading data: 13%|#3 | 927M/7.07G [00:10<01:05, 93.4MB/s]
Downloading data: 13%|#3 | 936M/7.07G [00:10<01:05, 93.4MB/s]
Downloading data: 13%|#3 | 946M/7.07G [00:10<01:05, 93.2MB/s]
Downloading data: 14%|#3 | 955M/7.07G [00:10<01:05, 93.0MB/s]
Downloading data: 14%|#3 | 964M/7.07G [00:10<01:05, 93.2MB/s]
Downloading data: 14%|#3 | 974M/7.07G [00:10<01:05, 93.1MB/s]
Downloading data: 14%|#3 | 983M/7.07G [00:10<01:05, 93.0MB/s]
Downloading data: 14%|#4 | 992M/7.07G [00:10<01:05, 93.0MB/s]
Downloading data: 14%|#4 | 1.00G/7.07G [00:10<01:05, 93.0MB/s]
Downloading data: 14%|#4 | 1.01G/7.07G [00:11<01:05, 93.1MB/s]
Downloading data: 14%|#4 | 1.02G/7.07G [00:11<01:05, 92.9MB/s]
Downloading data: 15%|#4 | 1.03G/7.07G [00:11<01:04, 93.0MB/s]
Downloading data: 15%|#4 | 1.04G/7.07G [00:11<01:04, 93.1MB/s]
Downloading data: 15%|#4 | 1.05G/7.07G [00:11<01:04, 92.9MB/s]
Downloading data: 15%|#4 | 1.06G/7.07G [00:11<01:04, 92.6MB/s]
Downloading data: 15%|#5 | 1.07G/7.07G [00:11<01:05, 92.4MB/s]
Downloading data: 15%|#5 | 1.08G/7.07G [00:11<01:04, 92.3MB/s]
Downloading data: 15%|#5 | 1.09G/7.07G [00:11<01:04, 92.4MB/s]
Downloading data: 15%|#5 | 1.09G/7.07G [00:11<01:05, 91.9MB/s]
Downloading data: 16%|#5 | 1.10G/7.07G [00:12<01:05, 91.7MB/s]
Downloading data: 16%|#5 | 1.11G/7.07G [00:12<01:04, 91.8MB/s]
Downloading data: 16%|#5 | 1.12G/7.07G [00:12<01:04, 91.8MB/s]
Downloading data: 16%|#5 | 1.13G/7.07G [00:12<01:04, 91.7MB/s]
Downloading data: 16%|#6 | 1.14G/7.07G [00:12<01:04, 91.6MB/s]
Downloading data: 16%|#6 | 1.15G/7.07G [00:12<01:04, 91.6MB/s]
Downloading data: 16%|#6 | 1.16G/7.07G [00:12<01:04, 91.6MB/s]
Downloading data: 17%|#6 | 1.17G/7.07G [00:12<01:04, 91.6MB/s]
Downloading data: 17%|#6 | 1.18G/7.07G [00:12<01:04, 91.5MB/s]
Downloading data: 17%|#6 | 1.19G/7.07G [00:12<01:04, 91.5MB/s]
Downloading data: 17%|#6 | 1.20G/7.07G [00:13<01:04, 91.5MB/s]
Downloading data: 17%|#7 | 1.20G/7.07G [00:13<01:04, 91.4MB/s]
Downloading data: 17%|#7 | 1.21G/7.07G [00:13<01:04, 91.4MB/s]
Downloading data: 17%|#7 | 1.22G/7.07G [00:13<01:04, 91.4MB/s]
Downloading data: 17%|#7 | 1.23G/7.07G [00:13<01:03, 91.5MB/s]
Downloading data: 18%|#7 | 1.24G/7.07G [00:13<01:03, 91.5MB/s]
Downloading data: 18%|#7 | 1.25G/7.07G [00:13<01:03, 91.8MB/s]
Downloading data: 18%|#7 | 1.26G/7.07G [00:13<01:03, 91.6MB/s]
Downloading data: 18%|#7 | 1.27G/7.07G [00:13<01:03, 91.4MB/s]
Downloading data: 18%|#8 | 1.28G/7.07G [00:13<01:03, 91.4MB/s]
Downloading data: 18%|#8 | 1.29G/7.07G [00:14<01:03, 91.6MB/s]
Downloading data: 18%|#8 | 1.30G/7.07G [00:14<01:02, 91.8MB/s]
Downloading data: 18%|#8 | 1.31G/7.07G [00:14<01:02, 91.8MB/s]
Downloading data: 19%|#8 | 1.31G/7.07G [00:14<01:02, 91.9MB/s]
Downloading data: 19%|#8 | 1.32G/7.07G [00:14<01:02, 91.9MB/s]
Downloading data: 19%|#8 | 1.33G/7.07G [00:14<01:02, 91.7MB/s]
Downloading data: 19%|#8 | 1.34G/7.07G [00:14<01:02, 91.6MB/s]
Downloading data: 19%|#9 | 1.35G/7.07G [00:14<01:02, 91.6MB/s]
Downloading data: 19%|#9 | 1.36G/7.07G [00:14<01:02, 91.6MB/s]
Downloading data: 19%|#9 | 1.37G/7.07G [00:14<01:02, 91.9MB/s]
Downloading data: 19%|#9 | 1.38G/7.07G [00:15<01:01, 92.0MB/s]
Downloading data: 20%|#9 | 1.39G/7.07G [00:15<01:01, 92.1MB/s]
Downloading data: 20%|#9 | 1.40G/7.07G [00:15<01:01, 92.2MB/s]
Downloading data: 20%|#9 | 1.41G/7.07G [00:15<01:01, 92.3MB/s]
Downloading data: 20%|## | 1.42G/7.07G [00:15<01:01, 92.3MB/s]
Downloading data: 20%|## | 1.43G/7.07G [00:15<01:01, 92.4MB/s]
Downloading data: 20%|## | 1.43G/7.07G [00:15<01:00, 92.6MB/s]
Downloading data: 20%|## | 1.44G/7.07G [00:15<01:00, 92.6MB/s]
Downloading data: 21%|## | 1.45G/7.07G [00:15<01:00, 92.8MB/s]
Downloading data: 21%|## | 1.46G/7.07G [00:15<01:00, 92.8MB/s]
Downloading data: 21%|## | 1.47G/7.07G [00:16<01:00, 92.8MB/s]
Downloading data: 21%|## | 1.48G/7.07G [00:16<01:00, 92.8MB/s]
Downloading data: 21%|##1 | 1.49G/7.07G [00:16<01:00, 93.0MB/s]
Downloading data: 21%|##1 | 1.50G/7.07G [00:16<00:59, 93.1MB/s]
Downloading data: 21%|##1 | 1.51G/7.07G [00:16<00:59, 92.9MB/s]
Downloading data: 21%|##1 | 1.52G/7.07G [00:16<00:59, 92.8MB/s]
Downloading data: 22%|##1 | 1.53G/7.07G [00:16<00:59, 93.0MB/s]
Downloading data: 22%|##1 | 1.54G/7.07G [00:16<00:59, 93.0MB/s]
Downloading data: 22%|##1 | 1.55G/7.07G [00:16<00:59, 93.0MB/s]
Downloading data: 22%|##1 | 1.56G/7.07G [00:16<00:59, 92.8MB/s]
Downloading data: 22%|##2 | 1.56G/7.07G [00:17<00:59, 92.9MB/s]
Downloading data: 22%|##2 | 1.57G/7.07G [00:17<00:59, 92.9MB/s]
Downloading data: 22%|##2 | 1.58G/7.07G [00:17<00:59, 92.9MB/s]
Downloading data: 23%|##2 | 1.59G/7.07G [00:17<00:59, 92.6MB/s]
Downloading data: 23%|##2 | 1.60G/7.07G [00:17<00:59, 92.4MB/s]
Downloading data: 23%|##2 | 1.61G/7.07G [00:17<00:59, 92.2MB/s]
Downloading data: 23%|##2 | 1.62G/7.07G [00:17<00:59, 91.9MB/s]
Downloading data: 23%|##3 | 1.63G/7.07G [00:17<00:59, 91.9MB/s]
Downloading data: 23%|##3 | 1.64G/7.07G [00:17<00:59, 92.0MB/s]
Downloading data: 23%|##3 | 1.65G/7.07G [00:17<00:59, 91.9MB/s]
Downloading data: 23%|##3 | 1.66G/7.07G [00:18<00:58, 92.2MB/s]
Downloading data: 24%|##3 | 1.67G/7.07G [00:18<00:58, 92.2MB/s]
Downloading data: 24%|##3 | 1.68G/7.07G [00:18<00:58, 92.1MB/s]
Downloading data: 24%|##3 | 1.68G/7.07G [00:18<00:58, 92.1MB/s]
Downloading data: 24%|##3 | 1.69G/7.07G [00:18<00:58, 92.0MB/s]
Downloading data: 24%|##4 | 1.70G/7.07G [00:18<00:58, 92.1MB/s]
Downloading data: 24%|##4 | 1.71G/7.07G [00:18<00:58, 92.1MB/s]
Downloading data: 24%|##4 | 1.72G/7.07G [00:18<00:58, 91.8MB/s]
Downloading data: 24%|##4 | 1.73G/7.07G [00:18<00:58, 91.8MB/s]
Downloading data: 25%|##4 | 1.74G/7.07G [00:18<00:58, 91.7MB/s]
Downloading data: 25%|##4 | 1.75G/7.07G [00:19<00:58, 91.7MB/s]
Downloading data: 25%|##4 | 1.76G/7.07G [00:19<00:57, 91.8MB/s]
Downloading data: 25%|##4 | 1.77G/7.07G [00:19<00:57, 92.0MB/s]
Downloading data: 25%|##5 | 1.78G/7.07G [00:19<00:57, 92.1MB/s]
Downloading data: 25%|##5 | 1.79G/7.07G [00:19<00:57, 92.3MB/s]
Downloading data: 25%|##5 | 1.80G/7.07G [00:19<00:57, 92.4MB/s]
Downloading data: 26%|##5 | 1.80G/7.07G [00:19<00:56, 92.6MB/s]
Downloading data: 26%|##5 | 1.81G/7.07G [00:19<00:56, 92.5MB/s]
Downloading data: 26%|##5 | 1.82G/7.07G [00:19<00:56, 92.4MB/s]
Downloading data: 26%|##5 | 1.83G/7.07G [00:19<00:56, 92.3MB/s]
Downloading data: 26%|##6 | 1.84G/7.07G [00:20<00:56, 92.3MB/s]
Downloading data: 26%|##6 | 1.85G/7.07G [00:20<00:56, 92.5MB/s]
Downloading data: 26%|##6 | 1.86G/7.07G [00:20<00:56, 92.3MB/s]
Downloading data: 26%|##6 | 1.87G/7.07G [00:20<00:56, 92.3MB/s]
Downloading data: 27%|##6 | 1.88G/7.07G [00:20<00:56, 92.3MB/s]
Downloading data: 27%|##6 | 1.89G/7.07G [00:20<00:56, 92.3MB/s]
Downloading data: 27%|##6 | 1.90G/7.07G [00:20<00:56, 92.2MB/s]
Downloading data: 27%|##6 | 1.91G/7.07G [00:20<00:55, 92.2MB/s]
Downloading data: 27%|##7 | 1.92G/7.07G [00:20<00:55, 92.5MB/s]
Downloading data: 27%|##7 | 1.93G/7.07G [00:20<00:55, 92.6MB/s]
Downloading data: 27%|##7 | 1.93G/7.07G [00:21<00:55, 92.5MB/s]
Downloading data: 27%|##7 | 1.94G/7.07G [00:21<00:55, 92.0MB/s]
Downloading data: 28%|##7 | 1.95G/7.07G [00:21<00:55, 92.2MB/s]
Downloading data: 28%|##7 | 1.96G/7.07G [00:21<00:55, 92.5MB/s]
Downloading data: 28%|##7 | 1.97G/7.07G [00:21<00:55, 92.5MB/s]
Downloading data: 28%|##8 | 1.98G/7.07G [00:21<00:55, 92.4MB/s]
Downloading data: 28%|##8 | 1.99G/7.07G [00:21<00:54, 92.4MB/s]
Downloading data: 28%|##8 | 2.00G/7.07G [00:21<00:54, 92.4MB/s]
Downloading data: 28%|##8 | 2.01G/7.07G [00:21<00:54, 92.4MB/s]
Downloading data: 29%|##8 | 2.02G/7.07G [00:21<00:54, 92.5MB/s]
Downloading data: 29%|##8 | 2.03G/7.07G [00:22<00:54, 92.6MB/s]
Downloading data: 29%|##8 | 2.04G/7.07G [00:22<00:54, 92.6MB/s]
Downloading data: 29%|##8 | 2.05G/7.07G [00:22<00:54, 92.5MB/s]
Downloading data: 29%|##9 | 2.05G/7.07G [00:22<00:54, 92.4MB/s]
Downloading data: 29%|##9 | 2.06G/7.07G [00:22<00:54, 92.4MB/s]
Downloading data: 29%|##9 | 2.07G/7.07G [00:22<00:54, 92.3MB/s]
Downloading data: 29%|##9 | 2.08G/7.07G [00:22<00:54, 92.4MB/s]
Downloading data: 30%|##9 | 2.09G/7.07G [00:22<00:53, 92.6MB/s]
Downloading data: 30%|##9 | 2.10G/7.07G [00:22<00:53, 92.7MB/s]
Downloading data: 30%|##9 | 2.11G/7.07G [00:22<00:53, 92.7MB/s]
Downloading data: 30%|##9 | 2.12G/7.07G [00:23<00:53, 92.7MB/s]
Downloading data: 30%|### | 2.13G/7.07G [00:23<00:53, 92.8MB/s]
Downloading data: 30%|### | 2.14G/7.07G [00:23<00:53, 92.4MB/s]
Downloading data: 30%|### | 2.15G/7.07G [00:23<00:53, 92.7MB/s]
Downloading data: 30%|### | 2.16G/7.07G [00:23<00:52, 92.8MB/s]
Downloading data: 31%|### | 2.17G/7.07G [00:23<00:52, 92.7MB/s]
Downloading data: 31%|### | 2.18G/7.07G [00:23<00:52, 92.8MB/s]
Downloading data: 31%|### | 2.18G/7.07G [00:23<00:52, 92.7MB/s]
Downloading data: 31%|###1 | 2.19G/7.07G [00:23<00:52, 92.6MB/s]
Downloading data: 31%|###1 | 2.20G/7.07G [00:23<00:52, 92.5MB/s]
Downloading data: 31%|###1 | 2.21G/7.07G [00:24<00:52, 92.4MB/s]
Downloading data: 31%|###1 | 2.22G/7.07G [00:24<00:52, 92.2MB/s]
Downloading data: 32%|###1 | 2.23G/7.07G [00:24<00:52, 91.8MB/s]
Downloading data: 32%|###1 | 2.24G/7.07G [00:24<00:52, 91.9MB/s]
Downloading data: 32%|###1 | 2.25G/7.07G [00:24<00:52, 91.6MB/s]
Downloading data: 32%|###1 | 2.26G/7.07G [00:24<00:52, 91.7MB/s]
Downloading data: 32%|###2 | 2.27G/7.07G [00:24<00:52, 91.6MB/s]
Downloading data: 32%|###2 | 2.28G/7.07G [00:24<00:52, 91.6MB/s]
Downloading data: 32%|###2 | 2.29G/7.07G [00:24<00:52, 91.9MB/s]
Downloading data: 32%|###2 | 2.30G/7.07G [00:24<00:51, 92.0MB/s]
Downloading data: 33%|###2 | 2.30G/7.07G [00:25<00:51, 92.2MB/s]
Downloading data: 33%|###2 | 2.31G/7.07G [00:25<00:51, 92.1MB/s]
Downloading data: 33%|###2 | 2.32G/7.07G [00:25<00:51, 91.8MB/s]
Downloading data: 33%|###2 | 2.33G/7.07G [00:25<00:51, 91.7MB/s]
Downloading data: 33%|###3 | 2.34G/7.07G [00:25<00:51, 91.7MB/s]
Downloading data: 33%|###3 | 2.35G/7.07G [00:25<00:51, 91.9MB/s]
Downloading data: 33%|###3 | 2.36G/7.07G [00:25<00:51, 92.0MB/s]
Downloading data: 33%|###3 | 2.37G/7.07G [00:25<00:51, 91.5MB/s]
Downloading data: 34%|###3 | 2.38G/7.07G [00:25<00:51, 91.4MB/s]
Downloading data: 34%|###3 | 2.39G/7.07G [00:25<00:51, 91.3MB/s]
Downloading data: 34%|###3 | 2.40G/7.07G [00:26<00:51, 91.4MB/s]
Downloading data: 34%|###4 | 2.41G/7.07G [00:26<00:50, 91.6MB/s]
Downloading data: 34%|###4 | 2.42G/7.07G [00:26<00:50, 91.7MB/s]
Downloading data: 34%|###4 | 2.42G/7.07G [00:26<00:50, 91.9MB/s]
Downloading data: 34%|###4 | 2.43G/7.07G [00:26<01:18, 59.2MB/s]
Downloading data: 35%|###4 | 2.44G/7.07G [00:26<01:10, 65.7MB/s]
Downloading data: 35%|###4 | 2.45G/7.07G [00:26<01:04, 71.7MB/s]
Downloading data: 35%|###4 | 2.46G/7.07G [00:26<01:00, 75.9MB/s]
Downloading data: 35%|###4 | 2.47G/7.07G [00:27<00:57, 79.5MB/s]
Downloading data: 35%|###5 | 2.48G/7.07G [00:27<00:55, 82.3MB/s]
Downloading data: 35%|###5 | 2.49G/7.07G [00:27<00:54, 84.4MB/s]
Downloading data: 35%|###5 | 2.50G/7.07G [00:27<00:53, 85.8MB/s]
Downloading data: 35%|###5 | 2.51G/7.07G [00:27<00:52, 87.1MB/s]
Downloading data: 36%|###5 | 2.51G/7.07G [00:27<00:51, 88.3MB/s]
Downloading data: 36%|###5 | 2.52G/7.07G [00:27<00:51, 89.0MB/s]
Downloading data: 36%|###5 | 2.53G/7.07G [00:27<00:50, 89.4MB/s]
Downloading data: 36%|###5 | 2.54G/7.07G [00:27<00:50, 89.8MB/s]
Downloading data: 36%|###6 | 2.55G/7.07G [00:27<00:49, 90.5MB/s]
Downloading data: 36%|###6 | 2.56G/7.07G [00:28<00:49, 90.7MB/s]
Downloading data: 36%|###6 | 2.57G/7.07G [00:28<00:49, 90.8MB/s]
Downloading data: 36%|###6 | 2.58G/7.07G [00:28<00:49, 90.8MB/s]
Downloading data: 37%|###6 | 2.59G/7.07G [00:28<00:49, 90.8MB/s]
Downloading data: 37%|###6 | 2.60G/7.07G [00:28<00:49, 91.0MB/s]
Downloading data: 37%|###6 | 2.61G/7.07G [00:28<00:49, 91.1MB/s]
Downloading data: 37%|###6 | 2.61G/7.07G [00:28<00:48, 91.1MB/s]
Downloading data: 37%|###7 | 2.62G/7.07G [00:28<00:48, 91.2MB/s]
Downloading data: 37%|###7 | 2.63G/7.07G [00:28<00:48, 91.1MB/s]
Downloading data: 37%|###7 | 2.64G/7.07G [00:28<00:48, 91.2MB/s]
Downloading data: 37%|###7 | 2.65G/7.07G [00:29<00:48, 91.5MB/s]
Downloading data: 38%|###7 | 2.66G/7.07G [00:29<00:48, 91.1MB/s]
Downloading data: 38%|###7 | 2.67G/7.07G [00:29<00:48, 91.6MB/s]
Downloading data: 38%|###7 | 2.68G/7.07G [00:29<00:47, 91.6MB/s]
Downloading data: 38%|###8 | 2.69G/7.07G [00:29<00:47, 91.7MB/s]
Downloading data: 38%|###8 | 2.70G/7.07G [00:29<00:47, 91.8MB/s]
Downloading data: 38%|###8 | 2.71G/7.07G [00:29<00:47, 91.9MB/s]
Downloading data: 38%|###8 | 2.72G/7.07G [00:29<00:47, 91.6MB/s]
Downloading data: 39%|###8 | 2.72G/7.07G [00:29<00:47, 91.6MB/s]
Downloading data: 39%|###8 | 2.73G/7.07G [00:29<00:47, 91.6MB/s]
Downloading data: 39%|###8 | 2.74G/7.07G [00:30<00:47, 91.5MB/s]
Downloading data: 39%|###8 | 2.75G/7.07G [00:30<00:47, 91.6MB/s]
Downloading data: 39%|###9 | 2.76G/7.07G [00:30<00:47, 91.5MB/s]
Downloading data: 39%|###9 | 2.77G/7.07G [00:30<00:47, 91.3MB/s]
Downloading data: 39%|###9 | 2.78G/7.07G [00:30<00:46, 91.4MB/s]
Downloading data: 39%|###9 | 2.79G/7.07G [00:30<00:46, 91.3MB/s]
Downloading data: 40%|###9 | 2.80G/7.07G [00:30<00:46, 91.4MB/s]
Downloading data: 40%|###9 | 2.81G/7.07G [00:30<00:46, 91.4MB/s]
Downloading data: 40%|###9 | 2.82G/7.07G [00:30<00:46, 91.5MB/s]
Downloading data: 40%|###9 | 2.83G/7.07G [00:30<00:46, 91.5MB/s]
Downloading data: 40%|#### | 2.83G/7.07G [00:31<00:46, 91.8MB/s]
Downloading data: 40%|#### | 2.84G/7.07G [00:31<00:45, 91.9MB/s]
Downloading data: 40%|#### | 2.85G/7.07G [00:31<00:46, 91.4MB/s]
Downloading data: 40%|#### | 2.86G/7.07G [00:31<00:46, 91.3MB/s]
Downloading data: 41%|#### | 2.87G/7.07G [00:31<00:46, 91.0MB/s]
Downloading data: 41%|#### | 2.88G/7.07G [00:31<00:46, 91.0MB/s]
Downloading data: 41%|#### | 2.89G/7.07G [00:31<00:46, 90.8MB/s]
Downloading data: 41%|#### | 2.90G/7.07G [00:31<00:46, 90.5MB/s]
Downloading data: 41%|####1 | 2.91G/7.07G [00:31<00:45, 90.6MB/s]
Downloading data: 41%|####1 | 2.92G/7.07G [00:31<00:45, 90.6MB/s]
Downloading data: 41%|####1 | 2.93G/7.07G [00:32<00:45, 90.8MB/s]
Downloading data: 41%|####1 | 2.93G/7.07G [00:32<00:45, 90.5MB/s]
Downloading data: 42%|####1 | 2.94G/7.07G [00:32<00:45, 90.5MB/s]
Downloading data: 42%|####1 | 2.95G/7.07G [00:32<00:45, 90.7MB/s]
Downloading data: 42%|####1 | 2.96G/7.07G [00:32<00:45, 90.6MB/s]
Downloading data: 42%|####2 | 2.97G/7.07G [00:32<00:45, 90.4MB/s]
Downloading data: 42%|####2 | 2.98G/7.07G [00:32<00:45, 90.5MB/s]
Downloading data: 42%|####2 | 2.99G/7.07G [00:32<00:45, 90.6MB/s]
Downloading data: 42%|####2 | 3.00G/7.07G [00:32<00:44, 90.8MB/s]
Downloading data: 43%|####2 | 3.01G/7.07G [00:32<00:44, 90.9MB/s]
Downloading data: 43%|####2 | 3.02G/7.07G [00:33<00:44, 90.9MB/s]
Downloading data: 43%|####2 | 3.03G/7.07G [00:33<00:44, 91.1MB/s]
Downloading data: 43%|####2 | 3.03G/7.07G [00:33<00:44, 91.0MB/s]
Downloading data: 43%|####3 | 3.04G/7.07G [00:33<00:44, 91.2MB/s]
Downloading data: 43%|####3 | 3.05G/7.07G [00:33<00:44, 91.3MB/s]
Downloading data: 43%|####3 | 3.06G/7.07G [00:33<00:43, 91.1MB/s]
Downloading data: 43%|####3 | 3.07G/7.07G [00:33<00:43, 91.0MB/s]
Downloading data: 44%|####3 | 3.08G/7.07G [00:33<00:43, 91.0MB/s]
Downloading data: 44%|####3 | 3.09G/7.07G [00:33<00:43, 91.4MB/s]
Downloading data: 44%|####3 | 3.10G/7.07G [00:33<00:43, 91.5MB/s]
Downloading data: 44%|####3 | 3.11G/7.07G [00:34<00:43, 91.7MB/s]
Downloading data: 44%|####4 | 3.12G/7.07G [00:34<00:43, 91.8MB/s]
Downloading data: 44%|####4 | 3.13G/7.07G [00:34<00:42, 91.9MB/s]
Downloading data: 44%|####4 | 3.14G/7.07G [00:34<00:42, 91.9MB/s]
Downloading data: 44%|####4 | 3.15G/7.07G [00:34<00:42, 92.0MB/s]
Downloading data: 45%|####4 | 3.15G/7.07G [00:34<00:42, 91.8MB/s]
Downloading data: 45%|####4 | 3.16G/7.07G [00:34<00:42, 91.8MB/s]
Downloading data: 45%|####4 | 3.17G/7.07G [00:34<00:42, 91.7MB/s]
Downloading data: 45%|####4 | 3.18G/7.07G [00:34<00:42, 91.8MB/s]
Downloading data: 45%|####5 | 3.19G/7.07G [00:34<00:42, 91.8MB/s]
Downloading data: 45%|####5 | 3.20G/7.07G [00:35<00:42, 92.1MB/s]
Downloading data: 45%|####5 | 3.21G/7.07G [00:35<00:41, 92.2MB/s]
Downloading data: 46%|####5 | 3.22G/7.07G [00:35<00:41, 92.1MB/s]
Downloading data: 46%|####5 | 3.23G/7.07G [00:35<00:41, 92.1MB/s]
Downloading data: 46%|####5 | 3.24G/7.07G [00:35<00:41, 92.0MB/s]
Downloading data: 46%|####5 | 3.25G/7.07G [00:35<00:41, 91.6MB/s]
Downloading data: 46%|####6 | 3.26G/7.07G [00:35<00:41, 91.4MB/s]
Downloading data: 46%|####6 | 3.26G/7.07G [00:35<00:41, 91.5MB/s]
Downloading data: 46%|####6 | 3.27G/7.07G [00:35<00:41, 91.2MB/s]
Downloading data: 46%|####6 | 3.28G/7.07G [00:35<00:41, 91.1MB/s]
Downloading data: 47%|####6 | 3.29G/7.07G [00:36<00:41, 91.1MB/s]
Downloading data: 47%|####6 | 3.30G/7.07G [00:36<00:41, 90.7MB/s]
Downloading data: 47%|####6 | 3.31G/7.07G [00:36<00:41, 90.5MB/s]
Downloading data: 47%|####6 | 3.32G/7.07G [00:36<00:41, 90.8MB/s]
Downloading data: 47%|####7 | 3.33G/7.07G [00:36<00:41, 90.9MB/s]
Downloading data: 47%|####7 | 3.34G/7.07G [00:36<00:41, 90.7MB/s]
Downloading data: 47%|####7 | 3.35G/7.07G [00:36<00:41, 90.8MB/s]
Downloading data: 47%|####7 | 3.36G/7.07G [00:36<00:40, 91.2MB/s]
Downloading data: 48%|####7 | 3.37G/7.07G [00:36<00:40, 91.2MB/s]
Downloading data: 48%|####7 | 3.37G/7.07G [00:36<00:40, 91.3MB/s]
Downloading data: 48%|####7 | 3.38G/7.07G [00:37<00:40, 91.4MB/s]
Downloading data: 48%|####7 | 3.39G/7.07G [00:37<00:40, 91.3MB/s]
Downloading data: 48%|####8 | 3.40G/7.07G [00:37<00:40, 91.3MB/s]
Downloading data: 48%|####8 | 3.41G/7.07G [00:37<00:39, 91.7MB/s]
Downloading data: 48%|####8 | 3.42G/7.07G [00:37<00:39, 91.7MB/s]
Downloading data: 48%|####8 | 3.43G/7.07G [00:37<00:39, 91.7MB/s]
Downloading data: 49%|####8 | 3.44G/7.07G [00:37<00:39, 91.5MB/s]
Downloading data: 49%|####8 | 3.45G/7.07G [00:37<00:39, 91.4MB/s]
Downloading data: 49%|####8 | 3.46G/7.07G [00:37<00:39, 91.3MB/s]
Downloading data: 49%|####9 | 3.47G/7.07G [00:37<00:39, 91.3MB/s]
Downloading data: 49%|####9 | 3.48G/7.07G [00:38<00:39, 91.5MB/s]
Downloading data: 49%|####9 | 3.48G/7.07G [00:38<00:39, 91.1MB/s]
Downloading data: 49%|####9 | 3.49G/7.07G [00:38<00:39, 90.9MB/s]
Downloading data: 50%|####9 | 3.50G/7.07G [00:38<00:39, 90.7MB/s]
Downloading data: 50%|####9 | 3.51G/7.07G [00:38<00:39, 90.6MB/s]
Downloading data: 50%|####9 | 3.52G/7.07G [00:38<00:39, 90.4MB/s]
Downloading data: 50%|####9 | 3.53G/7.07G [00:38<00:39, 90.3MB/s]
Downloading data: 50%|##### | 3.54G/7.07G [00:38<00:39, 90.3MB/s]
Downloading data: 50%|##### | 3.55G/7.07G [00:38<00:39, 90.3MB/s]
Downloading data: 50%|##### | 3.56G/7.07G [00:38<00:38, 90.3MB/s]
Downloading data: 50%|##### | 3.57G/7.07G [00:39<00:38, 90.4MB/s]
Downloading data: 51%|##### | 3.57G/7.07G [00:39<00:38, 90.4MB/s]
Downloading data: 51%|##### | 3.58G/7.07G [00:39<00:38, 90.6MB/s]
Downloading data: 51%|##### | 3.59G/7.07G [00:39<00:38, 90.6MB/s]
Downloading data: 51%|##### | 3.60G/7.07G [00:39<00:38, 90.9MB/s]
Downloading data: 51%|#####1 | 3.61G/7.07G [00:39<00:38, 90.9MB/s]
Downloading data: 51%|#####1 | 3.62G/7.07G [00:39<00:38, 90.8MB/s]
Downloading data: 51%|#####1 | 3.63G/7.07G [00:39<00:37, 90.7MB/s]
Downloading data: 51%|#####1 | 3.64G/7.07G [00:39<00:37, 90.8MB/s]
Downloading data: 52%|#####1 | 3.65G/7.07G [00:39<00:37, 90.6MB/s]
Downloading data: 52%|#####1 | 3.66G/7.07G [00:40<00:37, 90.5MB/s]
Downloading data: 52%|#####1 | 3.67G/7.07G [00:40<00:37, 90.3MB/s]
Downloading data: 52%|#####1 | 3.67G/7.07G [00:40<00:37, 90.4MB/s]
Downloading data: 52%|#####2 | 3.68G/7.07G [00:40<00:37, 90.2MB/s]
Downloading data: 52%|#####2 | 3.69G/7.07G [00:40<00:37, 90.1MB/s]
Downloading data: 52%|#####2 | 3.70G/7.07G [00:40<00:37, 90.1MB/s]
Downloading data: 52%|#####2 | 3.71G/7.07G [00:40<00:37, 90.2MB/s]
Downloading data: 53%|#####2 | 3.72G/7.07G [00:40<00:37, 90.1MB/s]
Downloading data: 53%|#####2 | 3.73G/7.07G [00:40<00:37, 90.3MB/s]
Downloading data: 53%|#####2 | 3.74G/7.07G [00:40<00:36, 90.4MB/s]
Downloading data: 53%|#####2 | 3.75G/7.07G [00:41<00:36, 90.5MB/s]
Downloading data: 53%|#####3 | 3.76G/7.07G [00:41<00:36, 90.8MB/s]
Downloading data: 53%|#####3 | 3.77G/7.07G [00:41<00:36, 91.0MB/s]
Downloading data: 53%|#####3 | 3.77G/7.07G [00:41<00:36, 90.9MB/s]
Downloading data: 53%|#####3 | 3.78G/7.07G [00:41<00:36, 91.1MB/s]
Downloading data: 54%|#####3 | 3.79G/7.07G [00:41<00:36, 91.1MB/s]
Downloading data: 54%|#####3 | 3.80G/7.07G [00:41<00:35, 91.2MB/s]
Downloading data: 54%|#####3 | 3.81G/7.07G [00:41<00:35, 90.9MB/s]
Downloading data: 54%|#####4 | 3.82G/7.07G [00:41<00:35, 90.6MB/s]
Downloading data: 54%|#####4 | 3.83G/7.07G [00:41<00:35, 90.8MB/s]
Downloading data: 54%|#####4 | 3.84G/7.07G [00:42<00:35, 90.4MB/s]
Downloading data: 54%|#####4 | 3.85G/7.07G [00:42<00:35, 90.5MB/s]
Downloading data: 55%|#####4 | 3.86G/7.07G [00:42<00:35, 90.5MB/s]
Downloading data: 55%|#####4 | 3.87G/7.07G [00:42<00:35, 90.5MB/s]
Downloading data: 55%|#####4 | 3.87G/7.07G [00:42<00:35, 90.7MB/s]
Downloading data: 55%|#####4 | 3.88G/7.07G [00:42<00:35, 90.6MB/s]
Downloading data: 55%|#####5 | 3.89G/7.07G [00:42<00:35, 90.6MB/s]
Downloading data: 55%|#####5 | 3.90G/7.07G [00:42<00:34, 90.6MB/s]
Downloading data: 55%|#####5 | 3.91G/7.07G [00:42<00:34, 90.6MB/s]
Downloading data: 55%|#####5 | 3.92G/7.07G [00:42<00:34, 90.5MB/s]
Downloading data: 56%|#####5 | 3.93G/7.07G [00:43<00:34, 90.5MB/s]
Downloading data: 56%|#####5 | 3.94G/7.07G [00:43<00:34, 90.3MB/s]
Downloading data: 56%|#####5 | 3.95G/7.07G [00:43<00:34, 90.4MB/s]
Downloading data: 56%|#####5 | 3.96G/7.07G [00:43<00:34, 90.2MB/s]
Downloading data: 56%|#####6 | 3.97G/7.07G [00:43<00:34, 90.3MB/s]
Downloading data: 56%|#####6 | 3.97G/7.07G [00:43<00:34, 90.2MB/s]
Downloading data: 56%|#####6 | 3.98G/7.07G [00:43<00:34, 90.3MB/s]
Downloading data: 56%|#####6 | 3.99G/7.07G [00:43<00:34, 90.5MB/s]
Downloading data: 57%|#####6 | 4.00G/7.07G [00:43<00:33, 90.6MB/s]
Downloading data: 57%|#####6 | 4.01G/7.07G [00:43<00:33, 90.9MB/s]
Downloading data: 57%|#####6 | 4.02G/7.07G [00:44<00:33, 91.2MB/s]
Downloading data: 57%|#####6 | 4.03G/7.07G [00:44<00:33, 91.4MB/s]
Downloading data: 57%|#####7 | 4.04G/7.07G [00:44<00:33, 91.6MB/s]
Downloading data: 57%|#####7 | 4.05G/7.07G [00:44<00:32, 91.8MB/s]
Downloading data: 57%|#####7 | 4.06G/7.07G [00:44<00:32, 91.7MB/s]
Downloading data: 57%|#####7 | 4.07G/7.07G [00:44<00:32, 91.7MB/s]
Downloading data: 58%|#####7 | 4.07G/7.07G [00:44<00:32, 91.7MB/s]
Downloading data: 58%|#####7 | 4.08G/7.07G [00:44<00:32, 91.6MB/s]
Downloading data: 58%|#####7 | 4.09G/7.07G [00:44<00:32, 91.6MB/s]
Downloading data: 58%|#####8 | 4.10G/7.07G [00:44<00:32, 91.5MB/s]
Downloading data: 58%|#####8 | 4.11G/7.07G [00:45<00:32, 91.3MB/s]
Downloading data: 58%|#####8 | 4.12G/7.07G [00:45<00:32, 91.2MB/s]
Downloading data: 58%|#####8 | 4.13G/7.07G [00:45<00:32, 91.6MB/s]
Downloading data: 59%|#####8 | 4.14G/7.07G [00:45<00:32, 91.3MB/s]
Downloading data: 59%|#####8 | 4.15G/7.07G [00:45<00:32, 91.2MB/s]
Downloading data: 59%|#####8 | 4.16G/7.07G [00:45<00:31, 91.2MB/s]
Downloading data: 59%|#####8 | 4.17G/7.07G [00:45<00:31, 91.2MB/s]
Downloading data: 59%|#####9 | 4.18G/7.07G [00:45<00:31, 91.3MB/s]
Downloading data: 59%|#####9 | 4.18G/7.07G [00:45<00:31, 91.4MB/s]
Downloading data: 59%|#####9 | 4.19G/7.07G [00:45<00:31, 91.4MB/s]
Downloading data: 59%|#####9 | 4.20G/7.07G [00:46<00:31, 91.5MB/s]
Downloading data: 60%|#####9 | 4.21G/7.07G [00:46<00:31, 91.3MB/s]
Downloading data: 60%|#####9 | 4.22G/7.07G [00:46<00:31, 91.3MB/s]
Downloading data: 60%|#####9 | 4.23G/7.07G [00:46<00:31, 91.5MB/s]
Downloading data: 60%|#####9 | 4.24G/7.07G [00:46<00:30, 91.6MB/s]
Downloading data: 60%|###### | 4.25G/7.07G [00:46<00:30, 91.5MB/s]
Downloading data: 60%|###### | 4.26G/7.07G [00:46<00:30, 91.4MB/s]
Downloading data: 60%|###### | 4.27G/7.07G [00:46<00:30, 91.2MB/s]
Downloading data: 60%|###### | 4.28G/7.07G [00:46<00:30, 91.5MB/s]
Downloading data: 61%|###### | 4.29G/7.07G [00:46<00:30, 91.3MB/s]
Downloading data: 61%|###### | 4.29G/7.07G [00:47<00:30, 91.5MB/s]
Downloading data: 61%|###### | 4.30G/7.07G [00:47<00:30, 91.5MB/s]
Downloading data: 61%|###### | 4.31G/7.07G [00:47<00:45, 61.0MB/s]
Downloading data: 61%|######1 | 4.32G/7.07G [00:47<00:40, 67.3MB/s]
Downloading data: 61%|######1 | 4.33G/7.07G [00:47<00:37, 72.7MB/s]
Downloading data: 61%|######1 | 4.34G/7.07G [00:47<00:35, 77.2MB/s]
Downloading data: 61%|######1 | 4.35G/7.07G [00:47<00:33, 81.1MB/s]
Downloading data: 62%|######1 | 4.36G/7.07G [00:47<00:32, 84.0MB/s]
Downloading data: 62%|######1 | 4.37G/7.07G [00:48<00:31, 86.0MB/s]
Downloading data: 62%|######1 | 4.38G/7.07G [00:48<00:30, 87.6MB/s]
Downloading data: 62%|######2 | 4.39G/7.07G [00:48<00:30, 88.9MB/s]
Downloading data: 62%|######2 | 4.40G/7.07G [00:48<00:29, 89.9MB/s]
Downloading data: 62%|######2 | 4.40G/7.07G [00:48<00:29, 90.7MB/s]
Downloading data: 62%|######2 | 4.41G/7.07G [00:48<00:29, 91.3MB/s]
Downloading data: 63%|######2 | 4.42G/7.07G [00:48<00:28, 91.6MB/s]
Downloading data: 63%|######2 | 4.43G/7.07G [00:48<00:28, 91.7MB/s]
Downloading data: 63%|######2 | 4.44G/7.07G [00:48<00:28, 91.5MB/s]
Downloading data: 63%|######2 | 4.45G/7.07G [00:48<00:28, 92.0MB/s]
Downloading data: 63%|######3 | 4.46G/7.07G [00:49<00:28, 92.1MB/s]
Downloading data: 63%|######3 | 4.47G/7.07G [00:49<00:28, 92.3MB/s]
Downloading data: 63%|######3 | 4.48G/7.07G [00:49<00:28, 92.6MB/s]
Downloading data: 63%|######3 | 4.49G/7.07G [00:49<00:27, 92.7MB/s]
Downloading data: 64%|######3 | 4.50G/7.07G [00:49<00:27, 92.4MB/s]
Downloading data: 64%|######3 | 4.51G/7.07G [00:49<00:27, 92.3MB/s]
Downloading data: 64%|######3 | 4.52G/7.07G [00:49<00:27, 92.2MB/s]
Downloading data: 64%|######3 | 4.52G/7.07G [00:49<00:27, 92.5MB/s]
Downloading data: 64%|######4 | 4.53G/7.07G [00:49<00:27, 92.4MB/s]
Downloading data: 64%|######4 | 4.54G/7.07G [00:49<00:27, 92.3MB/s]
Downloading data: 64%|######4 | 4.55G/7.07G [00:50<00:27, 92.4MB/s]
Downloading data: 65%|######4 | 4.56G/7.07G [00:50<00:27, 92.4MB/s]
Downloading data: 65%|######4 | 4.57G/7.07G [00:50<00:27, 92.3MB/s]
Downloading data: 65%|######4 | 4.58G/7.07G [00:50<00:27, 92.3MB/s]
Downloading data: 65%|######4 | 4.59G/7.07G [00:50<00:26, 92.1MB/s]
Downloading data: 65%|######5 | 4.60G/7.07G [00:50<00:26, 91.9MB/s]
Downloading data: 65%|######5 | 4.61G/7.07G [00:50<00:26, 91.9MB/s]
Downloading data: 65%|######5 | 4.62G/7.07G [00:50<00:26, 92.1MB/s]
Downloading data: 65%|######5 | 4.63G/7.07G [00:50<00:26, 92.1MB/s]
Downloading data: 66%|######5 | 4.64G/7.07G [00:50<00:26, 91.9MB/s]
Downloading data: 66%|######5 | 4.64G/7.07G [00:51<00:26, 91.7MB/s]
Downloading data: 66%|######5 | 4.65G/7.07G [00:51<00:26, 91.8MB/s]
Downloading data: 66%|######5 | 4.66G/7.07G [00:51<00:26, 92.1MB/s]
Downloading data: 66%|######6 | 4.67G/7.07G [00:51<00:26, 92.0MB/s]
Downloading data: 66%|######6 | 4.68G/7.07G [00:51<00:25, 92.2MB/s]
Downloading data: 66%|######6 | 4.69G/7.07G [00:51<00:25, 92.2MB/s]
Downloading data: 66%|######6 | 4.70G/7.07G [00:51<00:25, 92.4MB/s]
Downloading data: 67%|######6 | 4.71G/7.07G [00:51<00:25, 92.2MB/s]
Downloading data: 67%|######6 | 4.72G/7.07G [00:51<00:25, 92.3MB/s]
Downloading data: 67%|######6 | 4.73G/7.07G [00:51<00:25, 92.2MB/s]
Downloading data: 67%|######6 | 4.74G/7.07G [00:52<00:25, 92.2MB/s]
Downloading data: 67%|######7 | 4.75G/7.07G [00:52<00:25, 92.3MB/s]
Downloading data: 67%|######7 | 4.76G/7.07G [00:52<00:25, 92.5MB/s]
Downloading data: 67%|######7 | 4.76G/7.07G [00:52<00:24, 92.3MB/s]
Downloading data: 68%|######7 | 4.77G/7.07G [00:52<00:24, 92.3MB/s]
Downloading data: 68%|######7 | 4.78G/7.07G [00:52<00:24, 92.1MB/s]
Downloading data: 68%|######7 | 4.79G/7.07G [00:52<00:24, 92.1MB/s]
Downloading data: 68%|######7 | 4.80G/7.07G [00:52<00:24, 92.3MB/s]
Downloading data: 68%|######8 | 4.81G/7.07G [00:52<00:24, 92.2MB/s]
Downloading data: 68%|######8 | 4.82G/7.07G [00:52<00:24, 92.2MB/s]
Downloading data: 68%|######8 | 4.83G/7.07G [00:53<00:24, 92.4MB/s]
Downloading data: 68%|######8 | 4.84G/7.07G [00:53<00:24, 92.4MB/s]
Downloading data: 69%|######8 | 4.85G/7.07G [00:53<00:24, 92.2MB/s]
Downloading data: 69%|######8 | 4.86G/7.07G [00:53<00:24, 92.1MB/s]
Downloading data: 69%|######8 | 4.87G/7.07G [00:53<00:23, 92.0MB/s]
Downloading data: 69%|######8 | 4.88G/7.07G [00:53<00:23, 92.1MB/s]
Downloading data: 69%|######9 | 4.88G/7.07G [00:53<00:23, 91.9MB/s]
Downloading data: 69%|######9 | 4.89G/7.07G [00:53<00:23, 91.9MB/s]
Downloading data: 69%|######9 | 4.90G/7.07G [00:53<00:23, 92.0MB/s]
Downloading data: 69%|######9 | 4.91G/7.07G [00:53<00:23, 91.9MB/s]
Downloading data: 70%|######9 | 4.92G/7.07G [00:54<00:23, 92.0MB/s]
Downloading data: 70%|######9 | 4.93G/7.07G [00:54<00:23, 92.6MB/s]
Downloading data: 70%|######9 | 4.94G/7.07G [00:54<00:22, 93.0MB/s]
Downloading data: 70%|######9 | 4.95G/7.07G [00:54<00:22, 93.7MB/s]
Downloading data: 70%|####### | 4.96G/7.07G [00:54<00:22, 94.2MB/s]
Downloading data: 70%|####### | 4.97G/7.07G [00:54<00:22, 94.5MB/s]
Downloading data: 70%|####### | 4.98G/7.07G [00:54<00:22, 94.7MB/s]
Downloading data: 71%|####### | 4.99G/7.07G [00:54<00:21, 94.8MB/s]
Downloading data: 71%|####### | 5.00G/7.07G [00:54<00:21, 94.6MB/s]
Downloading data: 71%|####### | 5.01G/7.07G [00:54<00:21, 94.6MB/s]
Downloading data: 71%|####### | 5.02G/7.07G [00:55<00:21, 95.2MB/s]
Downloading data: 71%|#######1 | 5.03G/7.07G [00:55<00:21, 95.3MB/s]
Downloading data: 71%|#######1 | 5.04G/7.07G [00:55<00:21, 95.4MB/s]
Downloading data: 71%|#######1 | 5.05G/7.07G [00:55<00:21, 95.5MB/s]
Downloading data: 71%|#######1 | 5.06G/7.07G [00:55<00:21, 95.5MB/s]
Downloading data: 72%|#######1 | 5.06G/7.07G [00:55<00:21, 95.6MB/s]
Downloading data: 72%|#######1 | 5.07G/7.07G [00:55<00:20, 95.4MB/s]
Downloading data: 72%|#######1 | 5.08G/7.07G [00:55<00:20, 95.2MB/s]
Downloading data: 72%|#######2 | 5.09G/7.07G [00:55<00:20, 95.2MB/s]
Downloading data: 72%|#######2 | 5.10G/7.07G [00:55<00:20, 95.2MB/s]
Downloading data: 72%|#######2 | 5.11G/7.07G [00:56<00:20, 95.2MB/s]
Downloading data: 72%|#######2 | 5.12G/7.07G [00:56<00:20, 95.3MB/s]
Downloading data: 73%|#######2 | 5.13G/7.07G [00:56<00:20, 95.2MB/s]
Downloading data: 73%|#######2 | 5.14G/7.07G [00:56<00:20, 95.2MB/s]
Downloading data: 73%|#######2 | 5.15G/7.07G [00:56<00:20, 95.3MB/s]
Downloading data: 73%|#######2 | 5.16G/7.07G [00:56<00:20, 95.2MB/s]
Downloading data: 73%|#######3 | 5.17G/7.07G [00:56<00:19, 95.5MB/s]
Downloading data: 73%|#######3 | 5.18G/7.07G [00:56<00:19, 95.5MB/s]
Downloading data: 73%|#######3 | 5.19G/7.07G [00:56<00:19, 95.6MB/s]
Downloading data: 74%|#######3 | 5.20G/7.07G [00:56<00:19, 95.6MB/s]
Downloading data: 74%|#######3 | 5.21G/7.07G [00:57<00:19, 95.5MB/s]
Downloading data: 74%|#######3 | 5.22G/7.07G [00:57<00:19, 95.5MB/s]
Downloading data: 74%|#######3 | 5.23G/7.07G [00:57<00:19, 95.3MB/s]
Downloading data: 74%|#######4 | 5.24G/7.07G [00:57<00:19, 95.4MB/s]
Downloading data: 74%|#######4 | 5.25G/7.07G [00:57<00:28, 63.3MB/s]
Downloading data: 74%|#######4 | 5.26G/7.07G [00:57<00:26, 69.7MB/s]
Downloading data: 74%|#######4 | 5.26G/7.07G [00:57<00:24, 75.3MB/s]
Downloading data: 75%|#######4 | 5.27G/7.07G [00:57<00:22, 80.1MB/s]
Downloading data: 75%|#######4 | 5.28G/7.07G [00:58<00:21, 83.9MB/s]
Downloading data: 75%|#######4 | 5.29G/7.07G [00:58<00:20, 86.9MB/s]
Downloading data: 75%|#######4 | 5.30G/7.07G [00:58<00:19, 89.4MB/s]
Downloading data: 75%|#######5 | 5.31G/7.07G [00:58<00:19, 91.2MB/s]
Downloading data: 75%|#######5 | 5.32G/7.07G [00:58<00:18, 92.6MB/s]
Downloading data: 75%|#######5 | 5.33G/7.07G [00:58<00:18, 93.2MB/s]
Downloading data: 76%|#######5 | 5.34G/7.07G [00:58<00:18, 93.8MB/s]
Downloading data: 76%|#######5 | 5.35G/7.07G [00:58<00:18, 94.3MB/s]
Downloading data: 76%|#######5 | 5.36G/7.07G [00:58<00:18, 94.5MB/s]
Downloading data: 76%|#######5 | 5.37G/7.07G [00:58<00:18, 94.6MB/s]
Downloading data: 76%|#######6 | 5.38G/7.07G [00:59<00:17, 94.6MB/s]
Downloading data: 76%|#######6 | 5.39G/7.07G [00:59<00:17, 95.0MB/s]
Downloading data: 76%|#######6 | 5.40G/7.07G [00:59<00:17, 95.3MB/s]
Downloading data: 76%|#######6 | 5.41G/7.07G [00:59<00:17, 95.4MB/s]
Downloading data: 77%|#######6 | 5.42G/7.07G [00:59<00:17, 95.4MB/s]
Downloading data: 77%|#######6 | 5.43G/7.07G [00:59<00:17, 95.1MB/s]
Downloading data: 77%|#######6 | 5.44G/7.07G [00:59<00:17, 95.2MB/s]
Downloading data: 77%|#######6 | 5.45G/7.07G [00:59<00:17, 95.2MB/s]
Downloading data: 77%|#######7 | 5.46G/7.07G [00:59<00:16, 95.4MB/s]
Downloading data: 77%|#######7 | 5.46G/7.07G [00:59<00:16, 95.1MB/s]
Downloading data: 77%|#######7 | 5.47G/7.07G [01:00<00:16, 94.8MB/s]
Downloading data: 78%|#######7 | 5.48G/7.07G [01:00<00:16, 95.0MB/s]
Downloading data: 78%|#######7 | 5.49G/7.07G [01:00<00:16, 95.1MB/s]
Downloading data: 78%|#######7 | 5.50G/7.07G [01:00<00:16, 94.9MB/s]
Downloading data: 78%|#######7 | 5.51G/7.07G [01:00<00:16, 94.9MB/s]
Downloading data: 78%|#######8 | 5.52G/7.07G [01:00<00:16, 94.8MB/s]
Downloading data: 78%|#######8 | 5.53G/7.07G [01:00<00:16, 94.8MB/s]
Downloading data: 78%|#######8 | 5.54G/7.07G [01:00<00:16, 94.9MB/s]
Downloading data: 78%|#######8 | 5.55G/7.07G [01:00<00:16, 94.9MB/s]
Downloading data: 79%|#######8 | 5.56G/7.07G [01:00<00:15, 95.1MB/s]
Downloading data: 79%|#######8 | 5.57G/7.07G [01:01<00:15, 95.1MB/s]
Downloading data: 79%|#######8 | 5.58G/7.07G [01:01<00:15, 95.0MB/s]
Downloading data: 79%|#######9 | 5.59G/7.07G [01:01<00:15, 94.9MB/s]
Downloading data: 79%|#######9 | 5.60G/7.07G [01:01<00:15, 95.2MB/s]
Downloading data: 79%|#######9 | 5.61G/7.07G [01:01<00:15, 95.3MB/s]
Downloading data: 79%|#######9 | 5.62G/7.07G [01:01<00:15, 95.3MB/s]
Downloading data: 80%|#######9 | 5.63G/7.07G [01:01<00:15, 95.2MB/s]
Downloading data: 80%|#######9 | 5.64G/7.07G [01:01<00:15, 95.2MB/s]
Downloading data: 80%|#######9 | 5.65G/7.07G [01:01<00:14, 95.1MB/s]
Downloading data: 80%|#######9 | 5.66G/7.07G [01:01<00:14, 95.3MB/s]
Downloading data: 80%|######## | 5.66G/7.07G [01:02<00:14, 95.0MB/s]
Downloading data: 80%|######## | 5.67G/7.07G [01:02<00:14, 95.1MB/s]
Downloading data: 80%|######## | 5.68G/7.07G [01:02<00:14, 95.6MB/s]
Downloading data: 81%|######## | 5.69G/7.07G [01:02<00:14, 95.4MB/s]
Downloading data: 81%|######## | 5.70G/7.07G [01:02<00:14, 95.5MB/s]
Downloading data: 81%|######## | 5.71G/7.07G [01:02<00:14, 95.6MB/s]
Downloading data: 81%|######## | 5.72G/7.07G [01:02<00:14, 95.7MB/s]
Downloading data: 81%|########1 | 5.73G/7.07G [01:02<00:14, 95.2MB/s]
Downloading data: 81%|########1 | 5.74G/7.07G [01:02<00:13, 95.1MB/s]
Downloading data: 81%|########1 | 5.75G/7.07G [01:02<00:13, 94.9MB/s]
Downloading data: 81%|########1 | 5.76G/7.07G [01:03<00:13, 95.1MB/s]
Downloading data: 82%|########1 | 5.77G/7.07G [01:03<00:13, 95.3MB/s]
Downloading data: 82%|########1 | 5.78G/7.07G [01:03<00:13, 95.2MB/s]
Downloading data: 82%|########1 | 5.79G/7.07G [01:03<00:13, 95.1MB/s]
Downloading data: 82%|########1 | 5.80G/7.07G [01:03<00:13, 94.8MB/s]
Downloading data: 82%|########2 | 5.81G/7.07G [01:03<00:13, 94.9MB/s]
Downloading data: 82%|########2 | 5.82G/7.07G [01:03<00:13, 94.8MB/s]
Downloading data: 82%|########2 | 5.83G/7.07G [01:03<00:13, 94.8MB/s]
Downloading data: 83%|########2 | 5.84G/7.07G [01:03<00:13, 94.8MB/s]
Downloading data: 83%|########2 | 5.85G/7.07G [01:03<00:12, 95.0MB/s]
Downloading data: 83%|########2 | 5.86G/7.07G [01:04<00:12, 94.7MB/s]
Downloading data: 83%|########2 | 5.87G/7.07G [01:04<00:12, 95.0MB/s]
Downloading data: 83%|########3 | 5.87G/7.07G [01:04<00:12, 95.0MB/s]
Downloading data: 83%|########3 | 5.88G/7.07G [01:04<00:12, 94.9MB/s]
Downloading data: 83%|########3 | 5.89G/7.07G [01:04<00:12, 94.6MB/s]
Downloading data: 83%|########3 | 5.90G/7.07G [01:04<00:12, 94.7MB/s]
Downloading data: 84%|########3 | 5.91G/7.07G [01:04<00:12, 94.6MB/s]
Downloading data: 84%|########3 | 5.92G/7.07G [01:04<00:12, 94.7MB/s]
Downloading data: 84%|########3 | 5.93G/7.07G [01:04<00:11, 95.1MB/s]
Downloading data: 84%|########4 | 5.94G/7.07G [01:04<00:11, 95.0MB/s]
Downloading data: 84%|########4 | 5.95G/7.07G [01:05<00:11, 95.0MB/s]
Downloading data: 84%|########4 | 5.96G/7.07G [01:05<00:11, 94.9MB/s]
Downloading data: 84%|########4 | 5.97G/7.07G [01:05<00:11, 95.1MB/s]
Downloading data: 85%|########4 | 5.98G/7.07G [01:05<00:11, 95.0MB/s]
Downloading data: 85%|########4 | 5.99G/7.07G [01:05<00:11, 94.9MB/s]
Downloading data: 85%|########4 | 6.00G/7.07G [01:05<00:11, 94.9MB/s]
Downloading data: 85%|########4 | 6.01G/7.07G [01:05<00:11, 94.8MB/s]
Downloading data: 85%|########5 | 6.02G/7.07G [01:05<00:11, 95.0MB/s]
Downloading data: 85%|########5 | 6.03G/7.07G [01:05<00:11, 95.0MB/s]
Downloading data: 85%|########5 | 6.04G/7.07G [01:05<00:10, 95.1MB/s]
Downloading data: 85%|########5 | 6.05G/7.07G [01:06<00:10, 95.4MB/s]
Downloading data: 86%|########5 | 6.06G/7.07G [01:06<00:10, 95.1MB/s]
Downloading data: 86%|########5 | 6.06G/7.07G [01:06<00:10, 95.0MB/s]
Downloading data: 86%|########5 | 6.07G/7.07G [01:06<00:10, 94.9MB/s]
Downloading data: 86%|########6 | 6.08G/7.07G [01:06<00:10, 94.8MB/s]
Downloading data: 86%|########6 | 6.09G/7.07G [01:06<00:10, 94.8MB/s]
Downloading data: 86%|########6 | 6.10G/7.07G [01:06<00:10, 94.7MB/s]
Downloading data: 86%|########6 | 6.11G/7.07G [01:06<00:10, 94.6MB/s]
Downloading data: 87%|########6 | 6.12G/7.07G [01:06<00:10, 94.4MB/s]
Downloading data: 87%|########6 | 6.13G/7.07G [01:06<00:09, 94.5MB/s]
Downloading data: 87%|########6 | 6.14G/7.07G [01:07<00:09, 94.6MB/s]
Downloading data: 87%|########6 | 6.15G/7.07G [01:07<00:09, 94.9MB/s]
Downloading data: 87%|########7 | 6.16G/7.07G [01:07<00:09, 95.1MB/s]
Downloading data: 87%|########7 | 6.17G/7.07G [01:07<00:09, 94.9MB/s]
Downloading data: 87%|########7 | 6.18G/7.07G [01:07<00:09, 95.0MB/s]
Downloading data: 88%|########7 | 6.19G/7.07G [01:07<00:09, 94.9MB/s]
Downloading data: 88%|########7 | 6.20G/7.07G [01:07<00:09, 94.9MB/s]
Downloading data: 88%|########7 | 6.21G/7.07G [01:07<00:09, 94.8MB/s]
Downloading data: 88%|########7 | 6.22G/7.07G [01:07<00:09, 94.7MB/s]
Downloading data: 88%|########8 | 6.23G/7.07G [01:08<00:13, 62.9MB/s]
Downloading data: 88%|########8 | 6.24G/7.07G [01:08<00:12, 69.4MB/s]
Downloading data: 88%|########8 | 6.24G/7.07G [01:08<00:11, 75.1MB/s]
Downloading data: 88%|########8 | 6.25G/7.07G [01:08<00:10, 79.7MB/s]
Downloading data: 89%|########8 | 6.26G/7.07G [01:08<00:09, 83.4MB/s]
Downloading data: 89%|########8 | 6.27G/7.07G [01:08<00:09, 86.3MB/s]
Downloading data: 89%|########8 | 6.28G/7.07G [01:08<00:08, 88.7MB/s]
Downloading data: 89%|########8 | 6.29G/7.07G [01:08<00:08, 90.5MB/s]
Downloading data: 89%|########9 | 6.30G/7.07G [01:08<00:08, 91.8MB/s]
Downloading data: 89%|########9 | 6.31G/7.07G [01:09<00:08, 92.5MB/s]
Downloading data: 89%|########9 | 6.32G/7.07G [01:09<00:08, 92.9MB/s]
Downloading data: 89%|########9 | 6.33G/7.07G [01:09<00:07, 93.3MB/s]
Downloading data: 90%|########9 | 6.34G/7.07G [01:09<00:07, 93.7MB/s]
Downloading data: 90%|########9 | 6.35G/7.07G [01:09<00:07, 93.8MB/s]
Downloading data: 90%|########9 | 6.36G/7.07G [01:09<00:07, 94.1MB/s]
Downloading data: 90%|######### | 6.37G/7.07G [01:09<00:07, 94.5MB/s]
Downloading data: 90%|######### | 6.38G/7.07G [01:09<00:07, 94.4MB/s]
Downloading data: 90%|######### | 6.39G/7.07G [01:09<00:07, 94.5MB/s]
Downloading data: 90%|######### | 6.40G/7.07G [01:09<00:07, 94.4MB/s]
Downloading data: 91%|######### | 6.41G/7.07G [01:10<00:07, 94.3MB/s]
Downloading data: 91%|######### | 6.41G/7.07G [01:10<00:06, 94.4MB/s]
Downloading data: 91%|######### | 6.42G/7.07G [01:10<00:06, 94.6MB/s]
Downloading data: 91%|######### | 6.43G/7.07G [01:10<00:06, 94.6MB/s]
Downloading data: 91%|#########1| 6.44G/7.07G [01:10<00:06, 94.5MB/s]
Downloading data: 91%|#########1| 6.45G/7.07G [01:10<00:06, 94.7MB/s]
Downloading data: 91%|#########1| 6.46G/7.07G [01:10<00:06, 94.5MB/s]
Downloading data: 92%|#########1| 6.47G/7.07G [01:10<00:06, 94.6MB/s]
Downloading data: 92%|#########1| 6.48G/7.07G [01:10<00:06, 94.5MB/s]
Downloading data: 92%|#########1| 6.49G/7.07G [01:10<00:06, 94.5MB/s]
Downloading data: 92%|#########1| 6.50G/7.07G [01:11<00:06, 94.4MB/s]
Downloading data: 92%|#########2| 6.51G/7.07G [01:11<00:05, 94.5MB/s]
Downloading data: 92%|#########2| 6.52G/7.07G [01:11<00:05, 94.6MB/s]
Downloading data: 92%|#########2| 6.53G/7.07G [01:11<00:05, 94.6MB/s]
Downloading data: 92%|#########2| 6.54G/7.07G [01:11<00:05, 95.0MB/s]
Downloading data: 93%|#########2| 6.55G/7.07G [01:11<00:05, 95.0MB/s]
Downloading data: 93%|#########2| 6.56G/7.07G [01:11<00:05, 94.9MB/s]
Downloading data: 93%|#########2| 6.57G/7.07G [01:11<00:05, 94.5MB/s]
Downloading data: 93%|#########2| 6.58G/7.07G [01:11<00:05, 94.5MB/s]
Downloading data: 93%|#########3| 6.59G/7.07G [01:11<00:05, 94.7MB/s]
Downloading data: 93%|#########3| 6.60G/7.07G [01:12<00:05, 94.6MB/s]
Downloading data: 93%|#########3| 6.60G/7.07G [01:12<00:04, 94.9MB/s]
Downloading data: 94%|#########3| 6.61G/7.07G [01:12<00:04, 94.9MB/s]
Downloading data: 94%|#########3| 6.62G/7.07G [01:12<00:04, 95.1MB/s]
Downloading data: 94%|#########3| 6.63G/7.07G [01:12<00:04, 95.2MB/s]
Downloading data: 94%|#########3| 6.64G/7.07G [01:12<00:04, 95.1MB/s]
Downloading data: 94%|#########4| 6.65G/7.07G [01:12<00:04, 95.2MB/s]
Downloading data: 94%|#########4| 6.66G/7.07G [01:12<00:04, 95.1MB/s]
Downloading data: 94%|#########4| 6.67G/7.07G [01:12<00:04, 95.2MB/s]
Downloading data: 94%|#########4| 6.68G/7.07G [01:12<00:04, 95.2MB/s]
Downloading data: 95%|#########4| 6.69G/7.07G [01:13<00:04, 95.3MB/s]
Downloading data: 95%|#########4| 6.70G/7.07G [01:13<00:03, 94.8MB/s]
Downloading data: 95%|#########4| 6.71G/7.07G [01:13<00:03, 94.5MB/s]
Downloading data: 95%|#########5| 6.72G/7.07G [01:13<00:03, 94.7MB/s]
Downloading data: 95%|#########5| 6.73G/7.07G [01:13<00:03, 94.9MB/s]
Downloading data: 95%|#########5| 6.74G/7.07G [01:13<00:03, 95.0MB/s]
Downloading data: 95%|#########5| 6.75G/7.07G [01:13<00:03, 95.2MB/s]
Downloading data: 96%|#########5| 6.76G/7.07G [01:13<00:03, 95.3MB/s]
Downloading data: 96%|#########5| 6.77G/7.07G [01:13<00:03, 95.3MB/s]
Downloading data: 96%|#########5| 6.78G/7.07G [01:13<00:03, 95.3MB/s]
Downloading data: 96%|#########5| 6.79G/7.07G [01:14<00:02, 95.6MB/s]
Downloading data: 96%|#########6| 6.80G/7.07G [01:14<00:02, 95.6MB/s]
Downloading data: 96%|#########6| 6.81G/7.07G [01:14<00:02, 95.4MB/s]
Downloading data: 96%|#########6| 6.81G/7.07G [01:14<00:02, 95.2MB/s]
Downloading data: 96%|#########6| 6.82G/7.07G [01:14<00:02, 95.2MB/s]
Downloading data: 97%|#########6| 6.83G/7.07G [01:14<00:02, 95.3MB/s]
Downloading data: 97%|#########6| 6.84G/7.07G [01:14<00:02, 94.9MB/s]
Downloading data: 97%|#########6| 6.85G/7.07G [01:14<00:02, 95.0MB/s]
Downloading data: 97%|#########7| 6.86G/7.07G [01:14<00:02, 95.2MB/s]
Downloading data: 97%|#########7| 6.87G/7.07G [01:14<00:02, 95.5MB/s]
Downloading data: 97%|#########7| 6.88G/7.07G [01:15<00:02, 95.4MB/s]
Downloading data: 97%|#########7| 6.89G/7.07G [01:15<00:01, 95.5MB/s]
Downloading data: 98%|#########7| 6.90G/7.07G [01:15<00:01, 95.7MB/s]
Downloading data: 98%|#########7| 6.91G/7.07G [01:15<00:01, 95.5MB/s]
Downloading data: 98%|#########7| 6.92G/7.07G [01:15<00:01, 95.6MB/s]
Downloading data: 98%|#########7| 6.93G/7.07G [01:15<00:01, 95.6MB/s]
Downloading data: 98%|#########8| 6.94G/7.07G [01:15<00:01, 95.1MB/s]
Downloading data: 98%|#########8| 6.95G/7.07G [01:15<00:01, 94.9MB/s]
Downloading data: 98%|#########8| 6.96G/7.07G [01:15<00:01, 94.9MB/s]
Downloading data: 99%|#########8| 6.97G/7.07G [01:15<00:01, 95.0MB/s]
Downloading data: 99%|#########8| 6.98G/7.07G [01:16<00:01, 94.7MB/s]
Downloading data: 99%|#########8| 6.99G/7.07G [01:16<00:00, 94.7MB/s]
Downloading data: 99%|#########8| 7.00G/7.07G [01:16<00:00, 94.7MB/s]
Downloading data: 99%|#########9| 7.01G/7.07G [01:16<00:00, 94.4MB/s]
Downloading data: 99%|#########9| 7.01G/7.07G [01:16<00:00, 94.5MB/s]
Downloading data: 99%|#########9| 7.02G/7.07G [01:16<00:00, 94.8MB/s]
Downloading data: 99%|#########9| 7.03G/7.07G [01:16<00:00, 94.5MB/s]
Downloading data: 100%|#########9| 7.04G/7.07G [01:16<00:00, 94.4MB/s]
Downloading data: 100%|#########9| 7.05G/7.07G [01:16<00:00, 94.6MB/s]
Downloading data: 100%|#########9| 7.06G/7.07G [01:16<00:00, 94.6MB/s]
Downloading data: 100%|#########9| 7.07G/7.07G [01:17<00:00, 94.9MB/s]
Downloading data: 100%|##########| 7.07G/7.07G [01:17<00:00, 91.8MB/s]
Downloading data: 0%| | 0.00/970M [00:00<?, ?B/s]
Downloading data: 1%| | 8.26M/970M [00:00<00:11, 82.6MB/s]
Downloading data: 2%|1 | 17.3M/970M [00:00<00:10, 87.4MB/s]
Downloading data: 3%|2 | 26.3M/970M [00:00<00:10, 88.6MB/s]
Downloading data: 4%|3 | 35.5M/970M [00:00<00:10, 89.6MB/s]
Downloading data: 5%|4 | 44.6M/970M [00:00<00:10, 90.4MB/s]
Downloading data: 6%|5 | 53.9M/970M [00:00<00:10, 91.1MB/s]
Downloading data: 7%|6 | 63.1M/970M [00:00<00:09, 91.4MB/s]
Downloading data: 7%|7 | 72.2M/970M [00:00<00:09, 91.5MB/s]
Downloading data: 8%|8 | 81.4M/970M [00:00<00:09, 91.6MB/s]
Downloading data: 9%|9 | 90.6M/970M [00:01<00:09, 91.1MB/s]
Downloading data: 10%|# | 99.7M/970M [00:01<00:09, 91.2MB/s]
Downloading data: 11%|#1 | 109M/970M [00:01<00:09, 91.3MB/s]
Downloading data: 12%|#2 | 118M/970M [00:01<00:09, 91.2MB/s]
Downloading data: 13%|#3 | 127M/970M [00:01<00:09, 91.4MB/s]
Downloading data: 14%|#4 | 136M/970M [00:01<00:09, 91.5MB/s]
Downloading data: 15%|#5 | 146M/970M [00:01<00:09, 91.6MB/s]
Downloading data: 16%|#5 | 155M/970M [00:01<00:08, 91.5MB/s]
Downloading data: 17%|#6 | 164M/970M [00:01<00:08, 91.6MB/s]
Downloading data: 18%|#7 | 173M/970M [00:01<00:08, 91.8MB/s]
Downloading data: 19%|#8 | 182M/970M [00:02<00:08, 91.8MB/s]
Downloading data: 20%|#9 | 192M/970M [00:02<00:08, 91.5MB/s]
Downloading data: 21%|## | 201M/970M [00:02<00:08, 91.3MB/s]
Downloading data: 22%|##1 | 210M/970M [00:02<00:08, 91.6MB/s]
Downloading data: 23%|##2 | 219M/970M [00:02<00:08, 91.7MB/s]
Downloading data: 24%|##3 | 228M/970M [00:02<00:08, 91.7MB/s]
Downloading data: 24%|##4 | 237M/970M [00:02<00:07, 91.9MB/s]
Downloading data: 25%|##5 | 247M/970M [00:02<00:07, 92.0MB/s]
Downloading data: 26%|##6 | 256M/970M [00:02<00:07, 92.1MB/s]
Downloading data: 27%|##7 | 265M/970M [00:02<00:07, 92.3MB/s]
Downloading data: 28%|##8 | 274M/970M [00:03<00:07, 92.4MB/s]
Downloading data: 29%|##9 | 284M/970M [00:03<00:07, 92.7MB/s]
Downloading data: 30%|### | 293M/970M [00:03<00:07, 92.3MB/s]
Downloading data: 31%|###1 | 302M/970M [00:03<00:07, 92.4MB/s]
Downloading data: 32%|###2 | 312M/970M [00:03<00:07, 92.4MB/s]
Downloading data: 33%|###3 | 321M/970M [00:03<00:07, 92.5MB/s]
Downloading data: 34%|###4 | 330M/970M [00:03<00:06, 92.4MB/s]
Downloading data: 35%|###4 | 339M/970M [00:03<00:06, 92.3MB/s]
Downloading data: 36%|###5 | 349M/970M [00:03<00:06, 92.5MB/s]
Downloading data: 37%|###6 | 358M/970M [00:03<00:06, 92.5MB/s]
Downloading data: 38%|###7 | 367M/970M [00:04<00:06, 92.6MB/s]
Downloading data: 39%|###8 | 377M/970M [00:04<00:06, 92.5MB/s]
Downloading data: 40%|###9 | 386M/970M [00:04<00:06, 92.6MB/s]
Downloading data: 41%|#### | 395M/970M [00:04<00:06, 92.4MB/s]
Downloading data: 42%|####1 | 404M/970M [00:04<00:06, 92.2MB/s]
Downloading data: 43%|####2 | 414M/970M [00:04<00:06, 92.0MB/s]
Downloading data: 44%|####3 | 423M/970M [00:04<00:05, 91.8MB/s]
Downloading data: 45%|####4 | 432M/970M [00:04<00:05, 91.6MB/s]
Downloading data: 45%|####5 | 441M/970M [00:04<00:05, 91.7MB/s]
Downloading data: 46%|####6 | 450M/970M [00:04<00:05, 91.7MB/s]
Downloading data: 47%|####7 | 459M/970M [00:05<00:05, 91.5MB/s]
Downloading data: 48%|####8 | 469M/970M [00:05<00:05, 91.5MB/s]
Downloading data: 49%|####9 | 478M/970M [00:05<00:05, 91.9MB/s]
Downloading data: 50%|##### | 487M/970M [00:05<00:05, 91.9MB/s]
Downloading data: 51%|#####1 | 496M/970M [00:05<00:05, 91.9MB/s]
Downloading data: 52%|#####2 | 505M/970M [00:05<00:05, 91.9MB/s]
Downloading data: 53%|#####3 | 515M/970M [00:05<00:04, 92.0MB/s]
Downloading data: 54%|#####3 | 524M/970M [00:05<00:04, 91.8MB/s]
Downloading data: 55%|#####4 | 533M/970M [00:05<00:04, 92.0MB/s]
Downloading data: 56%|#####5 | 542M/970M [00:05<00:04, 92.0MB/s]
Downloading data: 57%|#####6 | 552M/970M [00:06<00:04, 92.0MB/s]
Downloading data: 58%|#####7 | 561M/970M [00:06<00:04, 92.2MB/s]
Downloading data: 59%|#####8 | 570M/970M [00:06<00:04, 92.0MB/s]
Downloading data: 60%|#####9 | 579M/970M [00:06<00:04, 92.5MB/s]
Downloading data: 61%|###### | 589M/970M [00:06<00:04, 92.4MB/s]
Downloading data: 62%|######1 | 598M/970M [00:06<00:04, 92.2MB/s]
Downloading data: 63%|######2 | 607M/970M [00:06<00:03, 92.2MB/s]
Downloading data: 64%|######3 | 616M/970M [00:06<00:03, 92.4MB/s]
Downloading data: 64%|######4 | 626M/970M [00:06<00:03, 92.4MB/s]
Downloading data: 65%|######5 | 635M/970M [00:06<00:03, 92.5MB/s]
Downloading data: 66%|######6 | 644M/970M [00:07<00:03, 92.3MB/s]
Downloading data: 67%|######7 | 653M/970M [00:07<00:03, 92.3MB/s]
Downloading data: 68%|######8 | 663M/970M [00:07<00:03, 92.2MB/s]
Downloading data: 69%|######9 | 672M/970M [00:07<00:03, 92.3MB/s]
Downloading data: 70%|####### | 681M/970M [00:07<00:03, 92.3MB/s]
Downloading data: 71%|#######1 | 690M/970M [00:07<00:03, 92.4MB/s]
Downloading data: 72%|#######2 | 700M/970M [00:07<00:02, 92.3MB/s]
Downloading data: 73%|#######3 | 709M/970M [00:07<00:02, 92.3MB/s]
Downloading data: 74%|#######4 | 718M/970M [00:07<00:02, 92.4MB/s]
Downloading data: 75%|#######4 | 727M/970M [00:07<00:02, 92.2MB/s]
Downloading data: 76%|#######5 | 737M/970M [00:08<00:02, 92.0MB/s]
Downloading data: 77%|#######6 | 746M/970M [00:08<00:02, 92.0MB/s]
Downloading data: 78%|#######7 | 755M/970M [00:08<00:02, 92.1MB/s]
Downloading data: 79%|#######8 | 764M/970M [00:08<00:02, 92.2MB/s]
Downloading data: 80%|#######9 | 774M/970M [00:08<00:02, 92.4MB/s]
Downloading data: 81%|######## | 783M/970M [00:08<00:02, 92.6MB/s]
Downloading data: 82%|########1 | 792M/970M [00:08<00:01, 92.8MB/s]
Downloading data: 83%|########2 | 801M/970M [00:08<00:01, 92.6MB/s]
Downloading data: 84%|########3 | 811M/970M [00:08<00:01, 92.6MB/s]
Downloading data: 85%|########4 | 820M/970M [00:08<00:01, 92.7MB/s]
Downloading data: 85%|########5 | 829M/970M [00:09<00:01, 92.9MB/s]
Downloading data: 86%|########6 | 839M/970M [00:09<00:01, 92.7MB/s]
Downloading data: 87%|########7 | 848M/970M [00:09<00:01, 92.2MB/s]
Downloading data: 88%|########8 | 857M/970M [00:09<00:01, 92.2MB/s]
Downloading data: 89%|########9 | 866M/970M [00:09<00:01, 92.1MB/s]
Downloading data: 90%|######### | 876M/970M [00:09<00:01, 92.3MB/s]
Downloading data: 91%|#########1| 885M/970M [00:09<00:00, 92.0MB/s]
Downloading data: 92%|#########2| 894M/970M [00:09<00:00, 91.6MB/s]
Downloading data: 93%|#########3| 903M/970M [00:09<00:00, 91.4MB/s]
Downloading data: 94%|#########4| 912M/970M [00:09<00:00, 91.4MB/s]
Downloading data: 95%|#########4| 922M/970M [00:10<00:00, 91.6MB/s]
Downloading data: 96%|#########5| 931M/970M [00:10<00:00, 91.6MB/s]
Downloading data: 97%|#########6| 940M/970M [00:10<00:00, 91.8MB/s]
Downloading data: 98%|#########7| 949M/970M [00:10<00:00, 91.9MB/s]
Downloading data: 99%|#########8| 958M/970M [00:10<00:00, 91.7MB/s]
Downloading data: 100%|#########9| 968M/970M [00:10<00:00, 91.8MB/s]
Downloading data: 100%|##########| 970M/970M [00:10<00:00, 91.9MB/s]
Generating train split: 0%| | 0/34602 [00:00<?, ? examples/s]
Generating train split: 0%| | 1/34602 [00:00<4:32:50, 2.11 examples/s]
Generating train split: 2%|1 | 541/34602 [00:00<00:27, 1253.44 examples/s]
Generating train split: 3%|2 | 1000/34602 [00:00<00:16, 2070.20 examples/s]
Generating train split: 5%|4 | 1580/34602 [00:00<00:10, 3041.84 examples/s]
Generating train split: 6%|5 | 2075/34602 [00:00<00:09, 3559.20 examples/s]
Generating train split: 8%|7 | 2650/34602 [00:00<00:07, 4169.56 examples/s]
Generating train split: 10%|9 | 3424/34602 [00:01<00:06, 4535.68 examples/s]
Generating train split: 12%|#1 | 3995/34602 [00:01<00:06, 4842.07 examples/s]
Generating train split: 14%|#3 | 4773/34602 [00:01<00:06, 4963.52 examples/s]
Generating train split: 16%|#6 | 5577/34602 [00:01<00:05, 5046.59 examples/s]
Generating train split: 18%|#8 | 6350/34602 [00:01<00:05, 5078.52 examples/s]
Generating train split: 20%|## | 6926/34602 [00:01<00:05, 5237.36 examples/s]
Generating train split: 22%|##2 | 7713/34602 [00:01<00:05, 5238.03 examples/s]
Generating train split: 25%|##4 | 8489/34602 [00:02<00:05, 5212.56 examples/s]
Generating train split: 27%|##6 | 9294/34602 [00:02<00:04, 5248.48 examples/s]
Generating train split: 29%|##8 | 9870/34602 [00:02<00:04, 5363.99 examples/s]
Generating train split: 31%|### | 10642/34602 [00:02<00:04, 5287.72 examples/s]
Generating train split: 33%|###2 | 11416/34602 [00:02<00:04, 5243.21 examples/s]
Generating train split: 35%|###4 | 11972/34602 [00:02<00:04, 5316.56 examples/s]
Generating train split: 37%|###6 | 12718/34602 [00:02<00:04, 5198.72 examples/s]
Generating train split: 38%|###8 | 13295/34602 [00:02<00:04, 5168.23 examples/s]
Generating train split: 40%|#### | 13881/34602 [00:03<00:03, 5340.34 examples/s]
Generating train split: 42%|####2 | 14660/34602 [00:03<00:03, 5285.43 examples/s]
Generating train split: 45%|####4 | 15434/34602 [00:03<00:03, 5240.68 examples/s]
Generating train split: 46%|####6 | 16000/34602 [00:03<00:03, 5198.93 examples/s]
Generating train split: 48%|####7 | 16587/34602 [00:03<00:03, 5364.40 examples/s]
Generating train split: 50%|##### | 17385/34602 [00:03<00:03, 5344.54 examples/s]
Generating train split: 52%|#####1 | 17951/34602 [00:03<00:03, 5421.42 examples/s]
Generating train split: 54%|#####4 | 18723/34602 [00:04<00:02, 5319.75 examples/s]
Generating train split: 56%|#####6 | 19458/34602 [00:04<00:02, 5175.24 examples/s]
Generating train split: 58%|#####7 | 20000/34602 [00:04<00:02, 5065.53 examples/s]
Generating train split: 59%|#####9 | 20549/34602 [00:04<00:02, 5170.17 examples/s]
Generating train split: 61%|######1 | 21279/34602 [00:04<00:02, 5060.67 examples/s]
Generating train split: 63%|######3 | 21809/34602 [00:04<00:02, 5116.56 examples/s]
Generating train split: 65%|######5 | 22536/34602 [00:04<00:02, 5005.71 examples/s]
Generating train split: 67%|######7 | 23269/34602 [00:04<00:02, 4936.61 examples/s]
Generating train split: 69%|######8 | 23800/34602 [00:05<00:02, 5024.01 examples/s]
Generating train split: 71%|####### | 24541/34602 [00:05<00:02, 4959.44 examples/s]
Generating train split: 73%|#######3 | 25293/34602 [00:05<00:01, 4973.97 examples/s]
Generating train split: 75%|#######4 | 25848/34602 [00:05<00:01, 5107.23 examples/s]
Generating train split: 77%|#######6 | 26633/34602 [00:05<00:01, 5145.64 examples/s]
Generating train split: 79%|#######9 | 27410/34602 [00:05<00:01, 5154.23 examples/s]
Generating train split: 81%|######## | 27989/34602 [00:05<00:01, 5302.00 examples/s]
Generating train split: 83%|########3 | 28756/34602 [00:05<00:01, 5236.45 examples/s]
Generating train split: 85%|########5 | 29562/34602 [00:06<00:00, 5179.81 examples/s]
Generating train split: 88%|########7 | 30334/34602 [00:06<00:00, 5166.30 examples/s]
Generating train split: 89%|########9 | 30900/34602 [00:06<00:00, 5277.74 examples/s]
Generating train split: 92%|#########1| 31680/34602 [00:06<00:00, 5248.37 examples/s]
Generating train split: 94%|#########3| 32443/34602 [00:06<00:00, 5192.09 examples/s]
Generating train split: 95%|#########5| 33000/34602 [00:06<00:00, 5117.47 examples/s]
Generating train split: 97%|#########6| 33550/34602 [00:06<00:00, 5209.05 examples/s]
Generating train split: 99%|#########9| 34318/34602 [00:07<00:00, 5174.06 examples/s]
Generating train split: 100%|##########| 34602/34602 [00:07<00:00, 4833.66 examples/s]
Generating validation split: 0%| | 0/5000 [00:00<?, ? examples/s]
Generating validation split: 8%|7 | 383/5000 [00:00<00:01, 3813.47 examples/s]
Generating validation split: 19%|#8 | 947/5000 [00:00<00:00, 4876.93 examples/s]
Generating validation split: 34%|###3 | 1695/5000 [00:00<00:00, 4933.94 examples/s]
Generating validation split: 49%|####9 | 2456/5000 [00:00<00:00, 4993.09 examples/s]
Generating validation split: 60%|###### | 3000/5000 [00:00<00:00, 4962.62 examples/s]
Generating validation split: 71%|#######1 | 3567/5000 [00:00<00:00, 5167.27 examples/s]
Generating validation split: 87%|########6 | 4334/5000 [00:00<00:00, 5142.47 examples/s]
Generating validation split: 98%|#########7| 4892/5000 [00:00<00:00, 5257.37 examples/s]
Generating validation split: 100%|##########| 5000/5000 [00:01<00:00, 4991.21 examples/s]
Generating test split: 0%| | 0/5734 [00:00<?, ? examples/s]
Generating test split: 8%|8 | 459/5734 [00:00<00:01, 4571.61 examples/s]
Generating test split: 17%|#7 | 1000/5734 [00:00<00:00, 4802.79 examples/s]
Generating test split: 28%|##7 | 1595/5734 [00:00<00:00, 5306.99 examples/s]
Generating test split: 42%|####1 | 2397/5734 [00:00<00:00, 5320.90 examples/s]
Generating test split: 52%|#####2 | 2994/5734 [00:00<00:00, 5524.41 examples/s]
Generating test split: 66%|######6 | 3797/5734 [00:00<00:00, 5448.84 examples/s]
Generating test split: 80%|######## | 4592/5734 [00:00<00:00, 5389.38 examples/s]
Generating test split: 94%|#########4| 5403/5734 [00:01<00:00, 5392.51 examples/s]
Generating test split: 100%|##########| 5734/5734 [00:01<00:00, 4584.18 examples/s]
让我们显示数据集中的一个示例条目：
import matplotlib.pyplot as plt
import numpy as np
idx = 5
print("Question: ", dataset["train"][idx]["question"])
print("Answers: " ,dataset["train"][idx]["answers"])
im = np.asarray(dataset["train"][idx]["image"].resize((500,500)))
plt.imshow(im)
plt.show()
Question: what year is shown in the photo?
Answers: ['2011', '2011', '2011', '2011', '2011', '2011', '2011', '2011', '2011', '2011']
3. 接下来，我们编写 transform 函数，将图像和文本转换为
模型可使用的张量 - 对于图像，我们使用
torchvision 转换为 Tensor 并调整大小为统一大小 - 对于文本，
我们使用 Hugging Face 的 -
对于答案（即标签），我们采用出现频率最高的答案
作为 label to train with：BertTokenizer
import torch
from torchvision import transforms
from collections import defaultdict
from transformers import BertTokenizer
from functools import partial
def transform(tokenizer, input):
batch = {}
image_transform = transforms.Compose([transforms.ToTensor(), transforms.Resize([224,224])])
image = image_transform(input["image"][0].convert("RGB"))
batch["image"] = [image]
tokenized=tokenizer(input["question"],return_tensors='pt',padding="max_length",max_length=512)
batch.update(tokenized)
ans_to_count = defaultdict(int)
for ans in input["answers"][0]:
ans_to_count[ans] += 1
max_value = max(ans_to_count, key=ans_to_count.get)
ans_idx = answer_to_idx.get(max_value,0)
batch["answers"] = torch.as_tensor([ans_idx])
return batch
tokenizer=BertTokenizer.from_pretrained("bert-base-uncased",padding="max_length",max_length=512)
transform=partial(transform,tokenizer)
dataset.set_transform(transform)
4. 最后，我们导入 from .默认情况下，它会加载预训练的 FLAVA 检查点，并且
包括一个分类头。flava_model_for_classificationtorchmultimodal
模型正向功能通过可视编码器传递图像 和问题。图片和问题 然后，嵌入通过 Multi Modal Encoder 传递。决赛 与 CLS 令牌对应的嵌入通过 MLP 头传递 它最终给出了每种可能的概率分布 答案。
from torchmultimodal.models.flava.model import flava_model_for_classification
model = flava_model_for_classification(num_classes=len(vocab))
flava_for_pretraining_unified_text_encoder.pt: 0.00B [00:00, ?B/s]
flava_for_pretraining_unified_text_encoder.pt: 0%| | 8.19k/1.43G [00:00<7:03:33, 56.3kB/s]
flava_for_pretraining_unified_text_encoder.pt: 1%|1 | 17.2M/1.43G [00:00<00:17, 79.1MB/s]
flava_for_pretraining_unified_text_encoder.pt: 2%|2 | 34.1M/1.43G [00:00<00:12, 115MB/s]
flava_for_pretraining_unified_text_encoder.pt: 2%|2 | 34.9M/1.43G [00:00<00:18, 76.1MB/s]
flava_for_pretraining_unified_text_encoder.pt: 4%|3 | 51.5M/1.43G [00:00<00:15, 90.4MB/s]
flava_for_pretraining_unified_text_encoder.pt: 5%|4 | 68.7M/1.43G [00:00<00:14, 96.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 6%|5 | 85.5M/1.43G [00:00<00:11, 116MB/s]
flava_for_pretraining_unified_text_encoder.pt: 6%|6 | 85.9M/1.43G [00:00<00:16, 83.1MB/s]
flava_for_pretraining_unified_text_encoder.pt: 7%|7 | 103M/1.43G [00:01<00:14, 93.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 8%|8 | 120M/1.43G [00:01<00:13, 100MB/s]
flava_for_pretraining_unified_text_encoder.pt: 10%|9 | 137M/1.43G [00:01<00:11, 116MB/s]
flava_for_pretraining_unified_text_encoder.pt: 10%|9 | 137M/1.43G [00:01<00:15, 85.6MB/s]
flava_for_pretraining_unified_text_encoder.pt: 11%|# | 155M/1.43G [00:01<00:13, 94.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 12%|#2 | 172M/1.43G [00:01<00:12, 102MB/s]
flava_for_pretraining_unified_text_encoder.pt: 13%|#3 | 188M/1.43G [00:01<00:10, 117MB/s]
flava_for_pretraining_unified_text_encoder.pt: 13%|#3 | 189M/1.43G [00:02<00:13, 88.8MB/s]
flava_for_pretraining_unified_text_encoder.pt: 14%|#4 | 206M/1.43G [00:02<00:12, 100MB/s]
flava_for_pretraining_unified_text_encoder.pt: 16%|#5 | 222M/1.43G [00:02<00:10, 116MB/s]
flava_for_pretraining_unified_text_encoder.pt: 16%|#5 | 226M/1.43G [00:02<00:12, 95.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 17%|#6 | 241M/1.43G [00:02<00:12, 92.6MB/s]
flava_for_pretraining_unified_text_encoder.pt: 18%|#8 | 258M/1.43G [00:02<00:12, 95.3MB/s]
flava_for_pretraining_unified_text_encoder.pt: 19%|#9 | 275M/1.43G [00:02<00:11, 99.4MB/s]
flava_for_pretraining_unified_text_encoder.pt: 20%|## | 292M/1.43G [00:02<00:09, 115MB/s]
flava_for_pretraining_unified_text_encoder.pt: 21%|## | 298M/1.43G [00:03<00:10, 103MB/s]
flava_for_pretraining_unified_text_encoder.pt: 22%|##1 | 309M/1.43G [00:03<00:12, 91.4MB/s]
flava_for_pretraining_unified_text_encoder.pt: 23%|##2 | 326M/1.43G [00:03<00:11, 94.3MB/s]
flava_for_pretraining_unified_text_encoder.pt: 24%|##4 | 344M/1.43G [00:03<00:11, 93.2MB/s]
flava_for_pretraining_unified_text_encoder.pt: 25%|##5 | 361M/1.43G [00:03<00:10, 103MB/s]
flava_for_pretraining_unified_text_encoder.pt: 26%|##6 | 377M/1.43G [00:03<00:09, 115MB/s]
flava_for_pretraining_unified_text_encoder.pt: 26%|##6 | 379M/1.43G [00:03<00:11, 92.1MB/s]
flava_for_pretraining_unified_text_encoder.pt: 28%|##7 | 395M/1.43G [00:04<00:10, 95.5MB/s]
flava_for_pretraining_unified_text_encoder.pt: 29%|##8 | 412M/1.43G [00:04<00:11, 88.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 30%|### | 429M/1.43G [00:04<00:09, 104MB/s]
flava_for_pretraining_unified_text_encoder.pt: 31%|###1 | 446M/1.43G [00:04<00:08, 117MB/s]
flava_for_pretraining_unified_text_encoder.pt: 32%|###1 | 456M/1.43G [00:04<00:08, 113MB/s]
flava_for_pretraining_unified_text_encoder.pt: 32%|###2 | 464M/1.43G [00:04<00:11, 86.3MB/s]
flava_for_pretraining_unified_text_encoder.pt: 34%|###3 | 481M/1.43G [00:04<00:10, 90.4MB/s]
flava_for_pretraining_unified_text_encoder.pt: 35%|###4 | 498M/1.43G [00:05<00:09, 98.6MB/s]
flava_for_pretraining_unified_text_encoder.pt: 36%|###6 | 515M/1.43G [00:05<00:09, 98.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 37%|###7 | 533M/1.43G [00:05<00:09, 93.4MB/s]
flava_for_pretraining_unified_text_encoder.pt: 38%|###8 | 550M/1.43G [00:05<00:08, 103MB/s]
flava_for_pretraining_unified_text_encoder.pt: 40%|###9 | 567M/1.43G [00:05<00:07, 117MB/s]
flava_for_pretraining_unified_text_encoder.pt: 40%|#### | 574M/1.43G [00:05<00:08, 106MB/s]
flava_for_pretraining_unified_text_encoder.pt: 41%|#### | 584M/1.43G [00:05<00:09, 87.8MB/s]
flava_for_pretraining_unified_text_encoder.pt: 42%|####2 | 601M/1.43G [00:06<00:08, 95.6MB/s]
flava_for_pretraining_unified_text_encoder.pt: 43%|####3 | 618M/1.43G [00:06<00:08, 96.8MB/s]
flava_for_pretraining_unified_text_encoder.pt: 44%|####4 | 636M/1.43G [00:06<00:07, 99.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 46%|####5 | 653M/1.43G [00:06<00:07, 97.3MB/s]
flava_for_pretraining_unified_text_encoder.pt: 47%|####6 | 670M/1.43G [00:06<00:07, 97.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 48%|####7 | 686M/1.43G [00:06<00:06, 111MB/s]
flava_for_pretraining_unified_text_encoder.pt: 48%|####8 | 692M/1.43G [00:07<00:07, 99.0MB/s]
flava_for_pretraining_unified_text_encoder.pt: 49%|####9 | 704M/1.43G [00:07<00:07, 103MB/s]
flava_for_pretraining_unified_text_encoder.pt: 50%|##### | 720M/1.43G [00:07<00:06, 118MB/s]
flava_for_pretraining_unified_text_encoder.pt: 51%|##### | 724M/1.43G [00:07<00:07, 96.3MB/s]
flava_for_pretraining_unified_text_encoder.pt: 52%|#####1 | 739M/1.43G [00:07<00:07, 91.1MB/s]
flava_for_pretraining_unified_text_encoder.pt: 53%|#####2 | 756M/1.43G [00:07<00:06, 99.1MB/s]
flava_for_pretraining_unified_text_encoder.pt: 54%|#####4 | 773M/1.43G [00:07<00:05, 115MB/s]
flava_for_pretraining_unified_text_encoder.pt: 54%|#####4 | 776M/1.43G [00:07<00:07, 93.4MB/s]
flava_for_pretraining_unified_text_encoder.pt: 55%|#####5 | 790M/1.43G [00:07<00:06, 95.6MB/s]
flava_for_pretraining_unified_text_encoder.pt: 56%|#####6 | 807M/1.43G [00:08<00:06, 97.7MB/s]
flava_for_pretraining_unified_text_encoder.pt: 58%|#####7 | 824M/1.43G [00:08<00:05, 113MB/s]
flava_for_pretraining_unified_text_encoder.pt: 58%|#####7 | 827M/1.43G [00:08<00:06, 92.5MB/s]
flava_for_pretraining_unified_text_encoder.pt: 59%|#####8 | 842M/1.43G [00:08<00:06, 91.6MB/s]
flava_for_pretraining_unified_text_encoder.pt: 60%|###### | 859M/1.43G [00:08<00:06, 94.5MB/s]
flava_for_pretraining_unified_text_encoder.pt: 61%|######1 | 876M/1.43G [00:08<00:05, 103MB/s]
flava_for_pretraining_unified_text_encoder.pt: 62%|######2 | 892M/1.43G [00:08<00:04, 116MB/s]
flava_for_pretraining_unified_text_encoder.pt: 62%|######2 | 894M/1.43G [00:09<00:05, 91.3MB/s]
flava_for_pretraining_unified_text_encoder.pt: 64%|######3 | 911M/1.43G [00:09<00:06, 84.4MB/s]
flava_for_pretraining_unified_text_encoder.pt: 65%|######4 | 928M/1.43G [00:09<00:05, 96.6MB/s]
flava_for_pretraining_unified_text_encoder.pt: 66%|######6 | 945M/1.43G [00:09<00:04, 105MB/s]
flava_for_pretraining_unified_text_encoder.pt: 67%|######7 | 961M/1.43G [00:09<00:03, 119MB/s]
flava_for_pretraining_unified_text_encoder.pt: 68%|######7 | 969M/1.43G [00:09<00:04, 108MB/s]
flava_for_pretraining_unified_text_encoder.pt: 68%|######8 | 979M/1.43G [00:09<00:05, 88.5MB/s]
flava_for_pretraining_unified_text_encoder.pt: 70%|######9 | 996M/1.43G [00:10<00:04, 101MB/s]
flava_for_pretraining_unified_text_encoder.pt: 71%|####### | 1.01G/1.43G [00:10<00:03, 115MB/s]
flava_for_pretraining_unified_text_encoder.pt: 71%|#######1 | 1.02G/1.43G [00:10<00:03, 105MB/s]
flava_for_pretraining_unified_text_encoder.pt: 72%|#######2 | 1.03G/1.43G [00:10<00:04, 91.2MB/s]
flava_for_pretraining_unified_text_encoder.pt: 73%|#######3 | 1.05G/1.43G [00:10<00:03, 99.3MB/s]
flava_for_pretraining_unified_text_encoder.pt: 73%|#######3 | 1.05G/1.43G [00:10<00:05, 72.2MB/s]
flava_for_pretraining_unified_text_encoder.pt: 74%|#######4 | 1.07G/1.43G [00:10<00:03, 95.6MB/s]
flava_for_pretraining_unified_text_encoder.pt: 76%|#######5 | 1.08G/1.43G [00:10<00:03, 106MB/s]
flava_for_pretraining_unified_text_encoder.pt: 77%|#######6 | 1.10G/1.43G [00:11<00:02, 121MB/s]
flava_for_pretraining_unified_text_encoder.pt: 77%|#######6 | 1.10G/1.43G [00:11<00:03, 86.3MB/s]
flava_for_pretraining_unified_text_encoder.pt: 78%|#######8 | 1.12G/1.43G [00:11<00:03, 97.8MB/s]
flava_for_pretraining_unified_text_encoder.pt: 79%|#######9 | 1.13G/1.43G [00:11<00:02, 99.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 80%|######## | 1.15G/1.43G [00:11<00:02, 111MB/s]
flava_for_pretraining_unified_text_encoder.pt: 81%|######## | 1.16G/1.43G [00:11<00:02, 102MB/s]
flava_for_pretraining_unified_text_encoder.pt: 82%|########1 | 1.17G/1.43G [00:11<00:02, 94.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 83%|########2 | 1.19G/1.43G [00:11<00:02, 99.1MB/s]
flava_for_pretraining_unified_text_encoder.pt: 84%|########4 | 1.20G/1.43G [00:12<00:02, 100MB/s]
flava_for_pretraining_unified_text_encoder.pt: 85%|########4 | 1.21G/1.43G [00:12<00:02, 92.8MB/s]
flava_for_pretraining_unified_text_encoder.pt: 85%|########5 | 1.22G/1.43G [00:12<00:02, 83.2MB/s]
flava_for_pretraining_unified_text_encoder.pt: 86%|########6 | 1.24G/1.43G [00:12<00:02, 96.0MB/s]
flava_for_pretraining_unified_text_encoder.pt: 88%|########7 | 1.25G/1.43G [00:12<00:01, 103MB/s]
flava_for_pretraining_unified_text_encoder.pt: 89%|########8 | 1.27G/1.43G [00:12<00:01, 109MB/s]
flava_for_pretraining_unified_text_encoder.pt: 90%|########9 | 1.29G/1.43G [00:12<00:01, 121MB/s]
flava_for_pretraining_unified_text_encoder.pt: 91%|######### | 1.30G/1.43G [00:12<00:01, 110MB/s]
flava_for_pretraining_unified_text_encoder.pt: 91%|#########1| 1.31G/1.43G [00:13<00:01, 91.3MB/s]
flava_for_pretraining_unified_text_encoder.pt: 92%|#########2| 1.32G/1.43G [00:13<00:01, 93.1MB/s]
flava_for_pretraining_unified_text_encoder.pt: 94%|#########3| 1.34G/1.43G [00:13<00:00, 105MB/s]
flava_for_pretraining_unified_text_encoder.pt: 95%|#########4| 1.36G/1.43G [00:13<00:00, 116MB/s]
flava_for_pretraining_unified_text_encoder.pt: 95%|#########4| 1.36G/1.43G [00:13<00:00, 93.4MB/s]
flava_for_pretraining_unified_text_encoder.pt: 96%|#########6| 1.37G/1.43G [00:13<00:00, 82.6MB/s]
flava_for_pretraining_unified_text_encoder.pt: 97%|#########7| 1.39G/1.43G [00:14<00:00, 93.9MB/s]
flava_for_pretraining_unified_text_encoder.pt: 98%|#########8| 1.41G/1.43G [00:14<00:00, 106MB/s]
flava_for_pretraining_unified_text_encoder.pt: 100%|#########9| 1.43G/1.43G [00:14<00:00, 119MB/s]
flava_for_pretraining_unified_text_encoder.pt: 100%|#########9| 1.43G/1.43G [00:14<00:00, 88.6MB/s]
flava_for_pretraining_unified_text_encoder.pt: 100%|#########9| 1.43G/1.43G [00:14<00:00, 70.7MB/s]
flava_for_pretraining_unified_text_encoder.pt: 1.43GB [00:14, 98.5MB/s]
/usr/local/lib/python3.10/dist-packages/torchmultimodal/utils/common.py:106: FutureWarning:
You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
5. 我们将数据集和模型放在一个玩具训练循环中，以 演示如何训练模型进行 3 次迭代：
from torch import nn
BATCH_SIZE = 2
MAX_STEPS = 3
from torch.utils.data import DataLoader
train_dataloader = DataLoader(dataset["train"], batch_size= BATCH_SIZE)
optimizer = torch.optim.AdamW(model.parameters())
epochs = 1
for _ in range(epochs):
for idx, batch in enumerate(train_dataloader):
optimizer.zero_grad()
out = model(text = batch["input_ids"], image = batch["image"], labels = batch["answers"])
loss = out.loss
loss.backward()
optimizer.step()
print(f"Loss at step {idx} = {loss}")
if idx >= MAX_STEPS-1:
break
Loss at step 0 = 8.290360450744629
Loss at step 1 = 8.358966827392578
Loss at step 2 = 8.274675369262695