0% An exception was thrown by producer or consumer, backtrace: Traceback (most recent call last):
File "/opt/conda/lib/python3.8/site-packages/oss2/task_queue.py", line 76, in __consumer_func
consumer(self)
File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 410, in __consumer
self.__download_part(part)
File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 425, in __download_part
utils.copyfileobj_and_verify(result, f, part.end - part.start, request_id=result.request_id)
File "/opt/conda/lib/python3.8/site-packages/oss2/utils.py", line 860, in copyfileobj_and_verify
fdst.write(buf)
OSError: [Errno 22] Invalid argument
0% An exception was thrown by producer or consumer, backtrace: Traceback (most recent call last):
File "/opt/conda/lib/python3.8/site-packages/oss2/task_queue.py", line 76, in __consumer_func
consumer(self)
File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 410, in __consumer
self.__download_part(part)
File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 425, in __download_part
utils.copyfileobj_and_verify(result, f, part.end - part.start, request_id=result.request_id)
File "/opt/conda/lib/python3.8/site-packages/oss2/utils.py", line 860, in copyfileobj_and_verify
fdst.write(buf)
OSError: [Errno 22] Invalid argument
0% An exception was thrown by producer or consumer, backtrace: Traceback (most recent call last):
File "/opt/conda/lib/python3.8/site-packages/oss2/task_queue.py", line 76, in __consumer_func
consumer(self)
File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 410, in __consumer
self.__download_part(part)
File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 425, in __download_part
utils.copyfileobj_and_verify(result, f, part.end - part.start, request_id=result.request_id)
File "/opt/conda/lib/python3.8/site-packages/oss2/utils.py", line 860, in copyfileobj_and_verify
fdst.write(buf)
OSError: [Errno 22] Invalid argument
Traceback (most recent call last):
File "pretrain_videos_download.py", line 29, in <module>
test_download()
File "pretrain_videos_download.py", line 25, in test_download
for item in data:
File "/opt/conda/lib/python3.8/site-packages/modelscope/msdatasets/ms_dataset.py", line 74, in __iter__
for item in self._hf_ds:
File "/opt/conda/lib/python3.8/site-packages/modelscope/msdatasets/dataset_cls/dataset.py", line 101, in __iter__
ex_cache_path = dl_manager.download_and_extract(v)
File "/opt/conda/lib/python3.8/site-packages/datasets/download/streaming_download_manager.py", line 973, in download_and_extract
return self.extract(self.download(url_or_urls))
File "/opt/conda/lib/python3.8/site-packages/datasets/download/streaming_download_manager.py", line 909, in download
url_or_urls = map_nested(self._download, url_or_urls, map_tuple=True)
File "/opt/conda/lib/python3.8/site-packages/datasets/utils/py_utils.py", line 436, in map_nested
return function(data_struct)
File "/opt/conda/lib/python3.8/site-packages/modelscope/msdatasets/download/download_manager.py", line 60, in _download
return oss_utilities.download(
File "/opt/conda/lib/python3.8/site-packages/modelscope/msdatasets/utils/oss_utils.py", line 106, in download
oss2.resumable_download(
File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 162, in resumable_download
downloader.download(result.server_crc)
File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 388, in download
q.run()
File "/opt/conda/lib/python3.8/site-packages/oss2/task_queue.py", line 44, in run
raise self.__exc_info[1]
File "/opt/conda/lib/python3.8/site-packages/oss2/task_queue.py", line 76, in __consumer_func
consumer(self)
File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 410, in __consumer
self.__download_part(part)
File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 425, in __download_part
utils.copyfileobj_and_verify(result, f, part.end - part.start, request_id=result.request_id)
File "/opt/conda/lib/python3.8/site-packages/oss2/utils.py", line 860, in copyfileobj_and_verify
fdst.write(buf)
OSError: [Errno 22] Invalid argument
您在下载youku-mPLUG预训练数据集时遇到了连接超时或其他网络问题。这可能是由于网络状况不佳、下载链接失效或服务器故障等原因导致的。
建议您尝试以下方法解决问题:
检查网络连接:请确保您的网络连接正常,可以通过ping命令检查与下载服务器的连接是否正常。
重试下载:网络问题可能导致下载过程中出现断点,建议您多次尝试下载,直到成功为止。
更换下载链接:如果当前链接失效,您可以尝试在官方网站或其他可靠来源查找并使用其他下载链接。
使用下载工具:您可以使用下载工具(如wget、curl等)来下载数据集,这些工具支持断点续传和自动重试等功能,可以提高下载成功的概率。
联系数据集提供者:如果以上方法均无法解决问题,建议您联系youku-mPLUG预训练数据集的提供者,寻求技术支持或其他帮助。
您好,抱歉给您带来使用问题,您可以去数据集的modelcard页面,更新到最新的modelscope库版本来解决这个问题