NLP自学习平台对话分类项目,训练模型报错,帮忙看一下呢?
2024-05-21 22:50:10 - info 11.196.23.194 training start.clusterId:54394
{"pod_name":"54394-job-blvlb"
"status":"Error"
"status_info":"exit code is 1"
"training_log":"[2024-05-21 14:50:25,897] worker.py ():140 [INFO] Namespace(params='{\"method\":\"train\",\"upload_data\":{\"model_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/model/1_NLP_dialog_classification_bert_X7_work_order_classification_1.tar.gz\",\"metric_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/metrics/1_NLP_dialog_classification_bert_X7_work_order_classification_1.json\"},\"algo_params\":{\"model_info\":{\"re_train\":false,\"num_gpus\":1,\"type\":\"NLP_dialog_classification_bert\"},\"super_model_params\":{\"auto_select\":true,\"semi_supervised_model\":\"self_training\",\"data_augmentation\":false},\"hyper_params\":{\"lr\":5e-05,\"epochs\":6}},\"download_data\":{\"resource_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification/dialogbert/resource/zh900k-bigdata.zip\",\"train_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71\"}}')
[2024-05-21 14:50:25,900] data_loader.py download_file():53 [INFO] file_url:oss://nlp-automl-public/1/online/NLP_dialog_classification/dialogbert/resource/zh900k-bigdata.zip
[2024-05-21 14:50:25,900] data_loader.py download_oss():142 [INFO] begin to download file : oss://nlp-automl-public/1/online/NLP_dialog_classification/dialogbert/resource/zh900k-bigdata.zip
[2024-05-21 14:51:38,397] data_loader.py download_oss():151 [INFO] success to download file : oss://nlp-automl-public/1/online/NLP_dialog_classification/dialogbert/resource/zh900k-bigdata.zip to /data/zh900k-bigdata.zip
[2024-05-21 14:51:38,398] data_loader.py download_file():53 [INFO] file_url:oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71
[2024-05-21 14:51:38,398] data_loader.py download_oss():142 [INFO] begin to download file : oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71
[2024-05-21 14:51:38,455] data_loader.py download_oss():151 [INFO] success to download file : oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71 to /data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71
[2024-05-21 14:51:39,396] worker.py process_py():104 [INFO] call train: {\"model_info\": {\"re_train\": false, \"num_gpus\": 1, \"type\": \"NLP_dialog_classification_bert\"}, \"super_model_params\": {\"auto_select\": true, \"semi_supervised_model\": \"self_training\", \"data_augmentation\": false}, \"hyper_params\": {\"lr\": 5e-05, \"epochs\": 6}, \"resource_file\": \"/data/zh900k-bigdata.zip\", \"train_file\": \"/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71\", \"model_file\": \"/data/1_NLP_dialog_classification_bert_X7_work_order_classification_1.tar.gz\", \"metric_file\": \"/data/1_NLP_dialog_classification_bert_X7_work_order_classification_1.json\"}
Traceback (most recent call last):
File \"/home/user/miniconda/lib/python3.8/runpy.py\", line 193, in _run_module_as_main
return _run_code(code, main_globals, None,
File \"/home/user/miniconda/lib/python3.8/runpy.py\", line 86, in _run_code
exec(code, run_globals)
File \"/home/user/miniconda/lib/python3.8/site-packages/algo_worker/train/worker.py\", line 142, in
worker.run()
File \"/home/user/miniconda/lib/python3.8/site-packages/algo_worker/train/worker.py\", line 127, in run
self.process()
File \"/home/user/miniconda/lib/python3.8/site-packages/algo_worker/train/worker.py\", line 119, in process
self.process_py()
File \"/home/user/miniconda/lib/python3.8/site-packages/algo_worker/train/worker.py\", line 105, in process_py
obj = cls(algo_params)
File \"/home/user/miniconda/lib/python3.8/site-packages/business/train/DialogBertTrainDriver.py\", line 19, in init
self.loader = data_loader(params)
File \"/home/user/miniconda/lib/python3.8/site-packages/business/data_process/data_loader_bert.py\", line 45, in init__
self.trains, self.valids, self.task_label_counter = data_process_utils.load_and_split_data(params)
File \"/home/user/miniconda/lib/python3.8/site-packages/business/data_process/data_process_utils.py\", line 97, in load_and_split_data
assert len(raw_train_datas) > 0, 'need at least one train data'
AssertionError: need at least one train data
{\"method\":\"train\",\"upload_data\":{\"model_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/model/1_NLP_dialog_classification_bert_X7_work_order_classification_1.tar.gz\",\"metric_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/metrics/1_NLP_dialog_classification_bert_X7_work_order_classification_1.json\"},\"algo_params\":{\"model_info\":{\"re_train\":false,\"num_gpus\":1,\"type\":\"NLP_dialog_classification_bert\"},\"super_model_params\":{\"auto_select\":true,\"semi_supervised_model\":\"self_training\",\"data_augmentation\":false},\"hyper_params\":{\"lr\":5e-05,\"epochs\":6}},\"download_data\":{\"resource_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification/dialogbert/resource/zh900k-bigdata.zip\",\"train_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71\"}}
"}
你这个json文件作为json解析的时候会报错
这个地方有问题,不是字符串
此回答整理自钉群“阿里云NLP自学习平台用户答疑群二群”
版权声明:本文内容由阿里云实名注册用户自发贡献,版权归原作者所有,阿里云开发者社区不拥有其著作权,亦不承担相应法律责任。具体规则请查看《阿里云开发者社区用户服务协议》和《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容,填写侵权投诉表单进行举报,一经查实,本社区将立刻删除涉嫌侵权内容。