开发者学堂课程【上云迁移实战:使用 ossfs 迁移非结构数据】学习笔记,与课程紧密联系,让用户快速学习知识。
课程地址:https://developer.aliyun.com/learning/course/514/detail/6858
使用 ossfs 迁移非结构数据
1、非结构化数据到 OSS 迁云: ossfs 迁云实践
(1)前提
完成 OSS bukect 创建
AK 创建及 OSS 权限分配
(2)运行环境
CentOS 7.2 64bit
eossfs_1.80.3 centos7.0_x86_64
2、非结构化数据到 OSS 迁云:步骤
(1)安装 ossfs
获取 ossfs 安装包
#wget-o“ossfs1.80.3centos7.0x8664rpm
”http://docs-aliyuncn-hangzhou.oss.aliyun-
inc.com/assets/attach/32196/cnzh/1507811577850/ossfs1803 centos70x86 64rpm?spm=5176doo
32196.2.6.A0qxWs&file=ossfs180.3centos7.0x8664rpm
(2)配置 OSS 信息
设置 bucket name 和 AccessKeyId/Secret 信息,将其存放在 /etc/passwd-ossfs 文件中,注意这个文件的权限必须正确设置,建议设为 640。
(3)挂载 OSS 至本地目录
将 OSSbucket mount 到指定目录
# ossfs my-bucket my-mount-point-ourl=my-oss-endpoint
(4)复制源站非结构化数据
复制源站非结构化数据至 OSS 挂载目录
打开 OSS 控制台查看结果
3、演示
(1)获取 ossfs 并安装
wget -0 "ossfs 1.80.3 centos7.0 x86 64.rpm"
http://docs-aliyun.cn-hangzhou.oss.aliyun-inc.com/assets/attach/32196/cn zh/1507811577850/ossfs 1.80.3 centos7.0 x86 64.rpm?spm=5176.doc32196.2.6.A QqxWs&file=ossfs 1.80.3 centos7.0 x86 64.rpm
yum -y localinstall
ossfs 1.80.3 centos7.0 x86 64.rpm
(2)设置 bucket name 和 AccessKeyId/Secret 信息
echo ossfs-edu:xxxx:Ra7gMHOdzV8gZQjXDdp 6t0 WAzZ9xoa >/etc/passwd-ossfs
(3)配置权限
chmod 640 /etc/passwd-ossfs
(3)将 osS bucket mount 到指定目录
ossfs ossfs-edu /mnt
-ourl=oss-cn-beiiing-internal.aliyuncs.com
[root@iZ2zebopxrlqc6acv01l40Z ~]# wget -0 "ossfs 1.80.3 centos7.0 x86 64.rpm"http://docs-aliyun.cn-hangzhou.oss.a liyun-inc.com/as sets/attach/32196/cn zh/1507811577850/os sfs 1.80.3 centos7.0 x8664.rpm?spm=5176.doc32196.2.6.AQqx Ws&file=ossfs 1.80.3 centos7.0 x86 64.rpm
[1]9470
[root@iZ2zebopxrlgc6acv01140Z~]#--2017-11-06 04:02:05-- http://docs-alivun.cn-hanazhou.oss.alivun-inc.com/assets/attach/32196/c n zh/1507811577850/ossfs 1.80.3 centos7.0 x86 64.rpm?spm=5176.doc32196.2.6.AQqxWs
Resolving docs-aliyun.cn-hangzhou.oss.aliyun-inc.com(docs -aliyun.cn-hangzhou.oss.aliyun-inc.com)... 42.120.230.2
Connecting to docs-aliyun.cn-hangzhou.oss.aliyun-inc.com(d ocs-al iyun.cn-hangzhou.oss.aliyun-inc.com)|42.120.230.21:8 0... connected.
HTTP request sent, awaiting response... 200 OK
Lenath:1149462 (1.1M)[application/octet-stream]
Saving to: 'ossfs 1.80.3 centos7.0 x86 64.rpm’
100%[=======================>] 1,149,462 1.47MB/s in 0.7s
2017-11-06 04:02:06 (1.47 MB/s) . 'ossfs 1.80.3 centos7.0 x86 64. rpm’saved [1149462/1149462]
[1]+ Done wget -0 "ossfs 1.80.3 centos7.0 x86
64.rpm”http://docs-aliyun.cn-hangzhou.oss.aliyun-inc.com/assets/attach/32196/cn zh/1507811577850/ossfs 1.80.3 centos7.0 x86 64.r pm?spm=5176.doc32196.2.6.AQqxWs
[root@iz2zebopxrlqc6acv01140Z-]# yum -y localinstall ossfs 1.803 centos7.0 x86 64.rpm
Loaded plugins: fastestmirror
Examining ossfs 1.80.3 centos7.0 x86 64.rpm:ossfs-1.80.3- 1.x86 6
Marking ossfs 1.80.3 centos7.0 x86 64.rpm to be installed Resolving Dependencies
--> Running transaction check
---> Package ossfs.x86 64 0:1.80.3-1 will be installed
Arch Version Repository Size
=====================================================
Installing:
ossfs x8664 1.80.3-1 /ossfs 1.80.3 centos7.0 x86 64 4.0 M
Transaction Summary
=====================================================
Install 1 Package
Total size: 4.0 M
Installed size: 4.0 M
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing :ossfs-1.80.3-1.x86 64 1/1
Verifying:ossfs-1.80.3-1.x86 64 1/1
Installed:
ossfs.x86 64 0:1.80.3-1
Complete!
[root@iZ2zebopxrlgc6acv01140Z~]#echo ossfs-edu:LTAI0uJKg YHDYGgE
:Ra7qMH0dzV8aZ0iXDdp6t0WAzZ9xoa>/etc/passwd-ossfs
[root@iZ2zebopxrlgc6acv01140Z -1# chmod 640 /etc/passwd -ossfs
[root@iZ2zebopxrlgc6acv01140Z~]# ossfs ossfs-edu /mnt -ourl=oss-cn-beiiing-internal.aliyuncs.com
[root@iZ2zebopxrlgc6acv01140Z ~]#ls
1. png 2.png 3.png ossfs 1.80.3 centos7.0 x86 64.rpm
[root@iZ2zebopxrlqc6acv01l40Z~]# cp./* /mnt/
[root@iZ2zebopxrlgc6acv01l40Z ~]# ll /mnt
total 1597
-rw-r--r-- 1 root root.. 161490 Nov 6 04:03 1.png
-rw-r--r-- 1 root root? 161490 Nov 6 04:03 2.png
-rw-r--r-- 1 root root 161490 Nov 6 04:03 3.png
-rw-r--r-- 1 root root 1149462 Nov 6 04:03 ossfs 1.80.3 centos7. 0 x86 64.rpm
[root@iZ2zebopxrlgc6acv01140Z ~]#
到控制台去查看:
非结构化数据已经传到 ossfs 上。