Administrace komentářů

Zdravim,

toto tema me zajima. Problemu muze byt vice a to i na strane serveru a ne na strane klienta. Rsync totiz per soubor dela pomerne dost metadata operaci na strane serveru (vypisy jsou z verzi 3.0.9 na klientu a 3.0.4 na serveru):

Toto jsou operace pro jeden novy soubor na strane serveru:

3090  1350825670.190272 lstat("linux-3.4.9-gentoo.10/arch/arm/mach-omap2/board-zoom-debugboard.c", 0x7fff95b06940) = -1 ENOENT (No such file or directory) <0.001303>

3091  1350825691.894455 select(5, NULL, [4], [4], {30, 0}) = 1 (out [4], left {29, 999997}) <0.000012>
3091  1350825691.894515 write(4, ""..., 8) = 8 <0.000019>
3091  1350825691.894582 open("linux-3.4.9-gentoo.10/arch/arm/mach-omap2/board-zoom-debugboard.c", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000547>
3091  1350825691.895178 open("linux-3.4.9-gentoo.10/arch/arm/mach-omap2/.board-zoom-debugboard.c.BVJsNA", O_RDWR|O_CREAT|O_EXCL, 0600) = 1 <0.002558>
3091  1350825691.897779 fchmod(1, 0600) = 0 <0.002224>
3091  1350825691.900058 write(1, ""..., 3350) = 3350 <0.003614>
3091  1350825691.903712 close(1) = 0 <0.000015>
3091  1350825691.903759 lstat("linux-3.4.9-gentoo.10/arch/arm/mach-omap2/.board-zoom-debugboard.c.BVJsNA", {st_mode=S_IFREG|0600, st_size=3350, ...}) = 0 <0.000025>
3091  1350825691.903837 utimes("linux-3.4.9-gentoo.10/arch/arm/mach-omap2/.board-zoom-debugboard.c.BVJsNA", {{1350825691, 0}, {1350820690, 0}}) = 0 <0.000461>
3091  1350825691.904343 chmod("linux-3.4.9-gentoo.10/arch/arm/mach-omap2/.board-zoom-debugboard.c.BVJsNA", 0644) = 0 <0.004003>
3091  1350825691.908391 rename("linux-3.4.9-gentoo.10/arch/arm/mach-omap2/.board-zoom-debugboard.c.BVJsNA", "linux-3.4.9-gentoo.10/arch/arm/mach-omap2/board-zoom-debugboard.c") = 0 <0.003544>

Na strane klienta pak:

32459 1350825662.709026 lstat("linux-3.4.9-gentoo.10/arch/arm/mach-omap2/board-zoom-debugboard.c", {st_mode=S_IFREG|0644, st_size=3350, ...}) = 0 <0.000008>
....
32459 1350825681.527884 open("linux-3.4.9-gentoo.10/arch/arm/mach-omap2/board-zoom-debugboard.c", O_RDONLY) = 3 <0.000007>
32459 1350825681.527911 fstat(3, {st_mode=S_IFREG|0644, st_size=3350, ...}) = 0 <0.000005>
32459 1350825681.527942 read(3, ""..., 3350) = 3350 <0.000313>
32459 1350825681.528286 close(3) = 0 <0.000005>

V pripade, ze soubor jiz existuje, je to jednodussi, ale z nejakeho duvoud dojde ke dvoum statum na strane serveru:

25558 1350830502.774044 lstat("linux-3.4.9-gentoo/arch/arm/mach-tegra/board-seaboard.c", {st_mode=S_IFREG|0644, st_size=7902, ...}) = 0 <0.002337>
.....
25558 1350830502.868738 lstat("linux-3.4.9-gentoo/arch/arm/mach-tegra/board-seaboard.c", {st_mode=S_IFREG|0644, st_size=7902, ...}) = 0 <0.000014>

Na strane klienta:

32643 1350830500.817663 lstat("linux-3.4.9-gentoo/arch/arm/mach-tegra/board-seaboard.c", {st_mode=S_IFREG|0644, st_size=7902, ...}) = 0 <0.000006>

Tj. na serveru se pro novy soubor dela paradoxne daleko vic metadata operaci. Na filesystemech, kde jsou metadata operace pomale, coz jsou typicky distribuovane FS , to pak jede velmi pomalu. Jestli jsem to pochopil spravne, tak je to prave Vas priklad? Jestli ano, jak dlouho trva projit tech 10M souboru findem pri COLD cachi (sync; echo 3 > /proc/sys/vm/drop_caches) na strane klientu a serveru?

Navic rsync ve verzi < 3.0.0. nejdrive udela incremental list a pak az prochazi soubory, od verze 3.0.0 to uz dela naraz. Jakou mate verzi, jake mate OS, verzi jadra? A jaka je latence mezi klientem a serverem?