Portál AbcLinuxu, 26. dubna 2024 00:23
Kdyz se snazim uploadovat male soubory, tak je to strasne pomale 4KB/s
Kdyz uploaduji jeden velky soubor, tak prenos je 800KB/s.
Absolutne nevim kde hledat. Mam nastaveny passive FTP, porty jsou presmerovany, netstat ukazuje spojeni na portu 21 a take na vysokem portu.
Syslog ukazuje:
Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:21 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:31 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192
proftpd.conf ServerName "Debian" ServerType standalone UseIPv6 off DeferWelcome off MultilineRFC2228 on DefaultServer on ShowSymlinks on DefaultRoot ~ IdentLookups off UseReverseDNS off ServerIdent on "FTP Server ready." RequireValidShell off TimeoutNoTransfer 600 TimeoutStalled 600 TimeoutIdle 1200 DisplayLogin welcome.msg DisplayFirstChdir .message ListOptions "-l" DenyFilter \*.*/ # Uncomment this if you are using NIS or LDAP to retrieve passwords: #PersistentPasswd off # Uncomment this if you would use TLS module: #TLSEngine on # Uncomment this if you would use quota module: #Quotas on # Uncomment this if you would use ratio module: #Ratios on # Port 21 is the standard FTP port. Port 21 PassivePorts 60000 60500 # To prevent DoS attacks, set the maximum number of child processes # to 30. If you need to allow more than 30 concurrent connections # at once, simply increase this value. Note that this ONLY works # in standalone mode, in inetd mode you should use an inetd server # that allows you to limit maximum number of processes per service # (such as xinetd) MaxInstances 30 # Set the user and group that the server normally runs at. User nobody Group nogroup # Umask 022 is a good standard umask to prevent new files and dirs # (second parm) from being group and world writable. Umask 022 022 # Normally, we want files to be overwriteable. AllowOverwrite on # Delay engine reduces impact of the so-called Timing Attack described in # http://security.lss.hr/index.php?page=details&ID=LSS-2004-10-02 # It is on by default. DelayEngine off
syslog se mi nepovedl tak znova.
Mar 10 06:27:11 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:21 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:31 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192 Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat()
Pricin muze byt nekolik. Prvni sit nedokaze prenest dostatek packetu/s. Druha, ze to nezvladaji disky. I kdyz 4kb/s je zalostne malo. No a za treti chyba nekde v konfiguraci.
Ahoj.
Add 1.
Kdyz dokazu prenest jeden velky soubor 800KB/s (jak jsem psal), tak to sit asi dokaze.
Add 2.
Zase, kdyz prenasim soubor 800KB/s a disky to zvladaji, tak by to mely zvladat i pri prenosu vice souboru. Jinak disky to urcite zvladaji.
Add 3.
Dost mozny, ale kde? 
No myslim, ze jsi si akorad nevsiml, ze jsem psal, ze upload jednoho velkeho souboru (400MB) frci jak po masle (800KB/s), ale jak vezmu adresar s malymi soubory, tak ta rychlost strasne klesne. Zajimalo by me jak je to mozny?
Jestli na druhe strane neni limiter na pocet otevrenych FTP spojeni,
nebo skusit --set-tos 0x008, nebo trekovani. Dale jsen nasel toto
jako vhodnou volbu: IdentLookups off UseReverseDNS off
NN
Limiter to neni.
Prisel jsem na to a je to velice zajimave. Chyba je ve formatu proftpd.conf. Mrknete se na ten co jsem vlozil nahore. To je default konfigurak v debianu.
Pridal jsem sekci <Global> a naskladal do ni vse co jsem mel v tom konfiguraku. Restartoval jsem demona a ten mi vzdy rekl co do te "Global" sekce nepatri. Tim jsem vyradil par options, ktere tam asi nepatri. Zbylo mi to co vidite dole.
Kdyz to schrnu, tak to bylo tim, ze jsem nemel seckci "Global" a v ni nejake ty options, ktere tam patri.
ServerName "Debian" ServerType standalone DefaultServer on UseIPv6 off DeferWelcome off MultilineRFC2228 on UseReverseDNS off # Port 21 is the standard FTP port. Port 21 # To prevent DoS attacks, set the maximum number of child processes # to 30. If you need to allow more than 30 concurrent connections # at once, simply increase this value. Note that this ONLY works # in standalone mode, in inetd mode you should use an inetd server # that allows you to limit maximum number of processes per service # (such as xinetd) MaxInstances 30 <Global> ShowSymlinks on DefaultRoot ~ IdentLookups off ServerIdent on "FTP Server ready." RequireValidShell off TimeoutNoTransfer 600 TimeoutStalled 600 TimeoutIdle 1200 DisplayLogin welcome.msg DisplayFirstChdir .message ListOptions "-l" DenyFilter \*.*/ # Uncomment this if you are using NIS or LDAP to retrieve passwords: #PersistentPasswd off # Uncomment this if you would use TLS module: #TLSEngine on # Uncomment this if you would use quota module: #Quotas on # Uncomment this if you would use ratio module: #Ratios on # Use Passive ftp PassivePorts 60000 60500 # Set the user and group that the server normally runs at. User nobody Group nogroup # Umask 022 is a good standard umask to prevent new files and dirs # (second parm) from being group and world writable. Umask 022 022 # Normally, we want files to be overwriteable. AllowOverwrite on # Delay engine reduces impact of the so-called Timing Attack described in # http://security.lss.hr/index.php?page=details&ID=LSS-2004-10-02 # It is on by default. DelayEngine off # A basic anonymous configuration, no upload directories. # <Anonymous ~ftp> # User ftp # Group nogroup # # We want clients to be able to login with "anonymous" as well as "ftp" # UserAlias anonymous ftp # # Cosmetic changes, all files belongs to ftp user # DirFakeUser on ftp # DirFakeGroup on ftp # # RequireValidShell off # # # Limit the maximum number of anonymous logins # MaxClients 10 # # # We want 'welcome.msg' displayed at login, and '.message' displayed # # in each newly chdired directory. # DisplayLogin welcome.msg # DisplayFirstChdir .message # # # Limit WRITE everywhere in the anonymous chroot # <Directory *> # RequireValidShell off # # # Limit the maximum number of anonymous logins # MaxClients 10 # # # We want 'welcome.msg' displayed at login, and '.message' displayed # # in each newly chdired directory. # DisplayLogin welcome.msg # DisplayFirstChdir .message # # # Limit WRITE everywhere in the anonymous chroot # <Directory *> # <Limit WRITE> # DenyAll # </Limit> # </Directory> # # # Uncomment this if you're brave. # # <Directory incoming> # # # Umask 022 is a good standard umask to prevent new files and dirs # # # (second parm) from being group and world writable. # # Umask 022 022 # # <Limit READ WRITE> # # DenyAll # # </Limit> # # <Limit STOR> # # AllowAll # # </Limit> # # </Directory> # # </Anonymous> </Global>
Jeste mala zmena:
PassivePorts patri ven z Global section. Tedy nahoru hned za Port.
Kdyby to admini opravili aby to bylo komplet a prehledne, tak by to bylo fajn.
Tak jsem se predcasne unahlil. Spatne jsem testoval.
Rychlost je stale pomala.
FTP upload jedu pres LAN - router - FTPserver. Vse jede na 1G. To jen abychom isolovaly vse co by mohlo orezat rychlost. Zadne filtry, atd.
tcpdump nebo WireShark a sledovat, kde to vázne.
K tomuhle bych akorat dodal, jestli mas vse na 1Gbit, tak prenos dat by nemel probihat 800kbyte/s ale 7-35Mbyte/s s tim, ze male soubory by meli jit pomaleji, ale zase ne 4kbyte/s. Zkus prenaset soubory primo mezi FTP serverem a notebookem nebo PC bez dalsich prvku. Tim se opravdu vyresi, jestli je to v siti nebo ne. Pri prenosu je dobre jeste sledovat vytizeni CPU jak na serveru, tak na tom PC, ze ktereho prenasis. Dale je dobre pouzit nejaky kvalitnejsi FTP klient. Napr. total commander pri urcitem nastaveni nedokaze prenest vic jak 500-800kbyte/s.
pouzitelny free klient je napriklad filezilla, ale jsou i dalsi.
Jasne, tech 800KB/s je spojeni pres WAN. Pres LAN mi to jede jak rikas, az 35MB/s. Ale jen jeden velky soubor. Male soubory proste nejedeou.
Pozivam ftp clienta v Linuxu (CLI). Take ftp v Dolphin v KDE4.
Fakt bych rekl, ze problem je zakopanej v Proftpd.
Kdyz se snazim uploadovat male soubory, tak je to strasne pomale 4KB/s
Kdyz uploaduji jeden velky soubor, tak prenos je 800KB/s.
AFAIK, je to takpoviediac "ficura" FTP protokolu. Kazdy prenos sa najskor dohodne cez kontrolne spojenie, potom sa pren urobi nove datove spojenie a cez to sa prenesu data. Takze zatial co prenos velkeho suboru cez FTP vytazi maximum z infrastruktury na ktorej bezi, tak prenos velkeho poctu suborov je stupidne neefektivny.
Skus najst, ci ProFTPd a zucastneny klient vedia robit nejaku formu "keep-alive" ci "pipeline" prenosu cez datovy kanal. Upozornujem, ze "strielam od boku" a netusim, ci nieco take je vobec cez FTP mozne.
Pasivni FTP a rozsirit rozsah pasivnich portu?
jen napad,
NN
Tak snad je videt z konfiguraku, ze pouzivam passive port a ze mam 500 portu.
Tiskni
Sdílej:
ISSN 1214-1267, (c) 1999-2007 Stickfish s.r.o.